robots.txt written to server successfully! Your content is now live at ' . esc_html( $agenli_robots_url ) . '

'; $agenli_has_file = true; } else { echo '

Could not write robots.txt — check that your server user has write permission to: ' . esc_html( ABSPATH ) . 'robots.txt

'; } } } $agenli_quick_rules = array( 'Block /wp-admin/' => "Disallow: /wp-admin/", 'Allow all bots' => "User-agent: *\nAllow: /", 'Block GPTBot (ChatGPT)' => "User-agent: GPTBot\nDisallow: /", 'Block ClaudeBot' => "User-agent: ClaudeBot\nDisallow: /", 'Block CCBot' => "User-agent: CCBot\nDisallow: /", 'Block all AI crawlers' => "User-agent: GPTBot\nDisallow: /\n\nUser-agent: ClaudeBot\nDisallow: /\n\nUser-agent: CCBot\nDisallow: /\n\nUser-agent: anthropic-ai\nDisallow: /", 'Add sitemap reference' => "Sitemap: " . home_url( '/sitemap.xml' ), ); ?>

Robots.txt Manager

Control how search engine and AI crawlers access your website.

View robots.txt ↗
⚠️
Physical robots.txt file detected on your server
A real robots.txt file exists at robots.txt. WordPress cannot override it via plugin filter — so your custom content below is not currently live. Click the button to write your saved content directly to the server file.
View current robots.txt ↗
✓
No physical file detected. Your custom robots.txt content is live via WordPress filter. View robots.txt ↗
⚠ A physical robots.txt file exists in your WordPress root. WordPress and this editor cannot override a physical file. Please delete or edit it via FTP/cPanel File Manager.
Edit robots.txt
Quick Add
$agenli_rule ) : ?>
Reference
User-agent: * = all bots
Disallow: / = block all
Allow: / = allow all

Always add your Sitemap URL at the bottom.