Free SEO Tool

Robots.txt Tester & AI Bot Validator

Verify robots.txt syntax rules, avoid accidental site-wide deindexing, and check bot accessibility for Googlebot, GPTBot, and PerplexityBot.

Robots.txt Content

Directive Health Checks

Global Deindex Block (`Disallow: /`)

Ensures you are not accidentally blocking all crawlers from indexation.

Safe (Not Blocked)

XML Sitemap Declaration

Ensures crawlers can locate the XML sitemap URL directly in robots.txt.

Sitemap Declared

AI Answer Engine Accessibility (GPTBot & Perplexity)

Checks if AI answer agents are recognized and permitted.

AI Bots Configured