ai-bot-access
AI bot access (robots.txt)
TrustImpact: Medium
What we measure
Whether robots.txt explicitly addresses GPTBot/ClaudeBot/PerplexityBot.
Why it matters for AI citation
Default-allow gets you crawled, but explicit allow signals intent + unlocks niche AI bots.
How to fix
Add User-agent: GPTBot/ClaudeBot/OAI-SearchBot/PerplexityBot rules to robots.txt.
Source
OpenAI / Anthropic / Perplexity bot docs
Category
Trust
Crawl-time + share-time trust signals: HTTPS, canonical, viewport, AI-bot access via robots/llms.txt, Twitter card, meta description.
See your score on this signal.
The free audit scores your page on all 47 signals — including this one.
Run free audit