engines
Claude-SearchBot
Anthropic's retrieval crawler for Claude's web tool — separate from ClaudeBot (training).
Definition
Claude-SearchBot is Anthropic's retrieval-side crawler — the one that fetches pages when Claude's web-search tool is invoked. Like OpenAI's split, it's separate from ClaudeBot which is used for training. Blocking it kills Claude's citation eligibility.
Example
User-agent: Claude-SearchBot\nAllow: / (allows Claude to cite you when users ask questions)How to optimize
Allow Claude-SearchBot in robots.txt. Anthropic also fetches /llms.txt — publish one. VectorCite's AI-bot access signal flags this automatically.