All crawlers
Claude-User
Operated by Anthropic · AI answers
Fetches a page when Claude answers a user’s question and cites it.
User-agent token
Claude-Userrobots.txt
Documented to honour robots.txt
Allow or block Claude-User
By default every well-behaved crawler is allowed. To block Claude-User specifically, add this to your robots.txt:
User-agent: Claude-User Disallow: /
Official Anthropic documentation
Did Claude-User read your content?
Quillly detects Claude-User and every other crawler server-side when they fetch your published pages, and shows it in your analytics — so you can see exactly which AI picked up which post, and when.
Track your crawlers free