Quillly All crawlers
Grok-DeepSearch
Operated by xAI · AI answers
Deep-research fetches for Grok answers.
User-agent token
Grok-DeepSearchrobots.txt
robots.txt compliance not documented
Allow or block Grok-DeepSearch
By default every well-behaved crawler is allowed. To block Grok-DeepSearch specifically, add this to your robots.txt:
User-agent: Grok-DeepSearch Disallow: /
Did Grok-DeepSearch read your content?
Quillly detects Grok-DeepSearch and every other crawler server-side when they fetch your published pages, and shows it in your analytics — so you can see exactly which AI picked up which post, and when.
Track your crawlers free