All crawlers
AI2Bot
Operated by Allen AI · Training crawlers
Finds documents for AI research systems.
User-agent token
AI2Botrobots.txt
Documented to honour robots.txt
Allow or block AI2Bot
By default every well-behaved crawler is allowed. To block AI2Bot specifically, add this to your robots.txt:
User-agent: AI2Bot Disallow: /
Did AI2Bot read your content?
Quillly detects AI2Bot and every other crawler server-side when they fetch your published pages, and shows it in your analytics — so you can see exactly which AI picked up which post, and when.
Track your crawlers free