Quillly All crawlers
YouBot
Operated by You.com · Search indexes
Search / answer-index crawler for You.com.
User-agent token
YouBotrobots.txt
Documented to honour robots.txt
Allow or block YouBot
By default every well-behaved crawler is allowed. To block YouBot specifically, add this to your robots.txt:
User-agent: YouBot Disallow: /
Did YouBot read your content?
Quillly detects YouBot and every other crawler server-side when they fetch your published pages, and shows it in your analytics — so you can see exactly which AI picked up which post, and when.
Track your crawlers free