Quillly All crawlers
Bytespider
Operated by ByteDance · Training crawlers
Public-content crawler for ByteDance models.
User-agent token
Bytespiderrobots.txt
robots.txt compliance not documented
Allow or block Bytespider
By default every well-behaved crawler is allowed. To block Bytespider specifically, add this to your robots.txt:
User-agent: Bytespider Disallow: /
Did Bytespider read your content?
Quillly detects Bytespider and every other crawler server-side when they fetch your published pages, and shows it in your analytics — so you can see exactly which AI picked up which post, and when.
Track your crawlers free