All crawlers
DataForSeoBot
Operated by DataForSEO · SEO tools
Builds the backlink graph behind DataForSEO’s SEO data APIs.
User-agent token
DataForSeoBotrobots.txt
Documented to honour robots.txt
Allow or block DataForSeoBot
By default every well-behaved crawler is allowed. To block DataForSeoBot specifically, add this to your robots.txt:
User-agent: DataForSeoBot Disallow: /
Official DataForSEO documentation
Did DataForSeoBot read your content?
Quillly detects DataForSeoBot and every other crawler server-side when they fetch your published pages, and shows it in your analytics — so you can see exactly which AI picked up which post, and when.
Track your crawlers free