All crawlers
AhrefsBot
Operated by Ahrefs · SEO tools
Crawls the open web continuously to build Ahrefs’ backlink index.
User-agent token
AhrefsBotrobots.txt
Documented to honour robots.txt
Allow or block AhrefsBot
By default every well-behaved crawler is allowed. To block AhrefsBot specifically, add this to your robots.txt:
User-agent: AhrefsBot Disallow: /
Did AhrefsBot read your content?
Quillly detects AhrefsBot and every other crawler server-side when they fetch your published pages, and shows it in your analytics — so you can see exactly which AI picked up which post, and when.
Track your crawlers free