Early-adopter pricing — $9/mo, before it rises.See plan →
All crawlers

AhrefsBot

Operated by Ahrefs · SEO tools

Crawls the open web continuously to build Ahrefs’ backlink index.

User-agent token
AhrefsBot
robots.txt
Documented to honour robots.txt

Allow or block AhrefsBot

By default every well-behaved crawler is allowed. To block AhrefsBot specifically, add this to your robots.txt:

User-agent: AhrefsBot
Disallow: /

Official Ahrefs documentation

Did AhrefsBot read your content?

Quillly detects AhrefsBot and every other crawler server-side when they fetch your published pages, and shows it in your analytics — so you can see exactly which AI picked up which post, and when.

Track your crawlers free

Related crawlers