All crawlers
MJ12bot
Operated by Majestic · SEO tools
Distributed crawler behind Majestic’s backlink index.
User-agent token
MJ12botrobots.txt
Documented to honour robots.txt
Allow or block MJ12bot
By default every well-behaved crawler is allowed. To block MJ12bot specifically, add this to your robots.txt:
User-agent: MJ12bot Disallow: /
Official Majestic documentation
Did MJ12bot read your content?
Quillly detects MJ12bot and every other crawler server-side when they fetch your published pages, and shows it in your analytics — so you can see exactly which AI picked up which post, and when.
Track your crawlers free