Quillly All crawlers
meta-webindexer
Operated by Meta · Search indexes
Improves Meta AI search result quality.
User-agent token
meta-webindexerrobots.txt
robots.txt compliance not documented
Allow or block meta-webindexer
By default every well-behaved crawler is allowed. To block meta-webindexer specifically, add this to your robots.txt:
User-agent: meta-webindexer Disallow: /
Did meta-webindexer read your content?
Quillly detects meta-webindexer and every other crawler server-side when they fetch your published pages, and shows it in your analytics — so you can see exactly which AI picked up which post, and when.
Track your crawlers free