All crawlers
Google-Extended
Operated by Google · Training crawlers
robots.txt token controlling Gemini model training.
User-agent token
Google-Extendedrobots.txt
Documented to honour robots.txt
Allow or block Google-Extended
By default every well-behaved crawler is allowed. To block Google-Extended specifically, add this to your robots.txt:
User-agent: Google-Extended Disallow: /
Did Google-Extended read your content?
Quillly detects Google-Extended and every other crawler server-side when they fetch your published pages, and shows it in your analytics — so you can see exactly which AI picked up which post, and when.
Track your crawlers free