Google-Extended
Google's AI training crawler.
- Operator
- In the user agent
- does not appear
- robots.txt token
Google-Extended- Follows robots.txt
- says it follows robots.txt
- Official documentation
- not found; identified by its observed user agent
- Checked on
- 2026-11-04
What is Google-Extended?
Google-Extended is Google's AI training crawler. It collects pages that may be used to train AI models. A visit does not answer anyone right now; it decides what future models know about you.
The operator's description: robots.txt token controlling use of content for Gemini training and grounding; no separate crawler.
How do I block or allow Google-Extended?
With robots.txt, using the token Google-Extended. Google says it follows robots.txt. This token exists only in robots.txt: it never appears in requests, so it does not show up in logs. To block the whole site:
User-agent: Google-Extended
Disallow: /To allow it, use Allow instead of Disallow. Before blocking, weigh what it brings: blocking does not remove you from AI search, but future models will know less about you.
How do I see whether Google-Extended visits my site?
Google-Extended does not identify itself in the user agent; it looks like an ordinary browser. It can only be recognised by its signature or by the addresses its operator publishes, which is what Knocklog checks.
How do I know it is really Google-Extended?
Google does not publish a way to verify Google-Extended. Any program can use that name, so Knocklog shows these visits as “unverified”, never as genuine.
Does Google-Extended visit your site?
See in seconds how your site treats AI agents. Then connect your traffic to learn who really came.
Other Google agents
- Google-Agent Agentic browser
- Googlebot Search engine