Google-Extended
A robots.txt control for whether your pages are used to improve Gemini models. It is not the crawler for Google Search.
- Who runs it
- robots.txt token
- Google-Extended
- User-agent
- See the operator's documentation for the current full string.
Google documents Google-Extended as a robots.txt token. Do not invent a separate browser user-agent for it. Use the token in robots.txt, and read Google's crawler list for what the token covers today.
Google-Extended is how a site opts out of its content being used to improve Gemini apps and Vertex AI generative models. Google lists it separately from Googlebot.
Disallowing Google-Extended does not block Google Search. Disallowing Googlebot does not mean you have opted out of that model use. Write both groups if you want both outcomes.
The token belongs in robots.txt. A managed robots file that blocks every AI name at once can include Google-Extended without you noticing.
Example robots.txt rules
Examples for your file, using the documented token. They are not a copy of the operator's own robots.txt.
Allow
User-agent: Google-Extended Allow: /
Block
User-agent: Google-Extended Disallow: /
Related guides
Other crawlers
Questions
- Will blocking Google-Extended hurt rankings?
- Google documents it as separate from Googlebot. Search crawling follows the Googlebot group.