# Google-Extended

> Google-Extended is a robots.txt product token, not a separate crawler. It controls whether content Google crawls may be used to train Gemini models and for grounding in Gemini Apps and Vertex AI. Google states it does not affect inclusion or ranking in Google Search, which includes AI Overviews and AI Mode.

- URL: https://geo.casa/crawling-indexing/google-extended/
- Reference · Officially documented
- Reviewed: 2026-10-25

## What it controls

> **Officially documented:**
> Google-Extended is "a standalone product token". It lets publishers manage whether content Google crawls from their sites may be used to train future generations of Gemini models. Those models power Gemini Apps and the Vertex AI API for Gemini. The token also covers grounding in Gemini Apps and Grounding with Google Search on Vertex AI.
>
> Sources: [Google: Google's common crawlers](https://developers.google.com/crawling/docs/crawlers-fetchers/google-common-crawlers)

## What it does not control

> **Officially documented:**
> "Google-Extended does not impact a site's inclusion in Google Search nor is it used as a ranking signal in Google Search."
>
> Sources: [Google: Google's common crawlers](https://developers.google.com/crawling/docs/crawlers-fetchers/google-common-crawlers)

AI Overviews and AI Mode are part of Google Search. To keep a site out of them, use the [Search generative AI control](https://geo.casa/ai-search/search-generative-ai-control/). To limit what they show from a page, use snippet controls ([Snippet controls for AI Overviews and AI Mode](https://geo.casa/crawling-indexing/snippet-controls/)).

> **Officially documented:**
> Search Console Help describes the same division from the other side. It says the Search generative AI control "doesn't affect AI training; to limit training of the models used to generate responses in Search generative AI features, use Google-Extended."
>
> Sources: [Google Search Console Help: Search generative AI control - Search Console Help](https://support.google.com/webmasters/answer/16908024)

Google's crawler documentation lists Google-Extended's scope as Gemini Apps and Vertex AI. The Search Console help article also names the models behind Search's generative AI features. Neither says Google-Extended removes content from those features.

## No separate crawler

> **Officially documented:**
> Google-Extended has no HTTP user-agent string of its own. Crawling is done with existing Google user agents, and the token is only read from robots.txt "in a control capacity".
>
> Sources: [Google: Google's common crawlers](https://developers.google.com/crawling/docs/crawlers-fetchers/google-common-crawlers)

You will not see "Google-Extended" in server logs. You also cannot block it at the firewall by user agent.

## Usage

```txt
user-agent: Google-Extended
disallow: /
```

Rules follow normal [robots.txt](https://geo.casa/crawling-indexing/robots-txt/) syntax, so partial opt-outs (`allow` / `disallow` by path) work too.

## See also

- [Configure robots.txt for AI crawlers](https://geo.casa/crawling-indexing/robots-txt-ai-crawlers/) — Google-Extended alongside GPTBot, OAI-SearchBot and others.

## Sources

- [Google: Google's common crawlers](https://developers.google.com/crawling/docs/crawlers-fetchers/google-common-crawlers)
- [Google Search Central: AI features and your website](https://developers.google.com/search/docs/appearance/ai-features)
- [Google Search Console Help: Search generative AI control - Search Console Help](https://support.google.com/webmasters/answer/16908024)