Google-Extended

A robots.txt control token, not a separate crawler, that lets sites opt out of Gemini and Vertex AI training without affecting Google Search or AI Overviews.

By Brandon MinaCEO, BrandPilot AIUpdated November 2026

Short answer

Google-Extended is a robots.txt control token, not a separate crawler, that lets websites opt out of having their content used to train Gemini and Vertex AI models. Blocking it does not affect a site's inclusion or ranking in Google Search or AI Overviews, which rely on Googlebot rather than this token.