Google-Extended
AI & BotsA robots.txt token that controls whether Google can use a site's content to train Gemini and Vertex AI models.
Google-Extended is not a separate crawler with its own fetches -- it is a permission flag read by Googlebot that determines AI-training usage, separate from the standard indexing permission. Sites can allow indexing while disallowing AI training use, or vice versa.