Google reads your site with Googlebot, and only Googlebot's robots.txt rules affect Google Search. Its crawler documentation, updated 15 October 2026, says Googlebot's crawling preferences "affect Google Search (including Discover and all Google Search features)". Nothing you write for GPTBot, ClaudeBot, PerplexityBot or any other company's crawler is read by Google.
Google-Extended is the one that sounds like it should matter. It is Google's token for controlling whether crawled content "may be used for training future generations of Gemini models", and the same page says plainly: "Google-Extended does not impact a site's inclusion in Google Search nor is it used as a ranking signal in Google Search."
AI Overviews and AI Mode
Google's AI features page says a page is eligible for AI Overviews and AI Mode when it is indexed and can be shown with a snippet, and that robots.txt rules for Googlebot are the control. So the only block that removes you from Google's AI answers is a block on Googlebot, or a nosnippet or noindex rule. Blocking Google-Extended does not do it.
What blocking the others does cost
Blocking OAI-SearchBot removes you from ChatGPT search answers, by OpenAI's own description. Blocking PerplexityBot works against appearing in Perplexity, which recommends allowing it. Blocking ClaudeBot keeps your pages out of Anthropic's crawl. None of these changes your Google rankings, so the decision is about the AI assistants, not about SEO.
Decide per bot. Our robots.txt guide lists each crawler, what it feeds, and the line that allows or blocks it.
