# OAI-SearchBot > OAI-SearchBot is OpenAI's crawler for search indexing. Builds the index behind ChatGPT search. OpenAI is indexing your page so it can be found later — not answering a question right now. **Category:** AI crawlers **Also known as:** OpenAI OAI-SearchBot **Updated:** 2026-09-09 **Source:** https://truestat.io/glossary/openai-oai-searchbot --- ## What OAI-SearchBot is This is the crawler that decides whether you exist inside ChatGPT search. It is often blocked by accident, in a robots rule meant for GPTBot, and the cost is invisible: nothing breaks, you simply stop being offered as a source and there is no report anywhere telling you so. OpenAI runs four separate crawlers and gives each one its own token, which is more considerate than it first appears: it means you can refuse the training crawl and keep the one that puts you in ChatGPT's answers, using two lines in a robots file. Most operators on this site do not offer that choice. On this site OAI-SearchBot is counted as indexing, which is the row it appears in on your dashboard. The category matters because it decides which number moves when this crawler visits, and the four are reported separately for exactly that reason. ## What its traffic looks like A steady crawl over time rather than a burst: robots.txt first, then pages in waves, revisiting the ones that change often. Volume tracks how large and how frequently updated your site is. A sudden increase usually follows a sitemap change or a burst of new pages, and a sudden stop is worth investigating — it often means a robots rule or a server error rather than a decision by the operator. ## How it is verified Checked as ip ranges + reverse dns. The user agent has to carry the token, and then the address is compared against what OpenAI publishes — refetched every six hours, so a newly announced range is picked up without a deploy. A request that matches neither is recorded as unverified rather than as a forgery: a published list can be incomplete, and an accusation needs evidence. Only a reverse DNS record resolving to somebody else produces a spoofed verdict, which is proof rather than the absence of it. ## If you block it You stop being findable inside ChatGPT search. People asking ChatGPT about your subject will be shown competitors instead. This is a very different decision from blocking GPTBot, and the two are often confused because both are OpenAI. Treat this as a search-engine decision rather than an AI one, because that is what it is. The question is whether the people you want are looking through this engine, and your own analytics answer it better than any general advice can. It is worth checking what you actually lose before writing the rule. Blocking an index crawler is one of the few changes here with an effect that compounds quietly: nothing breaks on the day, and traffic simply stops arriving over the following weeks. ## How it differs from OpenAI's other crawlers OpenAI sends 5 crawlers and gives each its own token, so they can be allowed and refused separately. The tokens differ by a few characters and what the fetch means does not: ChatGPT-User — ai assistant. Fetches a page while ChatGPT is answering someone's question. ChatGPT-Agent — ai assistant. ChatGPT's agent mode browsing on a person's behalf. GPTBot — ai training. Collects public pages that may improve future OpenAI models. OAI-AdsBot — other bots. Checks pages submitted as ChatGPT ads. Confusing two of these is the most common mistake with this operator, and it is expensive in one direction: a rule meant for the training crawler that lands on the search crawler removes you from results without stopping any training. ## One real request ```text Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; OAI-SearchBot/1.0; +https://openai.com/searchbot ``` ## Questions ### Is OAI-SearchBot in my logs really OpenAI? Not necessarily, and that is why it is worth checking. Any script can send OAI-SearchBot as its user agent. OpenAI publishes the addresses its crawler uses, so the claim can be tested against them — a request from outside those ranges is recorded as unverified rather than accepted. ### How do I tell OAI-SearchBot apart from OpenAI's other crawlers? By the token, and only by the token. OpenAI also sends ChatGPT-User, ChatGPT-Agent, GPTBot, and the strings differ by a few characters while the jobs differ completely — one may be answering somebody's question while another collects training material. Match on the exact token rather than on the operator's name appearing anywhere in the header, or the four end up counted as one. ### Does OAI-SearchBot run JavaScript? No. It requests the HTML and leaves. That is why a browser-based analytics tag never records these visits: the tag is JavaScript, and nothing runs it. Seeing this crawler at all requires reading it server-side. ### Why is OAI-SearchBot counted as Indexing and not something else? Because that is the job this particular crawler does. OpenAI runs more than one — ChatGPT-User, ChatGPT-Agent, GPTBot — and they are counted separately because the decisions about them are separate. Filing them together under one operator name would let ordinary indexing look like AI interest, which is the single most misleading thing an AI traffic report can do. ### Why does OAI-SearchBot not show up in Google Analytics? Google Analytics runs in the browser. This crawler never opens a browser — it requests the HTML, reads it, and leaves, so the tracking script is never executed and no event is ever sent. Every browser-based analytics tool has the same blind spot, which is why crawler traffic has to be read from the server side to be seen at all. ### What happens if a OAI-SearchBot visit cannot be verified? It is recorded as unverified, not as a forgery. A published address list can be incomplete or behind — an operator can start using a range before it appears in the file — so a miss is not evidence of anyone pretending. A visit is only marked as spoofed when the address's own reverse DNS record resolves to somebody else, which is proof rather than absence of proof. ## Related - https://truestat.io/glossary/openai-chatgpt-user - https://truestat.io/glossary/openai-chatgpt-agent - https://truestat.io/glossary/openai-gptbot - https://truestat.io/glossary/openai-oai-adsbot - https://truestat.io/glossary/fcrdns - https://truestat.io/glossary/spoofed-crawler --- From the TrueStat glossary — https://truestat.io/glossary. Privacy-first web analytics that also shows you which AI assistants are reading your site.