Skip to content
Check my site

ChatGPT search

Why isn't my website showing up in ChatGPT?

ChatGPT search only shows sites that OAI-SearchBot can reach. Check robots.txt, your CDN firewall and your raw HTML, then fix what's blocking it.

Check it: run the free check at IndexDoctor (index-doctor.com). It fetches your page as a normal browser, Googlebot, GPTBot and ClaudeBot, reads your robots.txt rules for OAI-SearchBot and the other AI crawlers, and tells you in plain English what's blocking them.

The short answer

ChatGPT can only show and cite your pages in its search answers if OpenAI's search crawler, OAI-SearchBot, is allowed to read them. OpenAI says sites that opt out of OAI-SearchBot "will not be shown in ChatGPT search answers, though can still appear as navigational links" (OpenAI crawlers). So the first job is to make sure nothing on your side turns that bot away. After that, whether ChatGPT picks you is up to its ranking: OpenAI says "placement is not guaranteed".

There are four usual reasons a site is missing, and you can check each one yourself.

1. robots.txt blocks OAI-SearchBot

Open yourdomain.com/robots.txt. You have a problem if:

  • a group for User-agent: OAI-SearchBot says Disallow: /, or
  • the User-agent: * group says Disallow: / and no group names OAI-SearchBot.

To fix it, add this and keep your other rules:

Example

User-agent: OAI-SearchBot
Allow: /

OpenAI says it can take about 24 hours after a robots.txt change for its systems to adjust (OpenAI crawlers).

Blocking GPTBot is a different thing. GPTBot collects content that may be used to train OpenAI's models. OpenAI says the two settings are independent: you can allow OAI-SearchBot to appear in search and disallow GPTBot to stay out of training (OpenAI crawlers). Plenty of sites block GPTBot on purpose and still show up in ChatGPT search.

2. Your CDN or host firewall blocks it, even though robots.txt says yes

robots.txt is only a request. A firewall, a CDN bot setting or a security plugin can still answer the bot with a 403 or a challenge page. OpenAI asks site owners to "confirm that the website host or content delivery network allows traffic from OpenAI's published searchbot IP addresses" (listed at https://openai.com/searchbot.json).

How to check:

  • Compare what a browser gets with what a crawler user-agent gets. If the browser gets a 200 and the bot gets a 403, 429 or a "Just a moment…" page, the block is in your CDN or firewall, not robots.txt.
  • Look in your CDN's bot settings. We have step-by-step guides for Cloudflare and Vercel.

A user-agent test from outside is a strong hint, not proof: some firewalls verify real bots by IP address, so they treat the real OAI-SearchBot differently from a test. Your CDN or server logs are the final word.

3. Your words aren't in the HTML

If your site is a single-page app (common with Lovable, Bolt and v0 builds), the HTML the server sends may be an empty <div id="root"> until JavaScript runs. OpenAI doesn't document JavaScript rendering for OAI-SearchBot, so the safe assumption is that it reads what's in the raw HTML. Test it:

  1. Open your page and use View Source (not Inspect).
  2. Search for a sentence from the page.
  3. If it isn't there, crawlers that don't run JavaScript see a blank page. Fix it with server-side rendering or prerendering. See Lovable, v0 and Bolt pages that Google never sees.

Google can render JavaScript, but it's a separate step that can delay indexing (Google: JavaScript SEO basics), so the same fix helps you in Google too.

4. The page is set to noindex

OpenAI says that if you don't want a page shown, use the noindex meta tag, and that its crawler can only read the tag if it's allowed to crawl the page (OpenAI Publishers FAQ). If you left a sitewide noindex from staging, remove it from the pages you want found. See noindex explained.

If access is fine and you're still missing

Then it's not a crawling problem. ChatGPT picks from the pages its search finds for each question, so:

  • make sure you have a page that answers the exact question people ask (for example "X vs Y" or "best tool for Z"),
  • describe your product the same way everywhere (site, listings, profiles),
  • check that ChatGPT knows which "you" it's talking about, especially if another product has a similar name.

How to tell if it's working

OpenAI says ChatGPT adds utm_source=chatgpt.com to links it sends, so you can see ChatGPT visits in your analytics (OpenAI Publishers FAQ).

Quick checklist

  • [ ] robots.txt doesn't disallow OAI-SearchBot
  • [ ] Your CDN or host gives OAI-SearchBot a 200, not a 403 or challenge
  • [ ] The page text is in View Source
  • [ ] No noindex on pages you want found
  • [ ] You waited about 24 hours after a robots.txt change

Run the free check: IndexDoctor (index-doctor.com) shows the browser, Googlebot, GPTBot and ClaudeBot fetches and reads your robots.txt for OAI-SearchBot, so you can see in one place which layer is blocking.

FAQ

Does blocking GPTBot remove me from ChatGPT?

Not from ChatGPT search. That's controlled by OAI-SearchBot. GPTBot is for training (OpenAI crawlers).

What about ChatGPT-User?

It's used when someone asks ChatGPT to open a page. OpenAI says it isn't used to decide what appears in search (OpenAI crawlers). See our ChatGPT-User page.

How long does it take?

OpenAI only states the ~24 hours for robots.txt changes. There's no promised time for a page to start appearing.

Related