Excluded by noindex tag
Excluded by noindex tag
A meta robots tag or X-Robots-Tag told Google to keep the URL out of the index.
noindex is working as written. Google fetched the URL, saw noindex in the HTML or the HTTP header, and dropped it. This is common on staging, thank-you pages, and on frameworks that ship a default robots meta.
Search the response for both the meta tag and the X-Robots-Tag header. A tag in a client component does not count until it is in the HTML Google downloads.
Remove noindex only on URLs you want indexed. Leave it on previews, internal search, and cart pages.
What to check
- Look at the raw HTML and response headers, not only the React tree.
- Check a layout or template that might add noindex to every page.
- After the tag is gone, wait for the next crawl. Do not ping an indexing API.
Fix prompt
Example prompt
This URL is excluded by a noindex robots meta tag or X-Robots-Tag header. Remove noindex from the server HTML and the HTTP headers if this URL should be indexed. Do not call an indexing API.
Check a URL · Crawlers · Glossary