# IndexDoctor

IndexDoctor tells a founder which pages Google and AI crawlers cannot see, why, and how to fix the page.
It is read-only. It does not request indexing.

- Home: https://index-doctor.com/
- Check a URL: https://index-doctor.com/check
- Pricing: https://index-doctor.com/pricing
- FAQ: https://index-doctor.com/faq
- Glossary: https://index-doctor.com/glossary
- Crawlers: https://index-doctor.com/crawlers
- Privacy: https://index-doctor.com/privacy
- Terms: https://index-doctor.com/terms

## Guides
- Crawled - currently not indexed: https://index-doctor.com/guides/crawled-currently-not-indexed
- Discovered - currently not indexed: what it means and how to fix: https://index-doctor.com/guides/discovered-currently-not-indexed
- Excluded by noindex tag: https://index-doctor.com/guides/excluded-by-noindex-tag
- Page with redirect: https://index-doctor.com/guides/page-with-redirect
- Duplicate without user-selected canonical: https://index-doctor.com/guides/duplicate-without-user-selected-canonical
- Alternate page with proper canonical: https://index-doctor.com/guides/alternate-page-with-proper-canonical
- Duplicate, Google chose different canonical: https://index-doctor.com/guides/duplicate-google-chose-different-canonical
- Soft 404: https://index-doctor.com/guides/soft-404
- Blocked by robots.txt: https://index-doctor.com/guides/blocked-by-robots-txt
- Blocked due to access forbidden (403): https://index-doctor.com/guides/blocked-due-to-access-forbidden
- Server error (5xx): https://index-doctor.com/guides/server-error-5xx
- Not found (404): https://index-doctor.com/guides/not-found-404
- Lovable, v0, and Bolt pages that Google never sees: https://index-doctor.com/guides/lovable-v0-bolt-pages-not-indexed
- Cloudflare blocking AI crawlers: https://index-doctor.com/guides/cloudflare-blocking-ai-crawlers
- Why is my page not indexed by Google?: https://index-doctor.com/guides/why-is-my-page-not-indexed
- How to check if Google can index my page: https://index-doctor.com/guides/how-to-check-if-google-can-index-my-page
- noindex explained: https://index-doctor.com/guides/noindex-explained
- robots.txt explained for beginners: https://index-doctor.com/guides/robots-txt-explained
- Is my Lovable, Bolt, or v0 site visible to Google?: https://index-doctor.com/guides/is-my-lovable-site-visible-to-google
- How to allow or block ChatGPT (GPTBot): https://index-doctor.com/guides/how-to-allow-or-block-gptbot
- How to allow or block ClaudeBot: https://index-doctor.com/guides/how-to-allow-or-block-claudebot
- How to allow or block PerplexityBot: https://index-doctor.com/guides/how-to-allow-or-block-perplexitybot
- Google-Extended explained: https://index-doctor.com/guides/google-extended-explained
- llms.txt explained: https://index-doctor.com/guides/llms-txt-explained

## Crawlers
- Googlebot: https://index-doctor.com/crawlers/googlebot
- Google-Extended: https://index-doctor.com/crawlers/google-extended
- Bingbot: https://index-doctor.com/crawlers/bingbot
- GPTBot: https://index-doctor.com/crawlers/gptbot
- OAI-SearchBot: https://index-doctor.com/crawlers/oai-searchbot
- ChatGPT-User: https://index-doctor.com/crawlers/chatgpt-user
- ClaudeBot: https://index-doctor.com/crawlers/claudebot
- Claude-User: https://index-doctor.com/crawlers/claude-user
- PerplexityBot: https://index-doctor.com/crawlers/perplexitybot
- CCBot: https://index-doctor.com/crawlers/ccbot
- Applebot-Extended: https://index-doctor.com/crawlers/applebot-extended
- Bytespider: https://index-doctor.com/crawlers/bytespider
- Meta-ExternalAgent: https://index-doctor.com/crawlers/meta-externalagent