Apple
Applebot-Extended
A robots.txt control for Apple's use of web content in generative features. It is not the same token as Applebot for search.
- Who runs it
- Apple
- robots.txt token
- Applebot-Extended
- User-agent
- See the operator's documentation for the current full string.
Apple documents the robots.txt token Applebot-Extended so you can opt out of that use without disallowing Applebot. Use Apple's crawler page for the current user-agent string rather than a copied guess.
Applebot crawls for Apple products that need a web index. Applebot-Extended is the token Apple tells publishers to use if they want to opt out of their content being used to train foundation models for Apple Intelligence and related features.
You can disallow Applebot-Extended and still allow Applebot. Write both groups if those should differ.
This check does not live-probe Applebot-Extended. The robots.txt rule is still something you can read yourself, and the free check shows the groups it understands.
Example robots.txt rules
Examples for your file, using the documented token. They are not a copy of the operator's own robots.txt.
Allow
User-agent: Applebot-Extended Allow: /
Block
User-agent: Applebot-Extended Disallow: /
Related guides
Other crawlers
Questions
- Does this token control Siri web results?
- Apple's page distinguishes Applebot from Applebot-Extended. Read that page for which product each token covers. Do not treat them as one switch.