robots.txt blocks Applebot-Extended (Apple model-training opt-out)
Applebot-Extended is a publisher control for whether content already crawled by Applebot may be used to train Apple's general-purpose foundation models. Apple states that Applebot-Extended does not crawl webpages itself. This check found robots.txt disallowing Applebot-Extended.
Why this matters
This is a model-training policy choice, not an Apple Search visibility failure. Apple says pages that disallow Applebot-Extended can still appear in search results. Regular Applebot is the crawler used for Apple search experiences and can also provide up-to-date context to Apple AI features.
How to fix it
No change is required if the model-training opt-out is deliberate. If you want to permit Apple to use Applebot-crawled content for foundation-model training, remove or narrow the Applebot-Extended Disallow rule. Manage Apple search crawlability with the regular Applebot rules.
Turn website findings into an action plan
Create an account to start a Full Audit of your website, with supporting evidence and a prioritised action plan.
Start Full Audit