Applebot-Extended
Apple · Training crawler
What it does
Applebot-Extended collects page content to be used in model training. Controls use of your content for Apple foundation model training.
It runs on rendering infrastructure, so client-side content is generally visible to it. That makes it the exception rather than the rule among AI crawlers.
Should you block Applebot-Extended?
Blocking it keeps your content out of the training corpus. It does not remove you from any answer surface, because this crawler is not what answers are built from.
Your content is excluded from Apple foundation model training. Applebot itself continues to crawl for Siri and Spotlight, so your presence in Apple's search surfaces is unchanged.
To allow it
User-agent: Applebot-Extended
Allow: /To block it
User-agent: Applebot-Extended
Disallow: /Put the rule in your robots.txt at the site root. A group that names Applebot-Extended explicitly takes precedence over your User-agent: * group, so naming it is how you make your intent survive later edits to the wildcard rules.
Verifying a real Applebot-Extended request
Like Google-Extended, this is a usage-control token rather than a distinct crawler. Applebot proper can be verified by reverse DNS to an Apple-controlled hostname and a matching forward lookup.
The mistake people make
Blocking Applebot rather than Applebot-Extended when the intent was to opt out of training. That removes you from Siri and Spotlight results, which is almost never what was wanted.
Can Applebot-Extended reach your site?
The free scan parses your robots.txt, evaluates every AI crawler against it, and tells you how much of a page Applebot-Extended would actually come away with.
Run the free scan