Cloudflare has just issued the AI industry a new deadline to separate the web crawlers used for traditional search purposes, like Google Search, from those used for AI agents and training. Starting on September 15, 2026, Cloudflare’s default settings will block “mixed-use” crawlers from any pages that host ads, the company announced on Wednesday. That means that the crawlers that blend search, agent use, and training will be blocked from crawling these sites by default, unless…
Why this update matters
This developing story is relevant for readers tracking technology because it reflects fresh changes from the original source and signals where attention is shifting next.
Key details
The report was collected automatically and prepared for publication with a newsroom workflow that focuses on clarity, search visibility, and quick understanding.
Readers should review the original source for direct statements, official notices, and any later corrections or additions as the story evolves.
Related coverage
Continue reading with more reporting from the same topic cluster.