Cloudflare AI Crawl Control : utile ?

Yes, essential if you host on Cloudflare. Free service launched in 2024, it visualises in real time the AI bots crawling your site, per bot, per country, per URL path. The only free tool that quantifies bot activity precisely without log gymnastics.

What Cloudflare AI Crawl Control actually does in 2026

Cloudflare AI Crawl Control launched in beta in late 2024 and reached general availability in 2025. It's today the only mainstream dashboard that shows, in real time, which AI crawlers visit a site and how often, without custom integration. Three core functions: observation, control, monetisation.

Function 1, Detailed observation. The dashboard lists requests by known user-agent: GPTBot, OAI-SearchBot, ClaudeBot, Claude-SearchBot, Claude-User, PerplexityBot, Google-Extended, CCBot, Bytespider and more. It flags compliance (or not) with your robots.txt: which bots try to access blocked sections, how often, from which IP ranges. According to Cloudflare data, AI crawler traffic represents 5 to 15% of total traffic on a premium editorial site in 2026.

Function 2, Three actions per crawler. For each identified AI crawler, the admin has three choices: allow, charge, block. "Allow is the default for real-time retrieval crawlers such as OAI-SearchBot, PerplexityBot and Claude-SearchBot: without that green light, you vanish from LLM citations," stresses Lorenzo Eeman, founder of PROEMA. Block is coherent for training crawlers if you want to pull your content from the next corpus. Charge is the pay-per-crawl option Cloudflare shipped in 2025 and extended to all paying customers in 2026.

Function 3, Pay-per-crawl (HTTP 402). Cloudflare generalised pay-per-crawl in 2026: your origin returns HTTP 402 (Payment Required) to the AI crawler, and Cloudflare bills the bot operator on your behalf for each successful crawl. The mechanism is still experimental, publisher adoption is a minority, but it lays the first brick of a potential training-data market. Most relevant for high-volume press publishers.

Practical verdict. For any brand serious about GEO, AI Crawl Control became baseline mandatory in 2026, same league as Analytics, GA4 or Search Console were for SEO. Zero cost (included in every paid Cloudflare plan), immediate benefit: you stop flying blind on AI bots. On the GEO Rocket portfolio, the dashboard is one of the monthly measurement sources, cross-referenced with citation rate tracking via the vertical question panel.