majorReviewed Mon Sep 14

Cloudflare separates AI traffic into Search, Agent, and Training

Cloudflare introduced a crawler-purpose taxonomy separating Search, Agent and Training traffic and announced new default controls.

Context

Cloudflare introduced a crawler-purpose taxonomy separating Search, Agent and Training traffic and announced new default controls.

What changed

Website owners could express different access policies based on how automated systems intend to use content.

Why it matters

AI visibility strategy must distinguish discovery/search access from model training and real-time agent access.

Visibility OS interpretation

Crawler access is becoming a first-class distribution decision rather than a binary allow/block choice.

What remains uncertain

No event-specific uncertainty note is recorded yet. This record may change as new evidence is reviewed.