notableReviewed Mon Sep 14

Cloudflare expands BotBase for bot and agent transparency

Cloudflare expanded BotBase so bot and agent operators can identify themselves and document what their automated systems do.

Context

Cloudflare expanded BotBase so bot and agent operators can identify themselves and document what their automated systems do.

What changed

Crawler identity, declared purpose and operator transparency gained a more formal infrastructure layer.

Why it matters

Verified crawler identity can affect whether publishers allow AI systems to retrieve content and therefore whether content remains discoverable.

Visibility OS interpretation

Bot identity is becoming part of the trust layer between publishers and AI systems.

What remains uncertain

No event-specific uncertainty note is recorded yet. This record may change as new evidence is reviewed.