notableReviewed Sat Oct 31

Randomized field experiment finds fewer organic clicks when AI Overviews appear

A randomized field experiment using a custom Chrome extension compared Google Search with AI Overviews against an AIO-hidden condition, measuring organic outbound clicks, zero-click searches and perceived search quality.

Context

A randomized field experiment using a custom Chrome extension compared Google Search with AI Overviews against an AIO-hidden condition, measuring organic outbound clicks, zero-click searches and perceived search quality.

What changed

In the experiment, conditional on an AI Overview appearing, outbound organic clicks were 39.8% lower and zero-click searches 34.5% higher with AIO exposure. Sponsored clicks and overall search frequency did not detectably change; the study found no measurable survey improvement in perceived search quality.

Why it matters

AI search citation visibility does not necessarily translate into publisher referral traffic. Controlled exposure evidence helps distinguish observed changes in search clicks from correlation in platform-level analytics.

Visibility OS interpretation

Visibility OS interpretation: track downstream clicks and zero-click behavior alongside AI Overview exposure and citation frequency; the experiment does not establish a universal traffic reduction or direct publisher revenue losses.

What remains uncertain

How do estimates generalize to other countries, devices, search intents and native rollout conditions? What longer-run behavioral adaptations occur? How robust is the exploratory AI Mode arm?

Evidence claims

Emerging Evidenceintroduces

In a randomized Chrome-extension field experiment, conditional on an AI Overview appearing, the AIO-exposed group generated 39.8% fewer outbound organic clicks and 34.5% more zero-click searches than the AIO-hidden group, according to the authors.

Randomized field experiment finds fewer organic clicks when AI Overviews appear | Visibility OS