Cloudflare Agent Readiness & AEO: Measure AI Agent Traffic

Cloudflare has integrated its Agent Readiness work into the dashboard and added a new Answer Engine Optimization (AEO) tool. The goal: give site owners a concrete picture of how AI agents see their site and whether those agents actually recommend them.

The company points out that fewer than half of all HTML page requests now come from humans, per its Radar data. That doesn't mean all bots are agents acting for a person, but the share is growing. Discoverability is shifting from ranking on a results page to being found, read, and confidently recommended by AI assistants.

Site owners have been staring at access logs full of AI bots with no idea whether those bots can use their site or recommend them. Two questions dominate: Can agents actually use my site? Am I getting recommended?

Diagnostics: The technical checkup

Agent Readiness Diagnostics scans your site the way an agent reads it. It checks robots.txt, sitemap, response headers, Markdown availability, and published metadata for authentication and tools. The results roll into a single readiness score, from 'Not Ready' to 'agent-native,' with pass/fail/neutral checks and an evidence trail.

Checks are grouped by effort:

Quick wins: crawler-readable robots.txt, XML sitemap, AI-crawler rules, clean Markdown for agents.
Technical groundwork: Content Signals, API catalog, link headers, agent login instructions.
Advanced integration: OAuth discovery, MCP and A2A agent cards, skills index, Web Bot Auth, WebMCP.
Commerce: emerging agent-payment standards like x402, ACP, UCP, AP2 — informational for now.

Each suggestion includes a next step, often a direct link to a Cloudflare setting or a 'Copy Agent Prompt' button for your coding agent.

AEO: Are AI assistants recommending you?

The AEO tab answers the second question. Cloudflare infers your industry and category, then probes leading assistants (Claude, GPT) with realistic customer prompts. Metrics include:

Citation Rate: share of answers citing your site.
Prominence: how much of the answer is yours and how early it lands.
Mention Rate: how often your brand is named, even without a citation.
Share of Voice: your slice of citations against competitors.

To avoid re-querying models for every scan, Cloudflare pre-computes a category-level baseline. That gives zero-latency results, lower compute overhead, and an Industry Fit score. Cloudflare AI Gateway prompts each assistant multiple times to account for variance, and Workers AI reads and scores the responses. An AI Operator Activity view shows real crawl and referral traffic per operator, plus errors like 403s and 404s.

The takeaway

This turns guesswork into measurement. Instead of grepping logs or eyeballing chatbot responses, you get actionable data. The bar is low because most sites aren't built for this audience yet — the ones that make themselves easy for agents to find, understand, and trust are the ones that get recommended.