Cloudflare's Attribution Business Insights: The Crawl-to-Referral Ratio That Exposes AI Bots

Cloudflare just dropped a new dashboard called Attribution Business Insights, and it's aimed squarely at the broken economics of AI crawling. The headline feature: a per-bot-operator crawl-to-referral ratio that makes it painfully clear which crawlers are leeching your bandwidth and which ones are actually sending you traffic.

The old internet deal was simple: search engines crawl your site a couple times for every referral they send back. That's a sustainable ratio. But Cloudflare's data shows that major AI crawlers have ratios ranging from 118:1 all the way up to nearly 50,000:1. In other words, an AI bot might hit your premium content tens of thousands of times and send back exactly one visitor. That's not a partnership — it's extraction.

This dashboard, available now to all Cloudflare Bot Management customers, cuts through the noise. It shows you bot vs. human traffic, site-wide and per-operator crawl-to-referral ratios over 24h/7d/30d windows, top bots by volume with bandwidth usage and country of origin, and a new classification system that labels crawlers as Training, Search, or Agent — so you know whether they're training an LLM, refreshing a RAG database, or answering an end-user query in real time.

The key insight here is that Cloudflare is deliberately keeping the action plane separate from the analytics plane. Attribution Business Insights is a read-only hub for business decision-makers — not another place to write security rules. You investigate here, then go enforce in the existing Security rules engine. That's a smart separation of concerns that invites non-security stakeholders (publishers, business ops) into the conversation without cluttering the control plane.

Cloudflare also teases a per-article breakdown coming next, which will show which specific pieces of content AI companies are hungriest for. That's the kind of granularity that turns analytics into leverage for licensing negotiations.

If you're running a content site behind Cloudflare and you haven't looked at your crawl-to-referral ratios yet, you're flying blind. This dashboard is the instrument panel you've been missing.