More Than Half the Traffic on the Web Is Now Machines, Not People

Cloudflare, which handles a large share of the world's internet traffic, reports that bots generate about 57 percent of web page requests. A growing portion are AI systems reading the internet to train on it or to answer questions about it.

Matthew Prince, the co-founder of Cloudflare — a company that sits in front of a substantial fraction of the world's websites — shared figures this month showing that automated programs now generate about 57.5 percent of requests for web pages. Humans account for the other 42.5 percent. Other measurements put the crossover slightly later but agree on the direction: the web became majority-machine sometime in the past two years, and the gap is widening.

Bots on the internet are not new. Search engines have crawled the web since the 1990s, and that arrangement was a fair trade: Google read your site, and sent you readers in exchange. What is new is the composition. Roughly a fifth of verified bot traffic is now AI crawlers, and about half of their requests are for training — reading your writing to build a model — rather than to answer a specific question and link back to you.

That breaks the old bargain. A crawler that takes your article to train a model, or to summarize it inside a chatbot, does not send you a reader. The publisher gets the cost of serving the request and none of the traffic. This is the mechanism underneath the lawsuits, the licensing deals, and the growing number of sites that now block AI crawlers outright.

There is a further consequence that is harder to price. If most of what reads the web is machines, and an increasing share of what is published to the web is written by machines, then the open internet is drifting toward being a system that talks mainly to itself. Nobody planned that, and nobody is obviously responsible for it.

For an ordinary reader nothing looks different today. But the economics that paid for the free web — write something, get found, get readers, sell something to them — is being quietly dismantled, and no replacement has been agreed on.