Digiday: Dozens of new third-party scrapers emerging as the new middlemen of content
A $1 billion market has formed — yet content creators receive zero
Inside the four-step pipeline: scrape → process → sell → reuse
"Not a tax — a hostile takeover"… "Napster is back, but iTunes is nowhere in sight"s
A new kind of middleman has emerged in the AI era. The familiar "ad tech tax" of the digital advertising age took a slice of revenue. The new "AI data broker" takes the entire pie — 100% of the content, with nothing paid in return. Worse: in some cases the same content is recycled into competing products that push the original publishers out of the market entirely. How exactly does this mechanism work? Drawing on Digiday's May 4 report on the alarm spreading through the U.S. publishing industry, this explainer walks through the pipeline step by step.
◆ What Is an "AI Data Broker"? — The Industry That Feeds AI
The term "data broker" is not new. Traditionally it referred to firms that collected personal and consumer data and sold it to marketers and advertisers. But the "AI data brokers" Digiday's reporting describes are a different breed. These firms automatically scrape news articles, blog posts, images and videos from across the open web, process them into structured training datasets, and sell them — or expose them via APIs — to AI companies such as OpenAI, Anthropic and Google.