Cloudflare Unveils Marketplace to Charge AI Bots for Scraping Next Year

Sep 23, 2024, 02:05 PM

Cloudflare has announced a suite of new tools aimed at helping website owners regain control over their content from AI bots. The tools include a marketplace that allows websites to charge AI companies for scraping their content, as well as free AI auditing tools to monitor and selectively block AI data-scraping bots. These features will be available to all Cloudflare customers, including those using its free services. The marketplace is expected to launch next year and will enable website owners to sell access to AI model providers. The tools also offer a one-click block feature and a dashboard showing which AI crawlers are accessing the site. Cloudflare CEO Matthew Prince has highlighted the importance of these tools in combating the widespread issue of AI scraping.