Cloudflare Pay Per Crawl - No AI crawl without compensation! ✊
by•
Cloudflare introduces a groundbreaking "pay per crawl" system that enables content creators to monetize their content by charging AI crawlers for accessing their websites, providing a flexible alternative to blanket blocking or free access.
Replies
Raycast
First we had @x402 then L402... now Pay Per Crawl! Suddenly everyone wants to fix web payments just as agents undermine the economic model of the internet. Timely!
Product Hunt
Cloudflare is one of the few companies that could make this happen.
🌐⚡ Bold move from Cloudflare—power back to the creators! 💪
This “pay per crawl” idea is a smart way to let creators benefit from AI interactions! For smaller content sites, how easy is it to set up and manage the monetization rules, and can they customize pricing based on their content value?
Olly - AI Agent for Social Media
All the best for the launch
wow! congrats on the bold move and launch.
Very intersting. Is there any youtube on the oficial channel talking about?
Cloudflare continues to impress. Their performance, security, and reliability are unmatched—it's the backbone of every modern web project I build. From CDN to DDoS protection, they just get it right. Huge thanks to the team for making the internet faster and safer
Durable Objects as the state layer for agents is where Cloudflare pulls ahead of most managed agent platforms. Vercel, Modal, and Fly all make deployment easy, but none give you per-agent SQL storage that hibernates at zero cost when idle. AutoRAG is still rough around the edges with limited embedding options and AI Gateway locked to Llama models, but the fact that it provisions entirely within your own account means no third-party vector DB to manage or pay for separately.