Stephanie Cohen & Mike Butcher

Fireside Chat with Cloudflare's Chief Strategy Officer, Stephanie Cohen (with Mike Butcher MBE)

What if website owners could charge AI companies for scraping their data? Cloudflare's CSO explains their new framework to block, allow, or charge for access.

Fireside Chat with Cloudflare's Chief Strategy Officer, Stephanie Cohen (with Mike Butcher MBE)
#1about 2 minutes

Cloudflare's new default to block AI training crawlers

Cloudflare now defaults to blocking AI training crawlers, giving website owners the choice to block, allow, or charge for access via a new beta.

#2about 2 minutes

Creating a sustainable ecosystem for online content

The new crawler controls were developed in response to feedback from publishers and AI companies to ensure the continued creation of high-quality content.

#3about 1 minute

How to access the new crawler control features

To use the new pay-per-crawl beta and other AI crawler controls, users must proxy their traffic through Cloudflare, which is available on the free plan.

#4about 2 minutes

How the developer platform supports an AI ecosystem

Cloudflare's developer platform is optimized for AI agents with features like global distribution, data localization, and efficient CPU and GPU usage.

#5about 2 minutes

Verifying bots and agents with Web Bot Auth

Web Bot Auth provides cryptographic verification to confirm a bot's identity, preventing impersonation and ensuring trust in an agent-driven internet.

#6about 2 minutes

Preparing for a future with AI agents

The internet is evolving to be optimized for machines, and Cloudflare is enabling this shift with tools like a remote MCP and an agent SDK.

#7about 3 minutes

The evolving cybersecurity landscape with AI

AI increases cybersecurity risks like sophisticated DDoS attacks, making it crucial to differentiate between good and bad bots to protect websites.

#8about 3 minutes

How AI is changing human interaction with the web

As users shift from traditional search to AI-generated answers, it's essential to maintain incentives for human-created content to ensure a vibrant internet.

#9about 2 minutes

Ensuring content authenticity in the AI era

Initiatives like C2PA are crucial for verifying content authenticity, allowing users to know if media is human-generated and has not been altered.

#10about 3 minutes

How developers can build on and engage with Cloudflare

Developers are encouraged to experiment with Cloudflare's free tier, provide direct feedback, and leverage the global network to build their applications.

#11about 2 minutes

What to expect next from Cloudflare's innovation pipeline

Expect continuous product announcements on the company blog, special releases during the annual Birthday Week, and ongoing updates to the AI agent platform.

Related jobs
Jobs that call for the skills explored in this talk.

Featured Partners

Related Articles

View all articles
DC
Daniel Cranney
AI & A11Y, Meta's privacy and the future of SEO
Inside last week’s Dev Digest 173 . 🏆 GitHub reaches 1bn repos, with underwhelming final submission 🎮 Atari 2600 beats ChatGPT at chess 💬 Chatbots don’t improve work for 7k companies 🕵️ Meta AI app is a privacy disaster ⚠️ Microsoft Copilot’s Zero C...
AI & A11Y, Meta's privacy and the future of SEO
CH
Chris Heilmann
With AIs wide open - WeAreDevelopers at All Things Open 2025
Last week our VP of Developer Relations, Chris Heilmann, flew to Raleigh, North Carolina to present at All Things Open . An excellent event he had spoken at a few times in the past and this being the “Lucky 13” edition, he didn’t hesitate to come and...
With AIs wide open - WeAreDevelopers at All Things Open 2025
CH
Chris Heilmann
Dev Digest 116 - WWWAI?
This time, learn how to un-AI Google's search results, what's new on the web, avoid a new security hole and go back to BASICS with us. News and ArticlesWhat a week. Google, Microsoft, OpenAI and many others had their big flagship events announcing th...
Dev Digest 116 - WWWAI?

From learning to earning

Jobs that call for the skills explored in this talk.