Monetizing AI Scraping: Cloudflare's New Marketplace

0:00Hello, it is Ryan and I was on a flight the other day playing one of my favorite social spin slot games on Chumbacasino.com. I looked over at the person sitting next to me and you know what they were doing? They were also playing Chumbacasino. Everybody's loving having fun with it. Chumbacasino is home to hundreds of casino style games that you can play for free anytime, anywhere. So sign up now at Chumbacasino.com to claim your free welcome bonus. That's Chumbacasino.com and live the Chumba life. Sponsored by Chumbacasino. No purchase necessary. VGW group void. We're prohibited by law. On 21 plus, terms and conditions apply.

0:30Save big money on your outdoor projects now at Menards. Create stunning patios, walkways, and retaining walls with our huge in-stock selection of durable concrete blocks. Ready to take home today. Plus, get free estimates with our easy-to-use design program. In-store or on Menards.com. Save big money on our 12-inch smooth patio block. On sale now through September 13th. Plus, check out our weekly flyer on Menards.com for more great deals happening now. Save big money at Menards. Today on the podcast, we're talking about a really interesting business concept and maybe even side hustle for you. So listen up if you are interested in making money online.

1:09But Cloudflare is a company who just launched a marketplace that will now allow websites to charge AI bots for scraping their data. So if you have a blog you've spent the last 10 years working hard on and you're worried about you're losing traffic to Google, Google AI search, you may want to consider this. So we're going to talk all about that today. Before we do, Jayden, why don't you tell them about our school community? Yeah, so every single week, Jamie and I record an exclusive video. We don't post anywhere else and we post it on our school community. We have over 350 members and over 60 videos in our classroom from, you know, the last more than a year we've been running this thing.

1:51We have courses on a whole bunch of different online side hustles, AI marketing, how we're using AI tools and growth hacks to grow our businesses and careers. This week in particular, Jamie and I released a video which goes over how we've been able to use the Amazon Influencer Program to get free stuff. You can flip that. You can sell it. Jamie talks about getting a free couch. That's a thousand dollar couch from somebody and making video that was like a minute or two long and then be able to flip that or use it. So this is a jacket I am currently wearing. If you're watching the video free from the Amazon influencer program.

2:27So someone sent it to me for free and my wife messaged them and she got a bunch of other random stuff too. So this is a really cool thing. We made a whole video about this. If you're not interested in that, there are dozens of other videos on a ton of other topics. We'd love to have you as a Remember, it's$19 a month and there is a link in the description. All right, let's get into what Cloudflare is doing. I think this is really interesting. So the thing that Cloudflare has said is that they actually have about 20 % of the websites on the web are using them. I personally think I have like maybe 20 different websites personally that I have running through Cloudflare.

3:06It's just like the best. it protects you from essentially so they did something smart they made a free thing that protects you from a ddos attack i think it's called where essentially you try to overwhelm a website server by sending like you know a million uh visitors to it in like 10 seconds and crash their server and take their website offline it's it's you know i can't even remember what the acronym is but it's like a distributed over uh you know corporate security people are going to hate me for creating this. But anyways, this is what Cloudflare, one of their products is what it does is it helps with that.

3:39So anytime you hear about like some big website getting taken down by like, you know, North Korea's bot network, they always go to Cloudflare, get essentially hosted. So it's like it builds a screen between the website and the world. So when the world is accessing the website, they're actually going through Cloudflare. Cloudflare has got all these algorithms and AI that can detect if, you know, these are all from the same IP address for the same region and they'll block out all the bots. So your actual website server isn't getting overwhelmed and crashing. So that's something that I personally use them for.

4:07And so it doesn't surprise me that over 20 % of all the websites in the world are using Cloudflare because this is a pretty amazing service and it's very cheap. And probably, I don't know, maybe they sell like traffic data or something like that from that. Or maybe it's a lead or like a cost leader for a lot of their other services, which are more expensive. If you're on like, I think if you have like an insane amount of traffic, you probably got to pay them a lot for it. My websites It's probably just have never hit that, you know, million daily user threshold or anything like that. But the thing that they're doing now, I think, is so fascinating because for the last year, they had a bunch of different tools for all of these, you know, 20 percent of the people that are using them that essentially is a one click solution to block all AI bots.

4:49So you pretty much enable this thing. And if there's an AI bot going to scrape your website, you just block it. You don't have to do it. It was interesting. there's a whole um there's a whole like story from wikipedia a while back where they were saying like these bots that essentially are crawling wikipedia and scraping it are costing wikipedia insane amounts of money because the way they like store all the data on the wikipedia server is like if there's a website that doesn't get visited very often like a wikipedia page they store at like this really far back kind of cache section they're like it's not getting access very often um but because the bots access literally every single page all of the like cash pages were getting like hit very frequently and they had to pay a lot more money just like for the server of that so like man these things are costing us like so much money um i think they said something like 30 or 25 or 30 percent of all the traffic on wikipedia was just like bots scraping them and they're like sick of how much money it costs them and server bills so this is obviously a very useful tool now beyond just blocking these scrapers cloud player is letting you make money from it so i guess jamie tell us a little bit about uh what what they're doing with that yeah so i mean i i like i said at the beginning imagine you had a blog about uh you know fishing for uh seahorses and you're an expert you're like the best person in the world at fishing for seahorses you know how to capture them you know breed them in captivity all that and you have spent you know 10 to 15 years on this blog and it's your, it's how you make a living.

6:18So people are, you know, buying, you know, guides from you, books from you there, you know, you know, you're going to do speaking events, you're working one-on-one with other seahorse breeders. And all of a sudden Google AI search comes along and now if anyone ever wants information, they don't need to go to your website and you no longer are getting that income. Well, now you have a way to kind of still protect yourself and, um, potentially make some money. So I think it's a really interesting concept because, you know, I think in a sense, it isn't fair that, you know, your info that you, you know, work so hard to put out there is just kind of just basically being ripped off and used without any sort of compensation.

7:01So I feel like this is a great model moving forward, not just for blogs, but in any other sort of, you know, content creation, really. It's kind of cool, too, because this has been a problem. Like a lot of people have complained about. They're like, all the AI models are scraping our data, then they're training off of it, then they're selling it for 20 bucks a month subscriptions to ChatGPT. And I feel like there's very few people that could have done anything about this, but Cloudflare is one of the companies that just happens to sit between the public and most major or serious websites. And so they're kind of like the perfect person because they can essentially detect when someone is a bot.

7:38They can this IP address has hit like a million other websites today. This is not a normal human that's just, you know, obsessed with Wikipedia. And so like they are actually the person that can like detect that. So I think that's very cool. It's also a very clean UI for this marketplace that they've built. They're calling it pay per crawl, which is so funny. Like we have Google that does like, you know, pay per click and, you know, you got pay per view and now all of a sudden got paper crawl. So essentially, there's a AI audit, which is if you're familiar with Cloudflare, and you've been blocking these AI bots from scraping your website, there used to just be something that would, you know, you had a toggle that would like allow it or block it.

8:18Now there's a button that says charge. So now you can just charge them for it. And it's a marketplace. So you can you can kind of just pick what the price is. it's kind of interesting because I'm not sure if companies like the New York Times, which have kind of filed lawsuits against OpenAI, if they're going to be doing this, how they plan on monetizing. I feel like bigger websites like Reddit, for example, just locked all of their data, said no one's allowed to just crawl us. And if you do, we'll sue you. And then they go and strike like multimillion dollar deals with Google and are like, you can use our data for training, you know, Gemini 2.5 Pro or whatever the latest model is, but you got to pay us.

8:56And so Google, and I think Apple as well, Google, probably OpenAI are all paying licensing deals to Reddit. Now, most people's blogs are not as big as Reddit. And so you don't really have the like legal power and you're not a publicly traded company. So it's a lot harder for just your average Joe to, you know, tell OpenAI not to scrape them if you don't want them to. Reddit can do something like that. And so I think the bigger people can, smaller people cannot. So I think this is kind of a perfect solution. Something that was kind of interesting that their CEO was talking about, though, was like the concept of like agents negotiating these these like rates where like if you could, you could have an agent that's going out scraping, it needs certain data for like different projects or different things.

9:39Because the way that they're saying is like, right now, it's blocking web like AI models that are just crawling to scrape your data and put it into like an LLM. But in the future, you're gonna have agents that are out searching the web, looking for like information for maybe they're whoever's running them like a business. It's like, hey, go do research on this industry. We're trying to do a report on X, Y, and Z. So then it's scraping your website. You're not really getting anything from that agent scraping your website per se. So what they're recommending here is maybe when you actually have this monetization turned on, you're not just monetizing like if opening eyes, scraping the whole internet or like, you know, the thousand other companies building LLMs, but all of the agents that are running around the internet, the millions and millions of agents that are going to be running around the internet, scraping stuff as well.

10:22Uh, you might actually be able to monetize those as well, which I think is also a very interesting concept. Yeah. And I mean, I think this could be almost like an answer to the, uh, the whole music licensing thing we talked about to how, uh, you know, companies like Suno AI are training off this, the music. Well, how did the, how does the artist get compensated for that? Maybe they could put it behind some kind of paywall like this as well, you know, and then the more times it's crawled for or used, you know, it could be, they could be compensated. I don't know. I feel like they're, they're, they're onto something big here, I think.

10:57Yeah, I think this is pretty cool. So if you want to participate in this, the AI company and the publisher both have to be set up with different Cloudflare accounts. So if you're not already, you might want to be, try this if you're interested in it. And then in your account, you can actually set what rate you want to sell your crawls for. And publishers can set the rate for what they will pay essentially for a crawl. And then Cloudflare just acts as an intermediary between the transaction. They charge the AI company and then they pay you as a publisher or whoever the publisher is for this. So, I mean, it's fantastic.

11:33I love the marketplace model. Cloudflare is probably the only company. There's a handful, but Cloudflare is really the only one. I think I could successfully pull this off in a big way. You could imagine like Google would, but also Google's like the big one of the biggest crawlers. They've been doing it for free for so long. I think they wouldn't want to do that because they make them look like a hypocrite for all their free crawling. So, yeah, I think this is very interesting. Great play by Cloudflare. And if you're interested in making money online, you may want to get your website signed up with this and see if you start raking in some dough.

12:02If you do, please let us know over on the Hustle School community. There's a link in the description to that. We'd love to hear from you if this is a side hustle that you're making a lot of money on. Thanks so much for tuning in and we will catch you guys in the next episode. You don't just live in your home. You live in your neighborhood as well. So when you're shopping for a home, you want to know as much about the area around it as possible. Luckily, homes.com has got you covered. So you can get to know the neighborhood without ever setting foot in it. Each listing features a comprehensive neighborhood guide from local experts, including detailed video overviews and unbiased information from a multitude of sources.

12:39Basically, everything you'd ever want to know about a neighborhood, including the number of homes for sale, transportation, local amenities, cultural attractions, even things like median lot size and a noise score is available to you on homes.com. And if you have a family or plan on raising one, homes.com has all the information you need about the local schools in the area. Where your kids or future kids go to school is as important as any decision you'll make in the home shopping process. Homes.com. We've done your homework. Tyler Reddick here from 2311 Racing. Another checkered flag for the books.

13:13Time to celebrate with Chumba. Jump in at Chumbacasino.com. Let's Chumba. No purchase necessary. BTW Group. Void where prohibited by law. CT &C 21 Plus. Sponsored by Chumba Casino. Saving money on your outdoor projects now at Menards. Create stunning patios, walkways, and retaining walls with our huge in-stock selection of durable concrete blocks. Ready to take home today. Plus, get free estimates with our easy-to-use design program. In-store or on Menards.com. Save big money in our 12-inch smooth patio block. On sale now through September 13th. Plus, check out our weekly flyer on Menards.com for more great deals happening now.

13:50Save big money at Menards.