In short
The episode has two main stories. First, it argues that Flock surveillance systems are used to track people, not just vehicles, via “freeform” natural-language searches that police can run across many cameras/networks. It also notes Flock’s cameras can include person-tracking models (e.g., Condor) and that even ALPR units can record video. Second, it reports that AI companies are buying large quantities of physical books (especially ISBN-bearing ones) to scan them for training data, potentially destroying the originals.
Guests
Joseph (host) and 404 Media co-founders Sam Cole, Emmanuel Mayberg, and Jason Kebler. Additional voices include Becky and Matthew Galt (The Abstract/404 Media) mentioned for an upcoming live event; experts cited include EFF’s Beryl Lipton and the Center for Democracy and Technology.
Key claims and examples
Police can search for descriptors like “tall man,” clothing/brands, and political symbols (e.g., “white Jeep with Trump flag”), sweeping up innocent people. Example: Florida Highway Patrol used a freeform car search (“black Dodge Durango”) and arrested Lindsay Isaacs for a fatal hit-and-run; she spent 13 days in jail, later found to be the wrong person. For books: a bookseller saw orders spike to hundreds/day; the episode links this to scanning for human-written text pre–Nov 30, 2022 and to “ISBN DB” offering bulk sourcing with anonymity/NDAs, referencing Anthropic’s “Project Panama.”
Written by AI. May contain mistakes. Listen to the episode to check what was said.
Chapters
Tap a time to open that second in VOCelebrating Three Years of 404 Media
1:02 to 4:16
Hosts discuss their upcoming anniversary events and ticket details.
“Gain access to that content at 404media.co.”
Introduction to Flock's Camera Tracking
4:16 to 6:02
Hosts begin discussing Flock cameras and their capabilities.
“And we'll definitely keep people updated on that.”
How Flock Cameras Conduct Freeform Searches
6:02 to 8:10
Discussion on how police use Flock cameras to conduct searches for individuals.
“And I just think that's something that's been really, really overlooked in the flock debate and the flock conversation.”
Impact of Flock Searches on Innocent People
8:10 to 10:38
Exploration of the implications of Flock's search capabilities on innocent individuals.
“Was this different than the process of figuring out how Flock is being used otherwise?”
Case Study: Flock's Search Gone Wrong
10:38 to 14:00
Hosts recount a specific incident where Flock's technology led to a wrongful arrest.
“the freeform searches are just in there as well.”
Tracking the Wrong Person: A Case Study
14:00 to 24:08
Explore a case where a woman was wrongly arrested due to flawed surveillance technology.
“And they pulled over this woman named Lindsay Isaacs, who was driving a black Dodge Durango.”
Tracking the Wrong Person: A Case Study
25:40 to 27:23
Explore a case where a woman was wrongly arrested due to flawed surveillance technology.
“when you purchase one pair at warbyparker.com slash 404.”
Tracking the Wrong Person: A Case Study
28:29 to 28:46
Explore a case where a woman was wrongly arrested due to flawed surveillance technology.
Book Trading Boom Linked to AI
28:46 to 31:02
Explore how AI companies are driving an unprecedented surge in book sales.
“I hope I included the correct headline If not, this is the one we're going with in the podcast and I'll just update in the show notes AI companies are buying tons of old books because they're free of AI slop.”
The Impact of AI on Book Sales
31:02 to 34:38
Discuss the implications of AI companies purchasing large volumes of books.
“So what does he suspect around these sales?”
Show all 14 chapters
AI Companies' Quest for Quality Data
34:38 to 38:06
Understand why AI companies are sourcing physical books for training data.
“So we know that AI companies are very hungry for books as AI training data.”
ISBN DB's Role in AI Book Acquisition
38:06 to 42:01
Examine how ISBN DB facilitates the acquisition of books for AI companies.
“Yeah, the key date being November 30th, 2022, the date that ChatGPT was released.”
The Anonymity of Buyers in Book Transactions
42:01 to 43:44
Explore how anonymity in book selling is structured and its implications.
“Then they also say that they make people sign NDAs.”
International Insights on Rare Book Trading
43:45 to 45:02
Discuss the international perspective on rare book trading and AI's impact.
“I think I saw some Spanish press and then I think you throw to a piece out of the Netherlands.”
Transcript
Automatic transcript. May contain errors.0:29This episode is brought to you by Google Chrome. another car and caused three people to die. And it had not a scratch on it, but they still arrested her. This woman spent 13 days in jail because she was falsely arrested.
1:00is also get access to additional episodes where we respond to the best comments. Gain access to that content at 404media.co. Also, remember to subscribe to our YouTube channel where you can watch all of our episodes, including this one. Subscribe at youtube.com slash at 404media.co. I'm your host, Joseph. And with me are the other 404 Media co-founders, the first being Sam Cole. Hey. Emmanuel Mayberg. Hello. And Jason Kebler. Hi. All right. So we are having, well, not just one event, two events to celebrate our third anniversary coming up. Sam, what are these two events? And of course, there will be a link directly to get tickets and the descriptions in the show notes.
1:47But what are we talking about, Sam? What are we doing? Yeah, we are throwing down in NYC in September. So we're turning three, end of August, early September. So we are going to throw two events. One of them is a live taping of the podcast. It's going to be talks. We're going to have Becky and Matthew Galt from The Abstract and 4-4 come and speak. So you get to meet them and hear them talk about their coverage areas, which are like science and data centers and all that kind of good stuff. So that'll be on September 3rd at the Green Space, which is a WNYC event space. It's in like the Chelsea area, if you're interested.
2:24That'll be September 3rd. And then on September 4th, next night, which is a Friday, we're going to go to Three's Brewing and have a big party. So come get a drink on us, come hang out. That's just going to be like a more casual hangout to celebrate three years. So subscribers get half off their ticket to 4For Media Live. If you're a subscriber at the supporter level, you can check your membership at 4formedia.co slash membership. 50 % off the live taping. For the party, you get into the party for free if you're a supporter level or subscriber. But there's various ways you can get into this party.
2:57You can pay full price if you want to also. But all of that information is at 4formedia.co slash three dash years. And you also just go to the website and find it. But yeah, it'll be in the show notes, all the info that you need. But we love doing these. It's a good chance to meet you guys in person and to see what's going on with you and what you're interested in and get some good FaceTime. Even though we're constantly in cyberspace, we do miss seeing you in real life. And we'll all be there. The whole gang will be there, which is a very rare treat. We're never all in the same city, so... Yeah, we're usually only in the same place ever for these parties, basically.
3:40Let me just stress, you said, come have a drink on us. You can probably have more than one. It's an open bar for several hours. Yeah, please have more than one drink. Yes. It's at a brewery. Drink the beer, please. Yeah, it's an open bar party for paid subscribers of 404 Media who get them for free. I don't know how much more attractive you can make it. And then if you're not a subscriber, you can also just pay for the ticket and you get access to an open bar. But yes, link to more details below. You should probably get tickets as soon as you can. Because I mean, I imagine especially as we get close to it, they're probably going to fill up.
4:17But yes, thank you, Sam. And we'll definitely keep people updated on that. For this first story, Jason, do you want to take us through it? Yeah, so we're continuing to talk about Flock, which over the last few months has really had quite a lot of opposition to it. We're starting to see a lot of people cut down Flock cameras. I guess there's a lot of discussion about what Flock cameras can and can't do, which is what this story is about. So this story is called How Cops Use Flock to Track People, Not Cars. Joseph, most people think of Flock as license plate reader cameras, but they do more than that.
5:00So what else do they do? Yeah. Yeah. So, I mean, they absolutely do track people as well. And it's not so much specific people. There isn't facial recognition and Flock will always stress that. There's no facial recognition on our cameras and that sort of thing. You can't type in a name and bring up somebody. But Flock cameras that police have access to can be searched as like a search engine. I think that's how you pull it in your edits to my article, Jason, which I think is a really good way to pull it. So they can just type in something like male with tattoos, Caucasian woman with Ugg boots or something like that, or any sort of permutation or combination of these words.
5:46And they can instantaneously search a bunch of these cameras, sometimes with stretches into the hundreds and hundreds of cameras at once to look for a specific person. Obviously, even if they're not typing in a name, they're clearly still looking for a specific person because they have this description, right? And I just think that's something that's been really, really overlooked in the flock debate and the flock conversation. And I feel like there's enough evidence to write about it now and like enough dialogue to bring it up as well. But yeah, they are constantly tracking not just license plates that go by, but all of the people as well.
6:29And it does depend on the specific sort of camera, and we'll get into that. Yeah, I mean, these are called freeform searches. What is a freeform search? Yeah, so a normal search for Flock is like when you just enter a license plate, right? There's a little dialog box where the cop can enter a license plate and that's it. Freeform is a product that Flock released, I think in early 2025. And I really paid attention to when it was launched because it sounded very, very interesting. And that Flock was saying, you can now type in natural language searches. Obviously, this is kind of getting on like the AI hype as well, right?
7:10Where, oh, I can ask the LLM to do this. I can ask ChatGPT to do this. Well, I can ask Flock's system to surface footage that may contain people that I'm interested in. So at the time when Flock announced freeform searches and freeform language searches, it was focused on vehicles. So you could type in stuff like red Ford pickup with a green sticker on it or something like that. Something that is descriptive of the vehicle but wouldn't fit into a license plate sort of search box. And this was how they were advertising it. But as this piece shows and as we'll go into in some of the examples, it's not just looking for vehicles.
7:55You can use those freeform searches to look for basically anything. And I just happen to focus on people because obviously, that's probably the most important part when you're talking about a privacy invading technology. How did you go about finding these? How did you obtain these searches? Was this different than the process of figuring out how Flock is being used otherwise? So when freeform searches were first announced, again, in 2025, I started doing a bunch of public records requests to various law enforcement agencies who I suspected might soon be using Freeform or might already. I can't remember exactly how, but often when a surveillance company will come out of a new product, they will include a testimonial from a specific law enforcement agency.
8:45Maybe they were testing it out. Like I've done this with Axon before when they introduced Draft1, which uses AI to provide summaries of body cam footage. So I did a bunch of FOIAs against law enforcement agencies that said they were demoing the technology. I did the same here with Flock and Freeform. I asked specifically, I want your records and databases related to Freeform searches. For whatever reason, those were denied at the time. So I kind of put it to the side. I thought, well, I'll come to this later then when maybe it's more widespread and maybe there are softer targets to send public records requests to.
9:23and then I'll get like some of these freeform searches. Then I was looking around haveibeenflocked.com, which is a very, very interesting website, which basically aggregates the results of a bunch of other people's public records requests against Flock for the license plate searches that we've done to show local cops who are looking up cameras for ice and tracked a woman who was seeking, who sought an abortion and, you know, All of the data that's contributed to this nationwide conversation on Flock, Have I Been Flock, aggregates and maybe not centralizes, but puts as much as it can in one place.
10:02I was going through there and very handily, Have I Been Flocked already has a section for free form searches because they're actually just included in the ordinary network audit as well. when we've sent these requests and when researchers who have acted as sources for us, they've done these requests as well. You ask the police force, I want the network audit of your flock searches and now bring up, here's all the license plates that were searched. This is when they were done. This is how many cameras were queried either in the town or potentially across the country. And this was the reason why.
10:36It turns out actually, very conveniently for us, the freeform searches are just in there as well. I think it's the column text underscore prompt. So thanks to Have I Been Flocked, I was able to just start going through those records and go, oh, okay. There's already a bunch of freeform searches out here. And now I can start seeing what sort of people searches police are doing through flock cameras and not just the license plates. So what were some of the searches that you found in there? As you mentioned, often when Flock is doing a search, or rather when a police is searching Flock, they'll just type in a license plate.
11:15But with this, they can get creative. It's essentially like using Flock as a Google search, more or less. So what are cops typing in? Yeah, there's kind of like two brackets of searches. Either they are quite specific, where it will be somebody searching for, for example, Atlanta Falcons, referencing the NFL team. So presumably looking for like a jersey or a shirt with that. Maybe it'll be cops searching for a man wearing a black t-shirt and shorts, which I guess isn't super specific, but it still has some characteristics there. American flag shirt, Dodger shirt came up as well. They're sort of more specific search terms, right?
12:02And then you have ones which are just incredibly vague, like tall man. Please search all of the cameras for tall man. And look, I mean, I'm sure authorities would say that, well, we have this piece of information that this missing person or the subject of investigation that we're trying to track down quickly was a tall man. That's all the information we have. Maybe we'll do that. And then maybe we'll get more solid information after that. there's a lot of tall men, presumably walking past cameras. So as some of the experts I spoke to, including Beryl Lipton at the Electronic Frontier Foundation, these are probably going to sweep up innocent people as well.
12:46Arguably even more so than the license plate stuff, right? I mean, Jason, you've been tracking this closely. There's been a lot of mistakes recently, right? Yeah, yeah. So I wanted to bring up one. This is actually... It's a freeform search, but it's a freeform search for car. So as you mentioned, this can be used to track people and we'll get back to that in a second. But it can also be used to track cars when the police are not sure of a license plate. So we've seen searches that are just like black SUV in Florida, things like this, very vague terms that are going to necessarily catch a bunch of different cars rather than just a specific license plate.
13:29you can type in red Acura and it will pull up all of the examples that they have of something like that. And so in Florida, this happened in October of 2025. There was a hit and run collision in which a black Dodge Durango hit another car and three people died. And the driver of that car drove off. And so the Florida Highway Patrol put in black Dodge Durango because some witness said, oh, it was like a black Dodge Durango. And they pulled over this woman named Lindsay Isaacs, who was driving a black Dodge Durango. And they arrested her and they put her in jail for 13 days. But she wasn't... It was the wrong car.
14:21It was the wrong person. Very interestingly and very insanely, they pulled her over in this black Dodge Durango that allegedly hit another car and caused three people to die. And it had not a scratch on it, but they still arrested her. And it turned out that a different black Dodge Durango had hit the family and killed them. And so this woman spent 13 days in jail because she was falsely arrested. And so, I mean, this is like an example of a freeform search gone wrong. They can do that for cars. And then as Joseph has been talking about, they can also put in people descriptors in there. And so we've seen both types of searches where they are searching like a vague term for a car, or they're searching for, as Joseph said, tool man, like protesters.
15:15Like I've seen searches for signs, like people holding white signs is like a search that we have seen. And so these are like the types of things that can go in there. I mean, just because you mentioned like political stuff as well. I contacted the Center for Democracy and Technology, you know, this good organization who have their finger on these issues. So they're very reliable when you're like trying to work on a story quickly. Please, I need an expert comment on this. And I pinged them about it. And they were already looking into something similar because they sent me a link on Have I Been Flocked to some of the results.
15:55And one was very explicit in Nature where it said, one police department searched 198 networks for, quote, white Jeep with Trump flag, end quote. Now, I don't know the context beyond that, but it shows that clearly they can look for a vehicle with a certain political symbol on it, a political flag on it, like no matter what it might be, right? So that was very, very interesting. Again, that was a vehicle search, like the one you're talking about, Jason. But then the people searches do show, you can look for somebody with a certain branded t-shirt, maybe a sports jersey, something like that. So I know these searches can get pretty narrow when you're not typing in like black SUV and arresting the wrong person.
16:42yeah and just on that like like i said um of course these cameras are networked together as we've reported many many times as people know now but sometimes like the search is both vague and they're searching a lot of different networks meaning a lot of different cities or like across an entire state things like this and so if you're doing a vague search and you're searching tens of thousands of cameras, it's going to pull up people who have nothing to do with the incident that's being investigated. Joseph, does this mean that every flock camera is also tracking people? Or what did you see in these freeform searches?
17:22Yeah, that's probably the one bit of nuance that people really should take away from it. Because yes, people should understand that flock cameras are also searching for people and cops are using that based on the searches we've seen but it's not every single flock camera right so ordinarily when you think of a flock camera and you see it on like a lamppost or whatever or the intersection or wherever you're seeing it that's probably a license plate reader just in that i think there are more of those cameras right these ones are well one type they can be are these condor cameras which they are explicitly for people tracking where somebody will walk past them and the camera will automatically pan and zoom on that person because that way that's what it's looking for these are not strictly the same as the license plate ones i think that you can also see this in some of the data where when you look up a search on have i been flocked or if you have the original spreadsheets yourself it will also say how many cameras were searched and how many networks were searched When we look at license plate data, when we get that, and I think we've had untold number of those results at this point, I can't keep track.
18:38It is often like 88 ,000 cameras or something like that, or thousands of networks. And when you see that, I feel like you and I, Jason, and you especially, Jason, have got a feel for just like, oh, that's a nationwide search. Because it's around 80K, 80 ,000, something like that. So that shows they searched basically every camera on the National Flock Network for a certain license plate. That doesn't seem to happen with these freeform searches. You'll look at them and like that white Jeep with a Trump flag one, that was 198 networks. Still a lot. That's probably not the entire country, right? or even some of them are just like 100 cameras, which are probably Condor or other people tracking cameras installed in that single town.
19:27Or as you say, Jason, maybe in that single state, something like that. So in the data, it doesn't say the type of camera. You kind of just have to extrapolate that from looking at the status so much over the past, like more than a year at this point. So I would just stress that, yes, Flock cameras are tracking people, as we show, but it's not necessarily the same one that's on your street corner. It's kind of hard to tell because they look a little bit different to the Condor ones. But we know they track people because throwing back to an earlier story, Flock left a bunch exposed, right, Jason?
20:02Yeah, they left a lot exposed. Basically, we were able to find the... I don't know. It was like a testing situation where a testing server that Flock was leaving these Condor cameras open on. And we did a story back in December on this that you should check out. We also did a video with Ben Jordan on this, who's a YouTuber who's done a lot of work on Flock. And basically, you could see how the cameras work, where the cameras would follow people as they were walking by. I drove up a few hours from where I live and in front of some of these exposed cameras and tracked myself. I was able to see myself as I was walking around, things like this.
20:45And so Flock has been really marketing the Condor cameras as extremely powerful, like very high resolution. They're called PTZ cameras, pan, tilt, zoom. So they can basically zoom in on a situation and on people in any given scene, which is quite concerning. I think the other thing, and I only learned this the other day, I just missed it when it happened. I don't know if you saw this or not, Joseph. But Condors are the main video cameras that Flock has been promoting. And for a while, they were saying that the license plate readers were just basically taking static images of cars that they pass by.
21:35but last year uh flock added video capabilities to all of its alpr cameras as well um and so these cameras are and can film video as well uh they're not as like high resolution as the condor cameras and they're not um they're basically like not as powerful as the condor cameras they're not really intended to look for humans in a scene, but they are filming video. And Flock went and told all of its customers that they're pushing this as a free upgrade to all of the license plate reader cameras out there last year. And so I would just check that out if that's something you didn't know. I'm not sure if they can search people on these based on the information that you found.
22:32It seems like the number of cameras that were involved in any given search suggested that they're probably Condor cameras because there's not as many Condor cameras out there. And a lot of these searches were not as wide as we've seen with the ALPR cameras, where there's sometimes like tens of thousands of cameras in any given search. But I think that's something that people should know that these can film video. And in the promo materials, they basically say, you get the license plate from our reader, but then you can go back and check the video to see which way a car turned at an intersection, for example.
23:13Yeah, I didn't know that. Yeah, I didn't know that. And yeah, it's just very funny. And this isn't even a flock specific thing, although it very much is here, but just like, oh yeah, we're not doing this thing. Surprise, we're doing the thing now, actually. And pushing it as a free update is very, very kind to its customers. But obviously that does set the groundwork potentially for making those into more people search as well, if they're high enough resolution, I guess. All right, we'll leave that there. When we come back after the break, we're going to talk about Emmanuel's new story about how AI companies are buying a ton of books.
23:51it looks like from a particular company. We'll be right back after this.
24:07There aren't so many things you use every single day. Maybe your phone, your wallet, your keys. And then if you wear glasses, well, you wear those every day. So I've always thought that it makes sense to actually like the pair you're wearing. That's one of the reasons I've been happy with Warby Parker. Warby Parker has made buying glasses feel a lot less intimidating. Their virtual try-on feature lets you use your phone to see what different frames actually look like on your face before you order, which is way better than trying to imagine it from a product photo. These are the ones that I ended up with.
24:40They are the Elio, I believe. Yes, they're the Elio in these olive green color. It's actually a really pretty color. I quite like them. They're a little translucent. And they've become my everyday pair. I've worn these pretty much every day out in the LA sun. They're lightweight, comfortable, and they look just as good at the end of the day as they did when I first put them on. Another thing I really like is that Warby Parker keeps everything really simple. Prescription glasses start at$95. And they also offer sunglasses, contacts, online eye exams, plus more than 300 retail stores if you'd rather shop in person.
25:16And if you have vision insurance, they'll even help verify your benefits and apply them automatically. I've been wearing these LEOs every day this summer. I don't even think about them anymore. They go with almost every outfit that I wear. They're great for the beach. They're great for walking my dog. So right now, buy one pair of glasses and get 20 % off any additional pairs at warbyparker.com slash 404. That's 20 % off any additional pairs when you purchase one pair at warbyparker.com slash 404. We have at this point written an embarrassing number of stories about data brokers, the companies that quietly compile your name, your home address, your phone number, your relatives, your daily habits, and then sell that file to basically anyone with a credit card.
26:00Advertisers for sure, but also spammers, scammers, and occasionally the person you'd really prefer didn't have your address. You never opted in. There's hundreds of these brokers and opting out of them one by one is effectively a part-time job. That's what Incogni does for you. It acts as your personal privacy advocate, identifying the brokers holding your information and handling the legal legwork of demanding that they delete it. Incogni manages the entire request and follow-up process on a recurring schedule because this data has a notorious way of reappearing. You set it up once and watch the verified removals stack up on the dashboard.
26:36The practical result is fewer spam calls, less junk mail, and a much smaller footprint for anyone trying to find or impersonate you. For the most comprehensive protection, we recommend their unlimited plan, which includes custom removals. As journalists, we know that sensitive data doesn't just sit on random broker databases. It winds up on public forums, directories, blogs, and news portals. If you find your personal details exposed on a specific site, you simply send Incogni the URL and their team of privacy experts will step in to manually handle the corporate takedown request for you. I've done these before and it's really a huge pain to do it manually.
27:15So the fact that Incogni does this is amazing. Take control of your data footprint risk-free with a 30-day money-back guarantee. Go to incogni.com slash 404media and use code 404media for 60 % off an annual plan. That's code 404media at incogni.com slash 404media. Here's a scenario that's not a hypothetical anymore Your mom gets a call, it sounds like you Says you're in trouble, need money, don't tell anyone That voice is a generative AI model Built from clips that were already out there Digital fraud is the fastest growing crime in the country You and I can probably spot most of it But even we're not untouchable Now imagine the people in your life who aren't steeped in AI and technology every day They're the target You may have heard us mention Savi last week.
28:03It's a new app that just launched. Savi protects your whole family from AI-powered scams across calls, texts, and voicemail, going beyond what's built into your phone. It filters scam texts before they land, screens unknown callers through voicemail, and can join any live call silently and flag it in real time if something feels off. 404 Media listeners can try Savi free for 14 days. Go to SaviSecurity.com slash 404Media. That's S-A-V-I security.com slash 404media Plans start at$5.25 a month for your whole family Available on iOS and Android
Read the full transcript
28:45All right, and we are back, Emmanuel I hope I included the correct headline If not, this is the one we're going with in the podcast and I'll just update in the show notes AI companies are buying tons of old books because they're free of AI slop. So a bookseller you're speaking to, Emmanuel, noticed something happening in April of this year. What did they see exactly? Yeah, I guess before I get into that, have you realized that this is a business that operates on this level? Like obviously, you buy books from Amazon, you buy books from bookstores, but I didn't realize that there are people who make a living trading books at scale.
29:31So they'll go to a library that is shutting down or a school that is shutting down, maybe a bookstore that's going out of business and they just buy up the entire stock, then put it up for sale on one of these marketplaces and sit on it for maybe years until somebody shows up and wants to buy it. But that is this guy's business and he's been doing it for a few decades. and it's not the worst business. It's not a high volume business either. He told me that on a good week, maybe he'll sell 20 books and that has been the case for years and years. And then suddenly starting in April, he started to get orders for hundreds of books a day.
30:18So he will check on his store on various marketplaces and see that he got an order for 300 books, 700 books, 200 books. And that is very unusual. It is unusual because that is a historic high. And then also the trend has been going in the other direction, he said, because libraries and schools have been getting less funding, not more funding. And when he went online to see if other booksellers were experiencing the same thing, They have these message boards where they talk about their business. And yeah, everybody has said the same thing. They've seen historic spikes in sales. Gotcha. So what does he suspect around these sales?
31:08Like, obviously, as the headline suggests, we're going to get to AI companies. But why does he suspect this is like an AI company, potentially, or maybe multiple AI companies behind this spike? What's the suspicion there? So first, it is a volume, right? As I said, nobody historically has bought this many books. Then also, in the past, when people buy a bunch of books at the same time, they usually follow a theme. So imagine you're a library and you're trying to build out a section on whatever, the Spanish Inquisition, right? Then you'll buy a bunch of books about that subject. And here, there's no rhyme or reason to the books that are being bought.
31:57The only thing they have in common is that they have ISBNs, which is the serial number and barcode on the back of probably every book that you've ever read. And those are the only books that are being bought in these huge batches. And this seller, as well as other sellers, he specializes in a certain foreign language and also particular subject, which includes a lot of rare books. And a lot of these don't have ISBNs. And none of those books are being bought. So imagine if you're an AI company and you're trying to methodically scan maybe every book in the world, then the easiest way to do that is to just go through a database of ISBNs and go through the list and scan every book.
32:53how does he feel about that how does he feel about the idea that he might be selling um a bunch of books not to a library that's going to serve you know maybe kids or adults who are interested in something or even just you know a school or whatever how does he feel about potentially selling books to an ai company it's complicated uh he it's obviously very good for his business. He says that usually the storage space where he keeps his inventory is overflowing and now there are empty shelves. So it's very good for business. He's making money. Other people online are talking about it and said that they're making money and not complaining.
33:36But as someone who's in this business because they love books, there is a likely possibility that the book that he is selling are getting destroyed because the cheapest, fastest way to scan books is not to take a picture of a page, turn the page, take another picture. It is to cut the spine of the book and then feed the pages to a machine that can scan them very quickly. So you're creating a digital copy of the book that is maybe being used for AI training data, but the physical book that is maybe rare is now more rare because the copy that he sold is no longer in circulation. It's cut and pulped and gone forever.
34:26Yeah, I guess this is probably the best place to mention what happened with Anthropic before and the lawsuit there and what came out then about them scanning books. What happened with Anthropic? So we know that AI companies are very hungry for books as AI training data. And we know this because there has been a few stories about them using essentially huge collections of pirated books. Facebook was caught doing this, I believe. And Anthropic was caught doing this. And the reason we know about the physical book operation is a bunch of authors sued Anthropic because they use pirated books in training data.
35:19And through that lawsuit and discovery, we found out that they had something called Project Panama, which was a mission to scan millions of books and to destroy them in the process. And this has been verified by Anthropic itself that they have been doing this. Yeah. So I mean, this is hinted at in the headline I read out. But why would AI companies want to scan a bunch of books on top of scraping basically the entire web as well? Why are they hunting out these books and scanning them in this bulk way? Why do that? So there are two reasons. One is it's just another source of data. Obviously, scraping the entire internet doesn't sound that easy, and I'm sure it's not, but it's basically been done.
36:23The AI companies have taken everything that's online and used it for training data. And now they're hungry for more training data because that can make the models better. And they're out of digital material, so you have to go where you haven't been, which is physical material. Textbooks, printed books, fiction books, anything that you can get your hands on. So that's the first reason. And then the second reason, which is made explicit by one of the companies that is now servicing this effort for AI companies to get printed books, is that we have talked before about this recursive problem with training AI models on AI-generated data, which is called model collapse.
37:10If you take AI output and use that to train another AI model and you keep doing that cycle after cycle, the AI model starts to get worse and more prone to errors and just generally not as good as if it was trained on human-created content. And if you're scanning books from 2022 or earlier, you're guaranteed to be training on human-created content because before 2022, the large language models weren't readily available. people weren't using that to flood Amazon with AI-generated books. And it's just sort of a guaranteed high quality and most importantly, a source that is free of AI-generated flop that these very AI companies are basically producing.
38:06Yeah, the key date being November 30th, 2022, the date that ChatGPT was released. So you're getting a book before that. It's probably not somebody trying to grift the Amazon marketplace by mass producing some AI slot book. Yeah, that totally makes sense. So this brings us, I think, to the most interesting part of the piece, which is that you found a company that is explicitly facilitating the mass sale of books to AI companies. And it's kind of crazy how they just say this all out loud. So what is ISBN DB? And what are they offering? What do they say on their website? ISBN DB has been around for many years.
38:54It is sort of like IMDB, which is something maybe more people are familiar with. It's just a database of all the books that have ISBNs. This has been previously very useful for libraries and schools and retailers who are looking to buy certain books or find out what's in their inventory and organize their inventory and things like this. But since the generative AI boom, they've discovered a new and deep-pocketed new client type, which is a company's and AI labs that are trying to get these books. So now they won't only provide you with this database, they will also go out and source these books for you.
39:44So they'll find them, buy them with the AI company's money, and collect them all in one spot and then deliver them directly to wherever the AI company does the scanning. There's a few companies that do this. ISV and DB is one of them. There are other companies that have done this previously for schools or libraries or retailers, but now they are directly offering their services to AI companies that are making these huge, huge purchases. And for them, the money is no object because as we know, they have billions and billions of dollars in investment. And probably most importantly for these AI companies, especially after the anthropic stuff, if ISBN DB says it can offer these companies secrecy.
40:40What does it say about the need to keep this on the down low? Yeah, so they talk quite a bit about the optics, the optics problem of doing this, which is nobody wants a headline about their company that says OpenAI or whatever, has bought a million books, used them for training data, and then destroyed them. That just doesn't look good. I don't know what image comes to mind for you, but it's a subject of science fiction and Fahrenheit 451 or book burning and stuff like that. Just destroying printed books is not a good pretty thing to see. Yeah, not a good vibe. So part of their pitch is, we'll keep you completely anonymous.
41:37This is kind of standard I've discovered for the industry. So it's like if you're on one of these marketplaces where you're selling books, if somebody makes a purchase, you don't know who it is. You're selling it via the marketplace. It goes to them as a middleman. And then they ship it to the client and the client's identity stays hidden. So they make clear that that is there to protect them. Then they also say that they make people sign NDAs. I assume that this is normal as well. But basically, it's like, don't worry. Nobody's going to find out that you're doing this with us. That is odd though, because on eBay, for example, as a seller, you know who you're selling to.
42:20You get a shipping label. There's a username associated with who buys your product. And maybe that username isn't identifiable. It can just be a random username. But you get a shipping label and you know exactly where you're sending it. And there's not a middleman. So it is interesting that just... I wouldn't consider buying and selling books to be very sensitive under normal times. Yeah, yeah. I believe... This is me speculating. But I believe that the reason that this became standard is not originally for privacy's sake. I think it was because purchases are made in the dozens, hundreds, now probably for the AI companies in the thousands of books.
43:08And part of the service that these platforms offer is you don't send it directly to the client, you send it to them. they go through the books, make sure that they meet whatever standard you have, then they repackage them and send them to you, right? So there's like a quality assurance aspect to this because you're buying such large numbers of books. But now it has... And then therefore you send it to an address that's not the final address. But now it has the added benefit of keeping clients anonymous. Yeah. Yeah. And I think just lastly, this is some of the first English language reporting on this, right?
43:50But there's rumblings of other stuff. I think I saw some Spanish press and then I think you throw to a piece out of the Netherlands. Just what are other countries seeing? Is it much of the same thing or they suspect the same thing or what's going on? it's the same thing and i can't prove this but i have a hunch that um the reason that we've seen rumblings about this in uh spanish language media and now uh this story's from the netherlands and uh that story says that they talked to a few rare book traders in europe and i think that's because the ai companies are going for the rare books first right like imagine if there is a race to scan all the books, all the printed books in the world, it would be easier to get a printed Harry Potter.
44:42Obviously, there's a digital copy of that as well. It's already in the training data. But a popular book would be easier to get than a rare book. So you'll buy the rare foreign language books first, put those into the database, destroy them, and then you might have a leg up on the competition. Yeah. if you are the one scanning and destroying it then the other company can't scan it because you've fucking burned that book obviously yeah alright we will leave that there if you're listening to the free version of the podcast I'll now play us out but if you are paying for a full media subscriber we're going to talk about the big Suno hack and everything we learned about that we were the first to reveal that the hacker contacted us and then we published all of these details about Suno you can subscribe and gain access to that content at 404media.co.
45:38As a reminder, 404 Media is journalist founded and supported by subscribers. If you do wish to subscribe to 404 Media and directly support our work, please go to 404media.co. You'll get unlimited access to our articles and an ad-free version of this podcast. You'll also get to listen to the subscribers only section, where we talk about a bonus story each week. this podcast is produced by Alyssa Midcalf another way to support us is by leaving a 5 star rating and review for the podcast that stuff really does help us out I have a few more of those to read out which I'll do soon this has been 404 Media we'll see you again next week
From the publisher
Take control of your data footprint risk-free with a 30-day money-back guarantee. Go to https://incogni.com/404Mediaand use code 404MEDIA for 60% off an annual plan. That's code 404MEDIA at https://incogni.com/404Media
Our listeners can buy one pair of glasses and get 20% off any additional pairs at https://WarbyParker.com/404 — and using our link helps support the show. #WarbyParker #ad
We start this week with Joseph’s story on how cops are using Flock to track actual people, not just cars, with searches like “male with tattoos.” After the break, Emanuel tells us all about the company that is explicitly selling mountains of books to AI companies and promising to keep the sales a secret. In the subscribers-only section, Jason tells us how he learned about the Suno hack and what it showed us.
You're Invited: 404 Media's Third Anniversary Live Podcast and Party!
How Cops Use Flock to Track People, Not Cars
AI Companies Are Buying Tons of Old Books Because They're Free of AI Slop
Hack Reveals Suno AI Music Generator Scraped YouTube, Deezer, and Genius
Youtube Version: https://youtu.be/6xSes4VMVyo
Subscribe at 404media.co
Learn more about your ad choices. Visit megaphone.fm/adchoices
