AI Slop Is Drowning Out Human YouTubers

10 Sep 2025 · 59 min

Ask about this episode

Ask anything about it. ChatGPT or Claude reads this page and answers with the times it was said.

Connect VO and ask about every podcast you hear, including the moments you saved. Add to ChatGPT · Add to Claude

In short

The 404 Media Podcast - Episode Summary

Podcast Title: The 404 Media Podcast Episode Title: AI Slop Is Drowning Out Human YouTubers Hosts: Jason Kebler, Emanuel Date: Not specified in the transcript

Overview In this episode, the hosts discuss the overwhelming presence of AI-generated content on platforms like YouTube, particularly focusing on "Boring History" videos that are increasingly overshadowing the work of dedicated human creators. The discussion also touches on Meta's declining content moderation efforts and a troubling Instagram account promoting Holocaust denial merchandise.

Key Discussions

Segment 1

AI-Generated History Videos

  • Introduction: Jason shares his experience with AI-generated history videos, discovered late at night while trying to fall asleep.
  • Content Quality:
  • Human-created Videos: Creators invest considerable time into research, scriptwriting, and production, often consulting multiple sources and ensuring high-quality content.
  • AI-generated Videos: In contrast, these videos are described as "slop," characterized by surface-level information and lack of depth. They often utilize AI tools for script generation and voiceovers, resulting in a generic and uninspired output.

Example Channels

  • Positive Examples: Channels like "History Time" and "Ancient Americas" produce well-researched content that engages with academic perspectives.
  • Negative Examples: AI-driven channels typically have clickbait titles, use basic facts, and lack diverse viewpoints or citations.

Segment 2

Impacts on Content Discoverability

  • Visibility of Quality Content: The rise of AI content hampers the discoverability of human-created videos, pushing them down in search results and view counts, threatening the sustainability of genuine creators.
  • Creator Concerns: Many creators report seeing decreased views as they struggle to compete with the flood of AI-generated content, making it difficult for new voices to gain traction.

Segment 3

Meta's Content Moderation Failure

  • Lack of Effective Moderation: The hosts criticize Meta for its failure to enforce content moderation policies regarding hate speech and misinformation.
  • Case Study: An Instagram account selling Holocaust denial merchandise with a significant following is mentioned. Despite reporting the account to Meta, minimal action was taken.
  • Oversight Board: The discussion touches on the Facebook Oversight Board, intended to review contentious moderation decisions, highlighting its inefficiency and the prolonged processes involved.

Segment 4

Cultural Implications

  • Normalization of Hate Speech: The ease with which users can access and share hate speech online is addressed, indicating a troubling normalization of such content on mainstream platforms.
  • Public Sentiment: The hosts express concern for societal implications as these narratives become prevalent, noting a growing desensitization towards horrifying content.

Conclusion The episode concludes with the hosts reflecting on the challenges of navigating an increasingly AI-dominated content landscape, particularly on YouTube and Instagram. They emphasize the importance of supporting genuine human creators while criticizing the failures of major platforms to uphold their content moderation responsibilities.

Key Takeaways

  • AI vs. Human Content: The growing presence of AI-generated content complicates the landscape for human creators, leading to reduced visibility for quality work.
  • Content Moderation Issues: Meta's lax moderation policies allow harmful content to proliferate, showcasing a failure to protect users and uphold community standards.
  • Cultural Impacts: The normalization of hate speech on social media poses significant risks to societal values and discourse.

Bonus Segment

  • AI Darwin Awards: The episode offers an additional discussion on the ‘AI Darwin Awards,’ showcasing the most absurd or misguided uses of AI technology.

---

For further details and to support the ongoing journalism at 404 Media, listeners are encouraged to subscribe for ad-free content and additional episodes at [404media.co](https://404media.co).

Written by AI. May contain mistakes. Listen to the episode to check what was said.

Hear the part that matters, and keep it.Open this episode in VO. Double tap your headphones to save a moment as you listen.
Get VO free

Transcript

Automatic transcript. May contain errors.

0:03Hello and welcome to the 404 Media Podcast. Joseph and Sam are out this week. So you get me Jason Kebler and I'm here with Emmanuel. What's up Emmanuel? Hey. How are we feeling about a full on takeover? of this here show. Finally, the time has arrived for us to do a four-hour podcast of us just rambling about whatever, not related to technology or our reporting at all. That's what I wanted to do, but you seemed scared. You seemed scared to do it. You didn't want to upset the listeners. So we're going to talk about our stories. Speaking of, Joseph and Sam are both out reporting. so they're not gallivanting they're doing stuff that you'll hear about quite soon I'm sure people might have seen Sam was in the courtroom for the sentencing of Michael Pratt who was the ringleader behind the Girls Do Porn case which he has covered for years and I think she was the first to post about the sentencing and some shocking statements from the Jane Doe involved in the case so people could check that out But yeah, that's why Sam is not here.

1:18And Joe is on a secret mission in unnamed parts of the world. Unnamed parts of the world. We can't even contact him. So hopefully he's okay. But he'll be back, I think, next week. In any case, yeah, check out Sam's Girl Soup Porn reporting. We are not going to talk about it on the podcast because we think it will be still relevant when Sam is back. So more to come there. In cybersecurity, speed is everything. Breaches often begin with a single exposure, an open cloud bucket, a forgotten subdomain, or an API spun up without your knowledge. The question is, who finds it first, you or an attacker?

1:59Enter Intruder, the exposure management platform that helps lean engineering and security teams stay ahead of threats by unifying vulnerability management, attack surface discovery, and cloud security. Intruder continuously detects vulnerabilities across your entire infrastructure, including over a thousand attack surface issues other platforms miss. And it's always on, giving you peace of mind by catching cloud misconfigurations early and checking your systems within hours when new vulnerabilities emerge. Using real-world threat intelligence, Intruder highlights the issues most likely to be exploited, so you can fix your real risks before attackers take advantage.

2:38The platform helps you save time and speed up fixes with integration with Jira, Slack, Microsoft Sentinel, and more. Plus support from Greg, your embedded AI security analyst. Stop breaches before they start with Intruder. Plans start at just$99 a month. Start your free trial today at intruder.io slash 404media. So for the first story, we're going to talk about one that I wrote, which is called AI-generated boring history videos are flooding YouTube and drowning out real history. Okay. Should we do a confession? yeah i mean there's a lot to get into here but i wouldn't mind if we spent most of this podcast talking about how you stumble upon these videos because they we can't go into this without going into like your youtube consumption habits can you please explain to our audience when you watched slash listened to the videos we talk about in the story?

3:46Yeah. So all of the videos that we're about to talk about, I discovered at 3am or later. Because most nights, not all nights, but most nights, I will put my AirPods in and I will turn on a YouTube video. Well, I go through phases of what listen to. And my most recent phase is listening to history videos. So for a while, I was listening to history videos about indigenous cultures in the Western Hemisphere run by a guy called Ancient Americas, who I actually talked to for this story. He talks about the Mayans, the Aztecs, but then also like the Toltecs and other indigenous societies that we don't hear about very much.

4:40Incredibly interesting. But also he speaks at a cadence that puts me to sleep very quickly. And so for a few months, I would be listening to his hour long videos and I would make it like five minutes and fall asleep. And then I would just leave it on. And eventually, you know the video would end and youtube would auto play something else and like one night i guess a couple of weeks ago i uh like woke up like i jolted awake listening to this and maybe we'll play the clip here in the end anne boleyn won a kind of immortality not through her survival but through her indelible impact on history. Fee...

5:28By the early 1770s. Before we move on, let's just dwell on the fact that, I mean, this is probably a night where you're having trouble falling asleep. So you put in your AirPods, put on one of these videos, and try to lull yourself to sleep. And I have done that before, but I feel like it's probably one of the least healthy things that I do to myself. That can't feel good to fall asleep that way. That can't be a restful good night's sleep. I really don't know. I really don't know. I tried to do research on this topic once. So back at Vice, we had theme weeks occasionally. And I think it was 2017, we did something called Sleep Week.

6:20And so everyone on staff would write an article about some aspect of sleep, the techification of sleep, the science of sleep, whatever. And mine was, I was trying to figure out if my falling asleep with a TV show on habit was bad for me. because we hear quite a lot about blue light, which is emitted from your cell phone, is emitted from a laptop, a game console, whatever. It's not good. It disrupts your sleep. It messes with your melatonin and circadian rhythm, etc. But what was unclear to me was that I was watching these TV shows with my laptop facing away from me. At first, because I was doing it on a laptop for a while.

7:11And then that eventually morphed into listening to YouTube videos. So I would start the video on YouTube and then put my phone face down because I didn't pay for YouTube premium. It's so funny that it's a premium feature. But yeah, go ahead. Yeah. I mean, I've now started paying for YouTube premium because of this. I've been listening to these videos now for years. and literally within the last month, I want to say, you pretty much can't listen to... And I always say listen to things on YouTube because I so rarely actually watch it. I just am listening to it. But every five minutes, you're getting an ad.

7:53And the ad is really loud. And that would be really jarring. So I would be falling asleep listening to this stuff and then an ad would come on and I'd be like, Oh, that's probably not healthy. And then sometimes you get a YouTube ad that was like 35 minutes long. So I would like wake up and I would be in like minute 20 of some ad. Anyways, I talked to sleep scientists and it's like, it's not studied that well. It's not really studied that well what like audio does to your brain because your brain is nominally consuming these voices. But I feel like I'm not processing really any of it once I actually fall asleep and I find it to be like quite calming and soothing.

8:34And I think a lot of people like fall asleep to a podcast. There's various boring history podcasts. There's soothing sleepy time stories podcasts. Trust me, I tried them all. ASMR stuff. There's a thing that's happening on YouTube now also where it's like whatever YouTube algorithm you're in, it will suggest that. But you can sleep to this format. So I listen to comedy podcasts and I get offered via the a recommendation algorithm, like four-hour compilation videos of this comedy podcast to fall asleep to. So it's doing that for everything. Sorry, two more things quickly because Joe is not here to stop us.

9:21And then we can go back into the journalism. One, I do this sometimes, but when I do it, I definitely feel like shit. When I wake up in the morning, I'm like, that was bad. That was a bad choice. And the healthy thing to do is not watch anything and read a book. And whenever I do that, I'll read half a page and fall asleep like a baby and have a really good night's sleep. But I don't know, for whatever reason that you understand, I'm sure it's hard to do that. And then the second thing, there's a really good episode of Dexter's Laboratory, the cartoon. Yeah, yeah. Where he falls asleep, he's trying to learn French in his sleep.

9:55So he puts on a learn French record when he goes to sleep, but the record skips. And the only phrase he hears is omelette du fromage. And then the next day... I remember that one. Yeah, yeah, yeah. It's the only thing he can say, but somehow it's the best day of his life because it's always appropriate for the situation. Great episode. Okay. Wait, wait, but so not to the journalism yet though, because it's interesting though, because I agree with you entirely. And I actually rarely use YouTube to fall asleep initially. Like I will often fall asleep, but then like one hour later, I will wake up and it will be the middle of the night.

10:36And I don't want to turn off. Maybe I could get a Kindle or something, but I don't want to turn something on to read from. And I also don't want to have my eyes open staring at my phone. And so this is why I do it. I'm like, I'll look at my phone for 30 seconds to put on one of these videos and then try to fall back asleep. And it usually works. And at some point in the night, I usually toss my AirPods away unconsciously. And so, I mean, I agree it's probably not the best, but there's a huge market for this. There's a huge market for this because of what we're about to talk about. It's like...

11:17Yeah, so anyways, I was listening to these human creators who spend a lot of time... You're watching these history videos. Yeah. Let's talk about... because it sounds like in the story, you in the morning realized that you were listening to something that was AI generated. But in order to illustrate that, can you describe what a good one of these videos is like and then what this AI generated video sounded like? Yeah. So, I mean, interestingly, a lot of the ones that I listen to are not designed to make people fall asleep. They're just like history podcasts, for lack of a better term. usually with visuals.

12:01And sometimes they're more than that. Like this one guy we're going to talk about, History Time, this man named Peter runs it. A lot of Peters in this story, actually. He will read four or five books on a topic. And then he will consult academic journals. And then he often does site visits. And so if he's talking about an ancient war or something like that, he will go to the battlefield and will film there. And so he's making documentaries that are often two, three hours long. And any given one of these documentaries can take months, they can take years. He told me some of them he worked on for over five years.

12:47Just in terms of like, he was doing other things also, like other videos came out, but like, he will be working on multiple of these at a time and they're really popular like he became quite a big youtuber he has i think like 1.2 million followers and um you know he puts out like a video every month or two and that is probably like the upper limit of what a human being who's trying to make really high quality, really well-researched videos can do. If you're reading multiple books for each one, if you're reading multiple academic papers about different perspectives on some ancient war, some ancient civilization, or the types of food that they ate in medieval times, there's all sorts of different videos that I've become interested in.

13:41I've become interested in this channel called Let's Talk Religion, and they will talk about the different perspectives on drinking alcohol in Islam, for example. And where did the idea that Muslims shouldn't drink alcohol come from? Through a historical perspective. That's an example of one of the videos that I've watched. There's another one that's an entire history of Zoroastrianism, which is a religion. I did a project on in eighth grade. and I'm like, oh, now I've like, it's a predecessor to Christianity and Islam and Judaism and it's still practiced by some people. But I was like, oh, what's the deal with this?

14:26And it's like a very academic look at these sorts of things. It's a human being who's doing like a ton of research and then like, not only are they doing a ton of research, they're then also finding imagery to go with it, which I don't watch, but like a lot of people do. And this imagery is often like, Creative Commons licensed stuff. It's stuff where they're getting permission from universities to use it. Like a lot of the people I spoke to for this article said that they are doing a ton of legwork just to script the video. And then of course, like edit the video, you know, add music to the video, record it with their own voices, like all of this stuff.

15:06And they've made careers out of it. Like a lot of them made careers out of it because history stuff does really well on YouTube. Um, you know, a lot of the videos, like the most popular, um, videos have millions of views. And so they're collecting money. A lot of them have Patreon and stuff like that. But anyways, like along comes these new AI slop channels that I started getting auto fed. And, you know, as like a journalist and someone who writes about AI slop, I, I did recognize them as slop pretty much immediately when I was coherent. in the morning and was scrolling through my YouTube watch history.

15:47And it's funny because I had, quote unquote, watched dozens of them according to my watch history, but I didn't even realize it. I was consuming them in my sleep. Yeah, the good videos remind me of a very popular early history podcast, this hardcore history that maybe people have heard of. And I would describe them as meticulous. And then also something that I think it's Dan Carlin, the guy who makes it often jokes about, is that I think he'll go like two years without putting out a podcast because of all the research. And then like you said, the editing, right? It's very carefully put together.

16:27So that's a good version. Describe one of these AI-generated videos. Because in theory, I don't know, you could go to ChatGPT, generate some text about some period in history, feed that to an AI tool that has AI voice generation, and you basically have a video. What does that look like in practice? Yeah, so I would say that the accounts are called Boring History for Sleep, and then there's a bunch of different variations of it. They have clearly AI slop thumbnails, first of all. And all of the visuals are pretty clearly AI slop, although it's pretty hard to tell in some of them because a lot of the visuals are medieval paintings, and AI is pretty good at doing that.

17:14And so if you're not up to date on historic oil paintings, you might not notice them as slop. But here's some of the video titles. Why It Sucked to Be an Aztec Sacrifice Victim and More, totally wrong medieval facts everyone still believes medieval irish food peasant to king the queen who slept with her step sons your life as a eunuch uh crazy facts about queen cleopatra etc um so it's a lot of stuff like that and then you know i watched some of these and there are facts in here um you know i think whoever is making them i'm not exactly sure what tools they're using, I was trying to reach out to them.

18:01I would imagine they're probably using some combination of like chat GPT for scripting, maybe like 11 labs to record the video. It's always the same narrator. The narrator has a British accent. It's not really like whispered. It's like very soft spoken. And one thing I noticed is that it uses a ton of adjectives. Like it just is like, imagine you are, you know, a peasant in 1400s England. It was a cold and dreary night. The willowy wisps, like, it's like really a lot of filler stuff. And then it's like kind of a list of very basic facts. and the, so I basically like, I spoke to the guy who runs Ancient Americas, which is a channel I really like.

18:54I talked to History Time, which channel I really like. And then another one called The French Whisperer, which is an ASM artist from France who does a lot of research as well for his videos. He does like science and history videos. And pretty much all of them were like, yes, we are aware of these things. The guy who does History Time told me I think they may be modeled on my videos, which could be possible because a lot of the topics are the exact same. And then the voice sounds really similar to his, which is concerning. And then the videos are usually like two to three hours long, which is how long he's doing them.

19:32But he's basically like, it's really, really, really, really surface level. It's like glossing over. like a lot of them are maybe not totally wrong, but it's like reading a Wikipedia article. It's like reading a Wikipedia article, but not clicking like any of the citations or anything like that. I've read a lot of AI-generated books for some of our reporting. And I would say two things that the AI-generated content has in common almost always is, A, yes, it reads a Wikipedia article, it's very surface level. And then I wonder if you agree, if you've listened to enough of these to say, but something that is good about what I liked history as a subject in school and what I liked about history podcasts and stuff is usually the person who is making it is not just listing facts about the time or the figure.

20:35It's like there's some sort of point or narrative that they're trying to get. There's some sort of thing that they're trying to say about this period of time. And I imagine that these videos lack perspective, basically. They definitely lack that. And then, you know, I'm not a historian. I've watched a lot of these. But something I really appreciate is that history feels like it's a conversation with different perspectives. And so a lot of these, the best human made channels will be like, well, this, this like academic study or this historian says this, but like this other person who is also a well renowned expert in the field says that, and it's not quite exactly the same.

21:21So you need to like consider it from these different perspectives and then sort of decide, you know, what you believe to be the truth. and I think that there's absolutely none of that in here and it definitely doesn't cite any of its sources. It's so funny, I'll be listening to one of these ancient Americas videos and it will be like, oh, these Harvard anthropologists wrote a study dating these ruins to a specific time but these other historians say that's impossible because the migration patterns that were known during this time period don't line up or whatever. And that's obviously very vague, but it's a lot of that.

22:07And I find that to be extremely interesting, despite... Well, these AI ones market themselves as boring history. None of the other ones say boring. I don't think they're boring, but they put me to sleep nonetheless because I'm tired, not because I think it's boring. so you talked to this guy p kelly who runs history time one of these more popular human uh youtube history channels you talked a little bit about how everyone thinks these videos are very surface level but what did i thought he had some very interesting things to say about how like what does this mean for the audience and what does this mean for how we are recording history or explaining history now on the internet?

23:02Yeah, so I think that this one was a really tough one for me, because obviously I've been writing tons and tons about AI slop. And I think that this is some of the most insidious stuff that I've seen. And that is because these real historians, again, spend months making a single video. And these AI slop factories make videos that look and feel the same in form, if not the actual information. Like every day they're publishing one. And there's dozens and dozens and dozens of these channels. And so there's tons of them out there. And there's no way that even all of the world's historians, if they were making videos, they're going to be drowned out by this very quickly.

23:51And so I think the discoverability aspect is a massive problem. Because if you search for, I don't know, what was life like in medieval times, you're going to get a bunch of these. maybe you'll get a really high quality human made video still like at the top right now but like that's that's been changing really rapidly and so i think it's going to be like really really hard to find these things um every creator that i talk to every human creator so that they've seen their youtube views go down this year um and they think it's because they're now competing with this slop so it makes it like less tenable for them it makes it a lot harder for new people to break into the space because um you know if you have no following whatsoever like how are you going to build one if you're competing with with this stuff and then also it just it like again glazes over the intricacies of uh of history and what is like really complicated often really complicated often very contested things.

25:02So you're getting like a really surface level sort of thing. And then, you know, that's to say nothing of the fact that a lot of the companies that make large language models are trying to make them like more centrist and like less woke and whatever. And so you can like see Grok like changing its answers about historical events in real time according to what Elon Musk wants. and things like that. And so I think it is really, really insidious. And I think it's something very difficult for humans to fight back against because there's just not enough time in the day to be competing with the AI on this, I think.

25:47I'll do a slight tangent again because no one is here to stop us. But it's like, I agree that across the board, I think sometimes people wonder if we're like over focused on what we call AI slop. And this is why I don't think we are because this is the most insidious and like terrifying outcome, in my opinion, where AI companies hoover up all the human made research content, art, whatever it is. and then we reach some sort of tipping point where we can't even find that stuff because we're flooded with all this fake bullshit and we're already seeing it. It's like, what you just said is true for news websites, for books, for academic research, for YouTube, for adult entertainment content creators.

26:50It's like everything is being drowned out by AI-generated slop. And it's easy to imagine a situation where we're not even able to find the human stuff. And that's terrifying. And I just had one of those weird weeks where it's like, I was looking at Blue Sky and Facebook and I feel like every other post with someone complaining about some AI-generated slop, they sign a completely different category of life. It's like, oh, I'm watching TV and clearly this art in this ad is AI-generated and it looks like shit. I'm scrolling Instagram and this influencer is AI generated. I'm buying a book from Amazon and all these books are AI generated.

27:28And people are like very fed up. And like, that is why we focused on it and why we continue to focus on it. And it's not clear how it's going to shake out. And it's a very big problem. Yeah. I mean, I think like as we've said, it's also there's very, very little incentive for anyone enabling this to fix it. it's like Google is pushing the tools to make this stuff. And so YouTube has said that it's going to like demonetize low effort content. But it's not, it's not demonetizing this. It's like the, you know, Google has a lot riding on Gemini and VO and like all these other tools that they make that are AI tools.

28:16And so I don't think that it's going away. And I think it's like, it still feels really early days, even though things have changed so much since we started reporting on this. It's like, this is still, there's still probably only a handful of people actually making these videos right now. and they're so easy to make. It's like there's going to be more and more people doing the same thing very soon and I don't know what the internet looks like after that happens. I think it's like a very bleak situation. And then the last thing I'll just mention is that a lot of these accounts are using like spam and like they're basically like all commenting on each other's YouTube videos in a concerted way.

29:11So they're manipulating the algorithm in addition to flooding the platform. It's like I found dozens and dozens of these accounts. I think they're probably all run by the same person because they all link to each other and they all comment on each other. And you can tell that they're doing bot type activity. And so add that on top of all of the other problems we just said and it's like it just gets really difficult and then the other the only other thing i'll mention is that um uh history time told me like he is making a lot of his videos by going to like special academic libraries where you like check out like the old english book like the the old manuscript and stuff and is like going through that sort of thing and you know these ai companies have tried to train their LLMs on as much stuff as they can get a hold of, but they're still largely just scraping the internet and sometimes scraping commercially available books.

30:16Whereas a lot of these history YouTubers and historians are like, I don't know, they're going into the archives in a basement somewhere and reading the old scrolls. So he's like, I'm giving you a real, really diverse, interesting perspective, whereas these AI is just taking what's on Wikipedia and regurgitating it somehow.

30:42Should we leave that there? That was a real indulgent segment. That's good. Only two and a half more hours to go. Alright, we'll leave that there and when we come back, we are going to talk about Instagram and a story that Emanuel did.

31:12Hiring is hard, like really hard. You want to give everyone a chance, but you're likely to get flooded with candidates who might not have the right experience and a bunch of bulk generated resumes and cover letters. Then you need to organize the interviews, make sure you're asking the right questions. And turns out, some of the candidates weren't actually interested in the first place. Well, the future of hiring looks much brighter because ZipRecruiter's latest tools and features help speed up finding the right people for your roles. So you save valuable time. And now you can try ZipRecruiter for free at ziprecruiter.com slash 404media.

Read the full transcript

31:48With ZipRecruiter's new tools, you'll be able to find and connect with qualified candidates in minutes. More than 320 ,000 new resumes are added to ZipRecruiter monthly, which means you'll constantly have a new talent pool to hire from. ZipRecruiter can match you with potential employees quickly, saving yourself and your company time, money, and headaches. No wonder ZipRecruiter is the number one rated hiring site based on G2. Go to ZipRecruiter.com slash 404media. Use ZipRecruiter and save time hiring. Four out of five employers who post on ZipRecruiter get a quality candidate within the first day.

32:25And if you go to ZipRecruiter.com slash 404media right now, you can try it for free. Again, that's ZipRecruiter.com slash 404media. ZipRecruiter, the smartest way to hire. Fall is planting season. Did you know that many plants and trees actually do better when planted this time of year? But you have to know where to start. That's why I love FastGrowingTrees.com. Doesn't matter if you live in the sunny South or if the air is getting chilly where you are. Their plant experts can help you find the perfect fit for your space. Fast growing trees makes it easy to get your dream yard. Order online and get your plants delivered directly to your door in just a few days without ever leaving home.

33:06All plants and trees are locally grown in the US, ensuring they'll thrive in your yard. I live in a sunny part of the country where lots of my neighbors have citrus trees. I've been jealous of them for years because an expensive landscaper is out of reach for me. And whenever I go to the nursery, I feel overwhelmed about what to get, how I'm going to get a home, and if I do manage to shove it into my car, the big mess it's going to make. With fast-growing trees, I don't have to worry about any of that. This fall, they have the best deals for your yard, up to half off on select plants and other deals.

33:38And listeners to our show get 15 % off their first purchase when using the code 404media at checkout. That's 15 % off at fastgrowingtrees.com using the code 404media at checkout. Now's the perfect time to plant. Use 404media to save today. Offer is valid for a limited time. Terms and conditions may apply. Check out the link below or in the show notes and support the show. Listeners to the 404media podcast know that we like to go a layer deeper on the stories we cover. It's not just about how technology is impacting people, but it's also about what's behind the tech. That's why you should go check out the new podcast, Interconnected, a new video and podcast series from Equinix that offers a rare look at the underlying infrastructure and tech advances driving the innovations of tomorrow.

34:30Through candid conversations with industry experts and visionary thinkers, Interconnected's hosts guide you through emerging technology trends, the infrastructure making them possible, and the connected future they're shaping. The first episode of Interconnected covers AI and medicine, taking a look at the data centers and systems that power the technology, leading to totally new methods of doing diagnostics, personalized medicine, drug discovery, and underlying clinical research. We hear a lot about how AI is changing the world. But what I like best about the show is that it explains the actual physical infrastructure and basic science that's powering it, which is critical to know no matter how you feel about AI.

35:12Discover the digital infrastructure powering today's biggest tech trends with Interconnected. Follow Interconnected on YouTube, Apple, Spotify, or wherever you get your podcasts.

35:34Okay, we are back. And the story is Instagram account promotes Holocaust denial t-shirts to 400 ,000 followers. I feel like this is something where you woke up one day and were like, I'm going to write about this account that I've known about for a long time, even though I have become so like inert to this type of content on Instagram and the internet. I guess, what is the account and like how did you first find out about it? So I don't know what is the first time I pulled on this thread, but I got fed into an algorithm on Instagram that I think you're familiar with as well, where I don't even know how I would define it other than racist.

36:34It's not even MAGA. It's not even right-wing or Republican or conservative on issues that are in the mainstream, even if you strongly disagree with them or think that they are racist, like ICE raids or whatever it is. It's not even that. It's just like straight up, this race is bad. Jews control the world. Black people are a burden on our society. just like a lot of mocking of Anne Frank and George Floyd and just like very, very inflammatory images and language and stereotypes of the most vile kind you can imagine. And Jason, you're familiar. Jason is nodding. Like, it's just like, it's this algorithm that you get into that is awful.

37:30And I've been looking at that stuff for, I don't know, about a year now. And I didn't really feel like it was worth covering because people know that that stuff exists on Instagram because other people get fed into this algorithm as well.

37:50And there's no effective way for us to encourage Instagram to ban thousands of accounts that are doing this or hundreds of accounts that are doing this. But as I'm watching all these racist memes as I'm scrolling through reels, I saw one that is the exact same aesthetic, saying the exact same type of stuff. But it was then also showing off t-shirts and hats and hoodies that had some of that same imagery on them and selling them. And it looked like not high-end, but not like not drop shipping not drop shipping I would say now that I've clicked around Shein for an article that Sam was writing last week it's like above Shein level of quality and I was like okay what's going on here and I'm not going to name the channel because unfortunately Meta decided that this channel didn't violate their terms to the point where it would ban it but it's a huge channel with a huge following 400 ,000 and followers, real people interacting with it.

39:04And it's selling merch with all this vile stuff on it. And then other people are sharing selfies of themselves wearing the merch. So it is a very real account that is just promoting and monetizing hate speech on Instagram. And we can talk about how we got there. But despite sending Instagram clear evidence of all this happening, they removed a couple of videos that have flagged. They've kept other videos that have flagged. And generally, they just let it slide. yeah i i think i mean you sort of touched on it but i guess um a big thing for me is like i could log on to instagram right now and scroll like through reels maybe like one one thumb swipe and be like that violates instagram's rules like that is horrendous like i i see such horrendous stuff on Instagram.

40:10And we have reported extensively about the fact that Meta has rolled back a lot of its restrictions on hate speech, a lot of its restrictions on racism and misogyny and anti-Semitism and all sorts of awful things, transphobia. But even given that it has rolled back a lot of these things. Like if, even if you sort of agree with the idea, which I don't really, that social media should be more like anything goes spaces, a lot of the accounts that I see are in blatant violation of the stated rules of meta. And so I guess like the, I don't really know what to take from that other than like they aren't doing content moderation like they used to.

41:06They have really gutted those teams and they just simply don't care. And I'm curious what you think because I know you can log on. I know if I said like, hey, right now, go find the worst Instagram account and you probably will find something really, really bad in like two seconds. Without even looking, it will be fed to you. Yeah, I mean, I think that's exactly the thing and why you have to write an article like this once in a while.

41:43We all see this stuff. We're desensitized to it. And then I saw this channel and then it's also I saw, honestly, another reason I wanted to write it is The Verge wrote an article about this anti-Semitic shirt that was advertised on a a TikTok shop where it's like you can buy stuff directly from a TikTok account. And I was like, that's totally fair. And it's like good to call TikTok out on this shirt and they reported it and TikTok took it down. But that sort of snapped me out of it where I'm like, if this is a story, I'm swimming in like a totally much more terrible level of garbage every day and there's more of it.

42:27And they're also selling shirts, you know what I mean? so I was like okay let me look into like let me look at the facts of the story and see if it's worth covering and it's like as I'm like you know writing notes about what this story would be I'm like this is this is crazy we're in such a crazy place with Instagram that it's like you just like you have to wonder what's going on there um you know I I'm not even gonna like I don't even know how I feel about what is the correct way to do this. I'm not sure. You know what I mean? But the fact is that Instagram has decided that it's not an everything goes space.

43:08It doesn't allow pornography. It doesn't allow various forms of hate speech. And that is how it decided that it manages this huge influential platform. And I go into this example in the story where A few years ago, in response to Trump's election and people being very, very upset about what was going on on Facebook and how extreme it was, and how, as you and Joe exposed at a piece you wrote from Motherboard, how ridiculous their moderation efforts were, they formed this thing called the Facebook Oversight Board, which they frame as like the Supreme Court of Facebook moderation. and essentially the way that it's supposed to work is that it's like an independently run body with independent members who are like judges and when there's like a moderation dispute on facebook it gets elevated to the supreme court the facebook oversight board and they then like you know very carefully look at the facts and make a recommendation to to meta about what to do, which as far as I can see, usually they adopt.

44:21And there's this case that started in 2020, where somebody posted like an anti-Semitic Squidward meme where it's like, you know, it suggests that Jews control the world or something like that. And the history of it is that people see the post, they see it's anti-Semitic, they flag it to Instagram, where it was posted. and Instagram repeatedly decides to keep it up. So it keeps getting reported. Instagram keeps saying it doesn't violate the rules. It keeps going like that until it's elevated to the oversight board. They deliberate it for a year and then they put out this ruling and they're like, we decided after much consideration that this should be removed.

45:09And from now on, all types of content that suggests that Jews control the world or something should be removed. And this whole process took four years. This meme was posted in 2020, and the ruling came down late last year. So Meta has spent so much time and so much effort to have this charade about rules and make decisions about what is and isn't allowed on the platform. And then you scroll Instagram, and it's all of that stuff nonstop. If you get fed into that algorithm. That is all you see. And it's upsetting on the level where it's like, okay, well, what is the point of having a moderation team?

45:51And what is the point of having an oversight board if you don't even attempt to act on your own policies? And again, it's not like I wrote the story and then published it and I was like, ha ha, and I caught meta missing something, I sent them the posts. I sent them the fucking posts. I showed them the account. I was like, here's every single thing that it says. And it's a violation of your policies. And they're like, shrug. We don't care. And I'm not some random user, right? It's like, I have a relationship with these people to a degree. We're not friends. You know what I mean? We're not... They respond to your emails, though.

46:28It's like, they know who I am. And they're just like, whatever, man. We don't care about this. And it just... Yeah. I mean, I don't want to talk in circles, but it's like... Well, they also know that you have a platform. Like they know you're writing an article about it. It's not like, oh, this is going to be reported by like random user number 4273. And if we don't take down their report, they're going to write a Yelp review about Facebook or something. It's like they know you're writing an article and that people are probably going to read the article and see what has been left up. and what has been left up is heinous.

47:05It's heinous stuff. Yeah, it's really bad. And I'm sympathetic to the moderation challenge as we always are, right? It's impossible to report on this stuff and not come away with the conclusion where it's like, wow, it's really, really hard, if not impossible, to moderate all the bad content on these giant platforms. And I think this one, I think right now, to be honest, I think it's particularly challenging because like this account and other accounts, there's like this range of stuff you can say where, you know, there's a bunch of memes and shirts and posts from other accounts that are very critical of Israel and are anti-Israel.

47:48And I think by any definition of free speech and hate speech, like that's fine. It's like you can totally criticize the government. You can say America is bad. you can say that Donald Trump is bad, you can accuse people of genocide, and that's totally fine. And then, you know, it slides into, like, you know, Jews control the media and stuff like that. And, like, caricature, like, historically caricatured, like, depictions of Jewish people that have, like, we've, like, long decided are, like, anti-Semitic, like, classical anti-Semitism. and and and again to the point of the piece and like holocaust denial which is like very clearly laid out in facebook's policies and very clearly something that this account is doing so it's like i recognize that there is a challenge there but if you if you step back for a minute and you're like if any human being looks at this stuff they can tell what like that this account is bad and has bad intentions and is racist and anti-semitic and all these things so it's like i i can i can i can uh recognize that they have like a really big challenge in front of them and at the same time be like anyone with a modicum of humanity can look at this stuff and be like fuck this and get it off my platform and it's just like clearly not they're something they're interested in doing yeah i mean i think we've maybe talked about this i definitely thought about it quite a lot regarding the meta ray-bans at ice raids story that i did a few weeks ago and it's like a lot of the pr people at meta who you know i don't know exactly what's going on behind the scenes there but it's like our experience is when we want to talk to someone at meta we send a request for comment and it has now been years since we were able to talk to anyone in like a kind of like let's interview you sort of way on the record at meta like there was a period where i would be like oh uh i'm curious like how your hate speech policy works or like why you're allowing this sort of thing.

50:17And so I would send a request for comment. And then I would get sent to like a policy expert there. And I would do like an on the record interview with them, meaning I wasn't talking to like Meta's public facing people. I was talking to the people who were like actually making the policies, actually making decisions, whatever. And I found a lot of those people to be quite like, like, I didn't always agree with them. But it seemed like they were trying hard, like they were trying hard to like solve a difficult problem. And now, and it's been this way for years at this point, like the last couple years.

50:56But now it's like you talk to a PR person, and then the PR person sends you a statement, or they say like, we're not commenting. And it's like, you have no idea whether that PR person talk to anyone internally at Meta, whether it was actually escalated in any way. You have no insight into that process whatsoever. And that's fine. It's not fine. It's not a deal. But it's just like, that's the way it is now. But it's weird because the PR people that you deal with will act as though everything is the same as it always has been in terms of like, oh, we're trying hard to operate in good faith and make decisions that are good for society and so on and so forth.

51:45And it's like, the actual reality is that Mark Zuckerberg is getting dinner with Trump regularly. He's going to Mar-a-Lago. He's sitting in the Oval Office at these meetings. He's like, I don't know if you saw this video the other day from when Zuckerberg was sitting next to Trump. in the Oval Office, but Trump asks him, like, how much money are you investing in the United States? And he, like, makes up a number. And, like, he was like, oh, like, $9 billion, sir, or something like that. And then, or no, I think it's, like,$600 billion. I think that's what he said. I don't remember. It doesn't matter.

52:21But then, like, a minute later, like, he's, like, on a hot mic. Zuckerberg goes to Trump and is like, oh, you, like, put me on the spot. Did I, like, say the right number, sir? And it's like, they're not taking this stuff down because they don't want... This is what is happening, in my opinion. They're not taking this stuff down because if it catches the attention of Donald Trump, it's going to cause problems for the company. When they were moderating more, like better, when they were actually doing moderation, conservatives got mad, Trump got mad, Elon Musk got mad, everyone got mad at them and said that they were being too woke and there were repercussions for them.

53:03They used to also fear companies would stop advertising with them. And it's like, there's not that fear anymore, because there's not that many other places for companies to put their money. And so they don't care about brand safety that much anymore, which is like, you know, your Procter & Gamble ads showing up next to like, instructions on how to drink bleach, like Procter & Gamble bleach to kill yourself or something like that. That is like not of concern anymore in the way that it used to be. I think that when they were doing moderation very seriously and also making a show of it, they thought what a lot of people naively but understandably thought in 2016, where it's like, Trump was elected, that was kind of a fluke, and it's going to swing back.

53:51And we're going to return to some like, not even progressive, just like a liberal order of things. And they were preparing for that. And when it became apparent that that is not the case, they were like, fuck it. And that's where we're at. And last thing I'll say to this, I said it again, but I just want to stress it. Whatever the reason is, if we're totally wrong about why this is happening, it doesn't change the fact that it is, I think, impossible to overstate how bad it is for society for us to be awash in this imagery. it's like it's not normal it's not good it's it's I think a lot of us because there's so much of it and we're used to it and we grew up on the internet and we saw a lot of this stuff we're like you know okay whatever but it's like it is it is it makes me kind of sick to think about how much of this is out there and how it's being shoved in our faces constantly dude I also hate to say it but it's like you could always find this stuff on the internet but like I don't know when I found it on the internet I found it in the like uh like context of reporting or on like how deep does the internet go like what is on like rotten.com and then like linked from like rotten.com or like some weird forum to some like other weird forum or whatever and and so it was like difficult to find first of all and second of all it was like I came to it with the context of like, I know I'm in a deep, dark, bad part of the internet and I've like clicked too many times.

55:33Whereas now it's like you have the entire social media going populace of the entire world shown this stuff when they log on. And so much of the like, so many people consider like Instagram to be the main thing that they do on the internet. Or Facebook to be the main thing they do on the internet. The moderate one, like the fairly normal-ish one. But yeah, that's a great point. It's like that used to be part of the sales pitch for our type of reporting, right? It's like, we're going to the dark corners of the internet. And it's the dark corners of the internet are the front page of Instagram. It's like algorithmically being spoon-fed to you.

56:14Yeah, it kind of makes me feel bad as a reporter because I'm like, oh, I need to find something to write about today. I don't need to go spelunking anymore. I just need to click the Instagram app and scroll for five seconds. But anyways, anything else on this? Should we leave it there? Let's run. Let's leave it there. All right. So we're going to leave that there. If you are a 404 Media subscriber, we're going to have a bonus segment for you about the AI Darwin Awards. if you're listening to the free version of this podcast you can get access to our conversation about the AI Darwin Awards by subscribing to 404 Media at 404media.co you will get a bonus segment every week on our podcast as well as our behind the blog segments on Fridays you get other bonus podcasts you get other stuff as well it's a good deal so consider subscribing Anyways, thank you for listening to 404 Media.

57:20This is the 404 Media Podcast, a production of 404 Media, LLC. As always, we will be back with a new episode next week. This episode was Mixed, Mastered, produced by Kaleidoscope. And you can subscribe to us and find more at 404media.co. I am this week's host, Jason Kebler, and we'll see you soon.

58:06Transcription by CastingWords

From the publisher

This week, we talk about how 'Boring History' AI slop is taking over YouTube and making it harder to discover content that humans spend months researching, filming, and editing. Then we talk about how Meta has totally given up on content moderation. In the bonus segment, we discuss the 'AI Darwin Awards,' which is, uhh, celebrating the dumbest uses of AI.YouTube Version:

AI Generated Boring History Videos Are Flooding YouTube And Drowning Out Real History

Instagram Account Promotes Holocaust Denial T-Shirts To 400,000 Followers

AI Darwin Awards Shows AI's Biggest Problem Is Human

Subscribe at 404media.co for bonus content.
Learn more about your ad choices. Visit megaphone.fm/adchoices

More from The 404 Media Podcast

All 164 episodes
AI Slop Is Drowning Out Human YouTubersThe 404 Media Podcast · 59 min
Listen in VO