In short
Podcast Notes: Hard Fork - Episode: Inside the Hunt for the Discord Leaker + Twitter Chaos Updates
Episode Summary In this episode, Kevin Roose and Casey Newton delve into the recent intelligence scandal involving leaked documents on Discord, the ongoing chaos at Twitter, and the implications of AI advancements that draw parallels to the TV show "Westworld."
---
Key Topics Covered
- Discord Leaks and National Security
- Guest Introduction: Aric Toler
- Director of research and training at Bellingcat.
- Collaborated with The New York Times to uncover the identity of the alleged leaker.
- Incident Overview
- Jack Teixeira, a 21-year-old Air National Guardsman, arrested for leaking classified military intelligence on Discord.
- Leaked documents had significant implications, including revealing vulnerabilities in the Ukrainian military and compromising U.S. relations with allies.
- Nature of the Leak
- Documents were initially shared in a private Discord server called "Thug Shaker Central," primarily used by teens and gamers.
- Leaked materials eventually made their way to larger public servers through casual exchanges among users.
- Cultural Commentary
- The incident highlights how online environments, particularly Discord, can blur lines between private discussions and public leaks.
- The casual nature of sharing information among friends led to serious national security ramifications.
- Twitter Updates
- Current State of Twitter
- The platform has deteriorated into chaotic management, with ongoing issues including the verification system.
- Elon Musk's changes have led to confusion and the perception of Twitter as a platform lacking seriousness.
- Verification Chaos
- Musk announced changes to the verification system, threatening to remove checkmarks from non-paying users but has delayed implementation multiple times.
- Concerns that the subscription model is unpopular and may not succeed in generating revenue.
- Privacy Issues
- Recent failures include Twitter circles allowing private posts to appear on public feeds, raising significant privacy concerns.
- Users advised against using Twitter DMs for sensitive communications due to security vulnerabilities.
- AI Developments and Westworld Parallels
- AI Research Discussion
- Recent study from Stanford and Google on generative agents capable of simulating human behavior in a virtual environment.
- These AI characters exhibited unexpected behaviors, including gossiping about each other and planning events.
- Implications of AI Memory
- AI agents can simulate memory retention, allowing them to build on previous interactions and create more dynamic relationships.
- Potential for future applications in gaming and virtual companions, raising ethical considerations.
- Concerns about Autonomous AI Agents
- Shift towards developing AI agents that can act independently without human oversight poses risks.
- An example of Chaos GPT aimed at destructive goals highlights potential dangers if such systems are mismanaged.
---
Key Takeaways
- The Discord leak incident underscores the vulnerabilities in how classified information can be mishandled by younger generations in online communities.
- Twitter's chaotic state reflects broader challenges in managing social media platforms and their evolving role in public discourse.
- Advances in AI create both exciting opportunities and significant ethical dilemmas, particularly regarding memory and autonomy.
---
Final Thoughts This episode of "Hard Fork" presents a fascinating look at the intersections of technology, privacy, and national security, emphasizing the need for responsible usage and management of online platforms and AI systems. The discussion serves as a reminder of how rapidly the digital landscape continues to evolve and the implications that arise from these changes.
Written by AI. May contain mistakes. Listen to the episode to check what was said.
Transcript
Automatic transcript. May contain errors.0:00I'll tell you something that went on for me this week. For a long time, I've used the Google Docs product. Have you used this product? The Google Docs? Yeah. You've seen this one? You've seen this one? Okay. Obscure, buried, you know. We like to highlight up and coming ads. So I'm in the Google Docs product yesterday, and I'm working with some folks for a project I'm excited about. And these people are Google Docs masters, okay? I didn't even know that Google Docs could be mastered because it looks so basic. But they keep saying things like, we'll just go down to where I am or go up to where I am.
0:28And I was like, bro, I don't know where you are on the dock, okay? Like I don't have some sort of like doc ESP. You can click the circle. You can click the circle. Did you knew you could click the circle? Yes. Okay, I have to tell people this. If you are in a Google Doc with other people and you're editing collaboratively, you can just click the little circle at the top of the page with their little initial or their picture and it will take you to wherever they are in the document. Wow, I can't believe you're just learning about this in the year 2023. How long would you say you've known this? At least five years.
0:57There's no way. Yes. Five years? Yes. Why has this never come up before? This is insane to me. You know why it is? Because it's in the New York Times. There's like five bylines in every story and six editors. And so you actually have to know. Like I work for normal media organizations where like you're lucky if you could like get an editor to like come into the newsroom to help you out. And so maybe there just haven't been that many people in my Google Docs. Wow. Casey, I'm going to blow your mind. Okay. Pro tip. You can print a document on Google Docs. Now we're just saying things that no millennial would ever do.
1:27But I think it's great that Google has added these features. You know, generally speaking, you don't want other people in your Google Doc, and I'll tell you why. Because they're going to have ideas, and those ideas are going to make more work for you. But if you find yourself in this sort of nightmare situation of working with other people, you can click the circle. Wow. I love the idea of a podcast where every week we just teach you how to use one extremely basic office product. You know, you're laughing, but I think that that could actually be quite useful to our readers. Next week on Hard 4, Casey learns Excel.
1:55Hell. We're going to need more than one episode for that.
2:03All right. I'm Kevin Roos, tech columnist at The New York Times. I'm Casey Newton from Platformer. And you're listening to Hard Fork. This week, how a private Discord server ended up at the center of a national security crisis. Then, more chaos and clownery at Twitter. And finally, what happened when researchers gave AI memories? I'm guessing it was nothing good. We'll find out.
2:39All right, Kevin, can we talk about national security for a minute? Absolutely. All right. Is this a secure line? Yes, I am in the sensitive room inside my house where I handle classified information. So we are good to talk about this stuff. Let me tell you, every room in my house is a sensitive room, depending on the day. But what I want to talk about is the national security aspects of it all. Yeah, so this is a big military intelligence story that is currently making front page headlines in the New York Times and other publications. So on Thursday, federal investigators arrested a man named Jack Teixeira, who is a 21-year-old Air National Guardsman.
3:17And they believe that he is linked to this leak of classified military intelligence documents. These documents have been circulating on the internet for a while now, and it wasn't clear who had leaked them or why, but these documents really did cause a stir. They've compromised some of our relationships with other countries. They've exposed weaknesses in the Ukrainian military. This is a big deal, and it seems to have stemmed from a very strange, very online source. So before we talk about the online piece of this, let's just talk about what these documents were and why it's important that they're out there.
3:56Yeah, so these documents were, one, just very politically sensitive. Two, this was also supposed to be top secret. And there is stuff in there that the United States was trying to hide both from its adversaries and allies alike. It included things like details about secret American and NATO plans for building up the Ukrainian military, for example. And then third, these are just timely documents, right? Sometimes when we hear about these leaks, they're years old. somebody finds them in a file cabinet and blows a whistle the information in these leaked documents is in some cases weeks old and it seems like stuff has been leaking for even longer than that so that's just a really big deal yeah and i would say like this leak of classified information has really shaken the national security apparatus so you know military intelligence officials have been looking into it furiously trying to figure out where it came from and who did it the state Department and other agencies are trying to handle some of the geopolitical fallout.
4:55And Merrick Garland, the United States Attorney General, made a statement on Thursday about the case. That's right. And what's really interesting to us is how these documents have been circulated. These documents were found on Discord servers, and not just any Discord servers, but video game Discord servers. And at least at first, it seemed like people were posting these documents not to blow the whistle, but to win arguments online. And so, Kevin, when you and I heard that, we said, well, we need to get to the bottom of this. Totally. And before we get into the details of these documents and why they're being shared inside these peculiar Discord servers, let's just explain for people who maybe don't know what Discord is.
5:36Yeah. So Discord is a communications app. It's free. And while it started as something that gamers primarily used. Now, basically, everyone's use it. And there are discords devoted to posting memes. There's discords devoted to making generative AI. I have a discord for my newsletter where people who read my newsletter can just kind of hop in and talk about today's issue and other things that are on their mind. So it's just kind of a very fast-growing, very popular next-generation social network, I would say, that is used by all sorts of folks. Right. So I would compare it to something like Slack or Microsoft Teams, but it's not work-focused.
6:12It started, as you said, as a gaming thing. And there are different kinds of Discord servers, as they're called, right? So anyone can start a Discord server. And some Discord servers just have a handful of people in them. But I've been in ones where there are also millions of people. So it can range from very small group chats to very large message board type things. Yeah. And an interesting thing about Discord is that you typically belong to both public and private discords at once. So you might have a very small, essentially a group chat with your friends, and then you also belong to a bunch of larger servers.
6:47And this winds up playing a key role in the plot here because what it seems like happened was that some materials that were designed to be shared only with a group chat pretty quickly migrated to some much bigger servers. Yeah, so we are still piecing together exactly what happened with this leak of classified information. But what we do know is that the leak appears to have started on a private Discord server that was populated by a group of friends who played video games together. The server at one point was called Thug Shaker Central, which is, do you get that reference? I don't. Yes, I looked it up and I would say it is a meme that is not great.
7:29Like how not great? Like, I would say that this meme originated in the world of pornography. And I would say pornography with a somewhat racist bent. Oh, okay. So we won't talk about the origination of the name Thugshaker Central, but that was the name of this Discord server. A bunch of friends are in there talking about video games, presumably talking about lots of other things. And at some point, someone in this Discord server, who we now believe is the person who was arrested, the airman Jack Teixeira, shares these classified documents. in this essentially group chat. And this might have just remained in this group chat.
8:13But because this is the internet, because this is Discord, because as you mentioned, lots of people belong to multiple Discord servers, things just got really weird and out of control. Yeah. And look, I'm sure you're in many group chats, Kevin. I know our listeners are too. And if there is one lesson you can take away from this story, it is that stuff is actually going to get outside of the group chat. Yeah. What happens in the group chat doesn't stay in the group chat. And we don't know exactly what happened in this case, but it appears that some of this classified material was eventually taken from this Discord server, Thugshaker Central, and shared to a public Discord server that was devoted to a niche YouTuber called WowMau.
8:55Have you heard of WowMau? I have now heard of WowMau. I've heard of WowMau now. But before now, had not heard of WowMau. How now? Wow, Mao. And this is a thing, like, lots of YouTubers have their own associated Discord servers where their fans will go and talk about their new videos or just talk about whatever. It's sort of this fan community. So these documents, these classified military intelligence documents, end up in this niche YouTube Discord server for Wow, Mao. And then from there, it seems like somebody in that server saw those documents, saved them, and then re-uploaded them to another Discord server.
9:34This one, a big one, devoted to Minecraft. And this really is the funniest part of the story, because what appears happened is that in the midst of a minor spat, one of the people who had access to these documents just threw them into the chat by saying, here, have some leaked documents. Which I think we can now agree is just a funny thing that we will now start saying to each other all the time. It is funny, but it's also like, this is a serious leak, right? This is leading every major news organization right now. The State Department and other agencies are scrambling to contain the geopolitical fallout from this.
10:13So this is a major event. And the fact that it has such a weird and sort of hyper online origin story just made it totally fascinating to talk about. And so I thought we should bring in one of the reporters who has been really leading the charge on this story. And that person is Eric Toler. Eric is a reporter for Bellingcat, which is a group that specializes in what they call open source research, or just basically using publicly available internet data to kind of solve mysteries and do reporting. He teamed up with reporters on the visual investigations team at the New York Times. And he is an incredibly good internet sleuth.
10:52And he was actually one of the reporters who broke this story in the New York Times. So I thought we should get him in and talk to him about where this leak came from and what he can tell us about how this strange online discord culture has birthed a true national security scandal.
11:29Eric Toler, welcome to Hard Fork. Hi there. So you are part of a team of reporters that have been digging into this Discord leak and just published a story in which the name of the alleged leaker or the leader of the Discord server where these groups were originally leaked is this 21-year-old from the Massachusetts Air National Guard named Jack Teixeira. So my first question is, how did you and your colleagues track this person down? Yeah, it's a little convoluted. And there's a lot of different platforms that most people probably know about, maybe not everyone. So this whole thing came to a head and everyone realized what was going on in the Times published a story about how the Pentagon is looking into this leak.
12:14And at the time, it mentioned that there were some posts on the messaging app Telegram. And so I was looking back, like, you know, there's no way this is the original source they had to come from somewhere and i looked and looked and i found three photos and two other ones that weren't in the telegram cache on 4chan but four of the ones on telegram weren't on 4chan so clearly they got it from the same place i just don't know where that place is so i looked and looked and looked kind of funny thing and then somebody dm'd me of like hey i think i saw this on discord and they pointed me to a minecraft map server it's where people make maps like of earth like they try to make like real life earth on minecraft and this guy had posted 10 on there and of the seven that were posted on 4chan slash telegram those seven were from this cache of 10 and there were three additional ones in here that no one had seen before as far as i know so i talked to that minecraft guy very nice minecraft guy he's like no it's not me because he was terrified for good reason he's like no no he's also a kid he's ever by the way this is going to be a recurring theme they're all kids a bunch of 17 year olds and this kid was like, no, I'm not the leaguer.
13:18Everyone, no, please, everyone leave me alone. I'm innocent. I got this from a different server, a different guy. And he got them from another 17-year-old, another kid who posted them on another server about this YouTuber guy. Yeah, so you're, of course, talking about the WowMouse server. Yes. So I, from there, I talked to a few other people, four people in total in the server, and eventually I figured out, kind of from these people I was chatting to, that it was a different server that this kid was a part of that he pulled from and then posted on the wow now so there were hundreds and hundreds on this other server called it had a lot of different names but the name at the time of the league was thug shaker central which is like this meme from like a couple years ago and this is where hundreds and hundreds of these were posted on here the 17 year old kid took 107 of these and cross posted them onto the wow now server and they've been being posted on this older server this thug shaker server since like at the latest um october it could have been earlier but at the latest around october of last year so you followed the sort of trail of breadcrumbs back to this server thug shaker central yeah and then from there i think you'd say that out loud before yeah and then how did you figure out who in that server had probably leaked these documents yeah and from there i was like okay well there were only about 20 or so active members in this server so the pool is pretty small and i know because i talked to the kid who also was 17 and he told me about like yeah so he called him og so he i that's not what anyone else called him that way he just gets because i was like the original leaker he's like well let's just call him og like the original guy or the original gangster whatever so this 17 year old this literal 17 year old who's in this discord server called thug shaker central tells you that the person who originally posted this in that server the the leaker we're assuming is someone that he was calling og he was like yeah there's this guy we call me og he he has money and he's well armed he's like this really cool dude and we played lots of games together on steam so steam is a gaming platform it's kind of like it wasn't like the playstation store or like the xbox game store but he's like we played arma 3 together and we played project zonboid and we played halo and he mentioned all these games they were playing and that's like how like they're they're buddies and they just play game together right so it's a bunch of teenagers not just americans from all over who are on this little discord server about 20 active users or so and then come this guy who we now know is jack he came in and was sharing all these like documents like hey look look what's going on guy right that sort of thing so i knew a handful of people who were involved so i knew um that these guys all played steam together i knew some of the games they played and i you know all that so i used um a few different tools to find uh because all these obviously these people almost all made their accounts private or deleted their accountants basically everywhere after the story broke.
16:04So there's a couple sites where like steamid.uk, for example, that has historic scrapes of Steam data, like not just who their current friends are, but like who their deleted friends are, either people who deleted their account when private or removed the friend of friends list. And I looked at some of these people's accounts, and I kind of like, okay, here's 400 friends, here's 250 friends, here's 300 friends, and like, who are the intersections? Like who's common friends with all of them? And basically, all the people who were common friends with all the players that I knew about were people who were also in the server so like okay well which of these is the most likely guy and there's one guy in particular who kind of stood out i looked into a little bit more into this guy and i found uh actually one of my colleagues over at bellingcat was looking into his id and they found that he was on this like arm like this gun kit selling website like he used one of his steam usernames he also used for selling some kit like scopes and body armor that sort of stuff so um we looked more into this guy's steam list and we saw just a few things that matched up like all the games that that this guy who's on the server told me they played together on the three projects on boy counter-strike blah blah blah he played all those games like there were screenshots he had posted like there's activity he played those games and so then i went through the usernames that he had for scene because seeing people you can change your username over and over and over and over and the very first username he had was something that's like very different than the other it was like jack something something tex no that's kind of that kind of sticks out because the other names are like the Excalibur effect you know very like dramatic names and so I googled this name and there's two results one Steam profile and two was this Flickr album showing a guy and his kid and this is from 2007 and it was Jack and Jackie was the name of the album for example so I was like well Jack is the name on the Steam ID and but you know 2007 was pretty old so I At first, we thought that this dad was the leaguer.
17:55But then we looked more and more, and we realized that we looked into the mom, and we found some other family members. And we found photos of a new Air Force Reserve person whose name was Jack, who had just recently entered into the Air Force National Guard. And he had some kind of shitposting adjacent stuff on some of his Instagram and his Facebook. And I was like, oh, this makes way more sense. And then we looked a little bit more and we saw that one of the usernames for his Instagram and his Facebook was also something linked back to his Steam account too. So we realized that he just hijacked his dad's Steam account.
18:29So the Steam username and the Flickr username were the same. That's because imagine you're like 12 or 13 and you play your dad's Steam account, but you don't want to make a new one because you already bought games on the account, right? You don't want to make a new account where you lose access to all your Counter-Strike and Thugbee and all that stuff, right? so he just he just basically took over his dad's account renamed and he started using it but the sites retained the historic name info so the dad flicker account and the steam account were the same which led to the family which led to photos of him and it linked back to the username he used for his instagram and facebook for the same as for his kind of revised hijacked steam account and then from there realized oh he's actually with the intelligence um wing of this international guard and then everything kind of fell together wow and besides deleting the server the thug shaker central server off of discord did the leaker try to cover his tracks in any other ways uh i mean he made the same profile private but there are services out there seen id.uk big shout out to those guys who run that server i'm i'm a nine dollar month patreon subscriber so i got access to their premium stuff to help with this story so eric this is a very impressive bit of internet sleuthing.
19:41And I know that you have spent a lot of time tracking down not just this leaker, but many other people and incidents on the internet. That's kind of your specialty. But I think the details of this are surprising to a lot of people just because it seems like such a mismatch. Usually when you have a leak of military intelligence, it's coming from someone with an ax to grind or a point to prove, a whistleblower who has some conscious-driven and reason that they want to get this information out there. And it just seems so strange that it emerged in this Discord chat, Thugshaker Central, where these gamers were, you know, many of whom were literally teenagers, were just sort of hanging out, trading insults and memes and whatever else.
20:24So help us understand, for people who have not spent as much time in these kinds of Discord servers as you have, like, what is the culture of a server like Thugshaker Central that would make someone like this alleged leaker jack teixeira want to post classified military documents so i mean it you know again they were just you know like 20 or so kids and they just kind of it's very intimate environment because like it's like voice chat too right you're doing a lot of voice chat you're playing games and all that stuff so it's not like it's like this very like i don't know like sanitized neutral like this like a lot of times like twitter or like you know whatever it's a little bit more distant right you see tweets and you interact with them very publicly this is a lot more intimate you have voice chat things like that so because of that people probably felt like they were very close to one another i mean like this uh the kid who gave the interview to watch one post um said like he was my best friend you know he felt like he was very tight very close to him i'm not sure if it was reciprocated but i mean that's you can kind of get the idea that like there was this sense of like they were a tight-knit community so think of as like a you know a more intimate group chat i guess you could say rather than like you know a discord server which makes it sound like it's a lot more official than it really was right which kind of builds the trust i guess i guess what i'm wondering is like i you know i've been in some gaming group chats um i have friends that i know through playing video games i have never once thought to leak them secret information from my job too old to think that yeah but sort of zooming out as a person who has been studying you know extremism and online mischief for a long time, who has sort of specialized in tracking down hard-to-find people and things on the internet.
22:04Was it surprising at all for you that this new leak that is really turning the United States government upside down, was it surprising to you that it came from such a seemingly strange source? Not really. I mean, if you think about, like, how is this leak going to happen? Because I'm sure this happens. I'm sure that there are people who have classified documents who share them with their buds, like PodGossip, right? But most people don't have a 17-year-old friend who will then post them onto it. different discord you know so maybe the people who are doing this right now just have better friends or at least maybe friends with better filters or their sense of judgment i mean i well yeah one lesson i'm taking from this is that people are just not as good at doing crimes as they think they are and that especially when the internet is involved they just like do not understand how to you know share things with other people in a secure way yeah it's insane yeah eric thank Thank you for coming on Hard Fork.
22:56Sure. Thanks for having me.
23:31Casey, it has been several weeks since we have talked about Twitter on this show. Yeah. We had to set it aside for a minute and sort of let it cool down. Yeah. Right. It went into timeout. Yep. But now it's back. Yep. And a lot has been happening. So I have to confess that a few months ago, I was kind of doubting whether all the predictions of Twitter's doom were actually going to come true. Like, people kept saying the app is dying, people are leaving, it's going to break, they're laying off all these people. It still ran and seemed pretty normal. But now it looks like things are seriously starting to decline.
24:06And we don't have time to run through all of the disasters. So I just picked sort of three categories of Twitter chaos that I want to ask you about. Check marks, circles, and clown shit. The three Cs. So let's start with check marks. Okay. So we're talking about the checkmarks, which are officially called verified badges. And Elon Musk, you know, he said that on April 1st, every person who does not pay for Twitter Blue who has one of these checkmarks, you know, members of the media or celebrities or politicians would lose their checkmarks. That date came and went. Yeah. And as of right now, I'm pulling out my Twitter profile and I still have a checkmark.
24:48Oh, look, I do too. So what is the deal? What is going on with Elon Musk and these checkmarks? Well, look, on one level, checkmarks did play an important function on the old Twitter because they would tell you that somebody was who they said they were, and that helped with impersonation. And then Elon decided that the best path forward for Twitter as a business was to pivot it away from advertising and towards subscriptions. And the main kind of carrot that he wanted to offer to people in order to get them to subscribe was a verification badge of their own. As you well know, the first round of this went very poorly.
25:25They let anyone buy a badge for$8. They didn't check to see who anyone was. People impersonated the pharmaceutical company Eli Lilly and many other institutions at some point causing wild swings in their stock price. And so it kind of got put on a back burner, and Elon said, let us think this through a little bit more. And so, yeah, as you say, the new deal was going to be, okay, everybody, April 1st, if you're not paying, you're going to lose your back. And then that got delayed. And so now he's saying everyone's going to lose their badges on April 20th. That's 420 for all you stoners out there.
26:00And we'll see. I mean, you know, Elon has a very chat GPT like relationship with the truth. You know, like this is somebody who is not drawing on a store of facts all the time, I would say. And so when I hear that he has set a new deadline, no part of me believes that it's real. I think it could happen. But like, I don't I don't have any expectation that it will. Right. What do you think is actually going to happen on 420, the new day when all the checkmarks are supposed to disappear from these legacy verified people and organizations? Well, here's what we know. So far, only a very small percentage of Twitter users are paying for Twitter Blue, which includes this badge.
26:38He keeps extending the deadline, I think, because he assumes people are going to fall in line and they're going to say, oh, I've gotten my extension. I guess I'll get that eight bucks together and I'll finally pay. And he's just banking on the fact that these badges are going to become more precious to people. I don't think that's going to happen. So at some point, he's going to have to put his money where his mouth is, and he's just going to have to start taking away people's badges and then see if that has the desired effect. I don't think it's going to. But I can also see why he would want to delay it, because after he does that, he doesn't have a lot of moves left, right?
27:10I mean, you could imagine moves. Like, he could start charging people to tweet, right, or something like that. But if we get to that point, it's going to be in a very desperate place. So I could see him delaying this again and again and again. Yeah. My bigger question is, we know that Elon Musk wanted to shift Twitter from an ad-based model to a subscription model, right? That is the business problem that he is trying to solve by instituting this$8 a month Twitter blue verification scheme. Does the fact that this program has been so unpopular mean that people just aren't willing to pay for social media at all?
27:44I think people are willing to pay for all sorts of things on social media. It tends not to be these features that were previously offered for free, but TikTok was the highest grossing app last year. And the reason isn't because you have to pay for your badge. So there's a lot of money out there for the social media ecosystem, but you have to bring real product and design chops to it. You have to offer a stable functioning product, and Elon just hasn't been able to deliver on either of those. Yeah, I mean, to me, it shows the power of anchoring, right? If you start a new social app and you say, you know, this is going to cost$8 a month and here are all the things you get, or, you know, you can give tips to your favorite creators, like, that seems like a proposition that people might actually go for.
28:32But if you take something that used to be free and then start charging for it without any real increase in value, like people are anchored to that free price. And it's going to seem not just a stretch for them, but it's going to seem offensive to them. They're like, I used to get this for free. I'm giving you my tweets for free. You're using them to make money. Like I'm not going to pay you for the privilege of filling up your platform with my content. Totally. And to me, the exciting thing here is this is a move that is finally making people start to say, you know what? maybe I should stop giving this guy my tweets for free.
29:03All right. Next C on the list, circles. Twitter circles are a product that I have never used. What are they? So Twitter circles is very similar to the close friends feature on Instagram. So if you use Instagram, you can create a list of your very close friends. And then if you post to your story, these sort of ephemeral posts that only last for 24 hours, those stories will only be seen by people in your close friends. Twitter circles launched with the same basic idea that instead of broadcasting your tweet to the entire world, you could broadcast to a subset of the people that you follow. Now, I never use this feature very much myself because most of the people that I would include in my close friends are media people.
29:50And if I said something stupid on Twitter to my a close friend circle, they would just screenshot it and get me fired. This is a huge relief to me, by the way, because I was paranoid that you did have a close friend circle on Twitter and that I wasn't in it. I was posting detailed reviews of your podcast performance every week to a close group of friends. No, I wasn't using it. But I'll tell you, I have some gay friends in particular who were using circles to post, let's say, some spicier, more adult-oriented content. And so that made what happened on Twitter circles this week something of a catastrophe.
Read the full transcript
30:23Okay, what happened? So what happened was, as I said, these posts to your circles are supposed to be limited to a group of people that you've put on an allow list, okay? But then some poor souls browsing the Twitter feed started to see posts on the For You page. The For You page is the algorithmically ranked feed of posts that Twitter might think you would enjoy for any number of reasons. Right? It's ranked, but it could potentially be seen by anyone. And so essentially, you had private posts that were being not just made public, but recommended to the public. So the best analog I can offer here is imagine that you posted something really heartfelt or embarrassing or vulnerable on your close friend's Instagram story, and then a stranger opened up the explore page on Instagram and saw it promoted at the top of their feed.
31:14That's what just happened on Twitter circles. And in a way, it's like funny to me that this hasn't gotten more discussion because this is a truly catastrophic privacy breach. Right. I mean, it's sort of like if your DMs were just showing up on people's Twitter timelines. It's like that level of a privacy scandal. Yeah, absolutely. You know, Elon did an interview this week where he boasted that a lot of folks said Twitter would be dead by now. But it's not dead because like his standard for his Twitter alive, I think, is like, can you still log into the website? But this is a great example of how when you get rid of a huge number of people that worked on your technical infrastructure, weird stuff is just going to start breaking in ways that can have quite a terrible effect on your user base.
31:57Yeah, I mean, I've been wondering whether there will be some kind of mass DM leak that stems from all these engineers getting laid off. That hasn't happened, but this Twitter circles thing does seem to be pretty close. Like, these are supposed to be private, but all of a sudden started showing up on people's for you feeds. Oh, yeah. And when the layoff started, Twitter engineers started messaging me saying, like, don't use DMs anymore. Like, they're just not a safe product. So I don't use Twitter DMs anymore for anything remotely sensitive. But, yeah, watch out, man. Wow. So do you have any idea of, like, what went on behind the scenes to make these Twitter circles posts start showing up for people they weren't supposed to be seen by?
32:35To my knowledge, they have said nothing about it, which does not exactly inspire confidence. So put your spicy tweets somewhere else because they are not safe in Twitter circles. OnlyFans is now accepting spicy private subscription only posts. When are you starting your OnlyFans? Well, we'll see how subset goes. Okay, that brings me to my third kind of catch-all category for what I am calling clown shit. This would include things that Elon Musk has done in the past couple of weeks. that just seemed like he's just kind of playing for laughs or not behaving in a serious way. He briefly changed the Twitter logo to the Doge image, the Shiba Inu dog that is also the face of Dogecoin.
33:21That lasted for a few days. It was not on April Fool's Day. No, I believe it launched on April 3rd, and everyone was joking like Twitter tried to do an April Fool's joke, but it took like an extra two days to launch. Which seems plausible to me. Yeah, totally. He also painted the sign on the Twitter building in downtown San Francisco, or he had it painted, so that it just now reads Titter. I truly don't believe that even an eighth grader would find this stuff funny. I can't imagine anyone is observing any of this and thinking this is so funny and cool. Right. This is the man that I want to entrust my company's advertising budget to.
34:02He also changed his display name on Twitter for a day or two recently to Harry Balls. Harry spelled H-A-R-R-Y and Balls spelled B-O-L-Z. This man is not well. Can we just say, the man is not well. Yeah, what is going on? Look, I think that driving a social network can actually drive you crazy. It's very difficult. You're running a platform that is hosting this huge portion of the world's speech. You're getting criticism from absolutely every corner. And that's hard enough, even if you are a very good CEO with kind of a good plan for where you're going. I think if you come into that with no background in the subject matter, and you've committed $44 billion, and you are losing money every month, and none of your ideas are working.
34:56Oh, and also you're working on a handful of other giant companies that have their own problems. That is just not a recipe for success, right? And so many people when Elon took over said, well, look, this guy's going to be different, okay? He's special. He builds rockets. A social network? Yeah, I think he can handle that. And then you fast forward to April 2023. Guess what, honey? It didn't work. He's like, give me the rockets back. That's right. Right. This isn't rocket science. It's actually harder. It is harder. But is there one person who wouldn't be relieved if Elon Musk says, I am stepping away from Twitter and I'm just going to work on rockets full time?
35:27Like, everyone would be overjoyed. I think even his fans would be overjoyed. Completely. Because, you know, he's been getting blowback from some people who previously have supported him. People like Paul Graham, who is a big Silicon Valley investor. He's a co-founder of Y Combinator. And he's been criticizing Elon recently for basically just taking his eye off the ball. You know, like, wasting his time running Twitter instead of working on SpaceX or Tesla. So even the people who are sort of predisposed to support him are not fans of what he's doing at Twitter. I want to ask you about one more thing that I would put in the clown shit category, which is what is going on between Twitter and Substack?
36:05Well, so, you know, ethics disclosure, I publish my newsletter platformer on Substack, and they've helped me in various ways over the years. And I have a note on my website about that. But Substack decided in the midst of all this chaos to— And Substack, for the people who may not know what it is, it is a newsletter platform. You can subscribe to newsletters, either free or paid. Substack is just kind of the infrastructure that powers that and allows people to pay you to read what you have to write. Yeah, that's right. And they saw everything going on at Twitter, and they said, well, gee, it seems like this thing is having some trouble.
36:41Maybe we could build something similar of our own. And so they built this product called Notes. It launched this week. It lets you post text and links and pictures, and you can reshare those. They call that restacking. And when Elon got word of this, he really overreacted. And for a time, he blocked users on Twitter from engaging with tweets that had links to sub stacks in them. If you click the link, it would say this website is spammy or dangerous. Which is true in the instance of platformer. Platformer is a spammy and dangerous newsletter. But for other Substack newsletters. It's better. Unfair.
37:25Yeah, it's unfair. So they marked Substack links as, quote, potentially spammy or unsafe. They also blocked searches for Substack. So if you search the word Substack, it would just show you results for the word newsletter. So it's like, oh, you're looking for a Substack? Well, we're not going to show you that, but we will show you newsletters. So when he got asked about this, Musk said that Substack was, quote, trying to download a massive portion of the Twitter database to bootstrap their Twitter clone. And I went over to Hacker News to see what they were saying about this comment, which I found completely inscrutable.
37:59And the Hacker News people, this is a community of engineers and some of the most delightful nerds you'll ever meet. And the Hacker News people were just laughing their heads off because they were like, what does this even mean? It's like, you can't download it. It just didn't make any sense whatsoever. And so, you know, as usual with him, there's not a relationship with the truth there. It's just kind of like, you know, spewing words, and it was all nonsense. I mean, what I found most interesting about this beef between Elon Musk and Substack is that one of the things that animated him when he took over Twitter was that he thought that the previous management of Twitter was sort of throttling or shadow banning sources of news that they didn't like, right?
38:37That's right. He was very upset about what happened with Hunter Biden and that story during the 2020 election where Twitter, you know, blocked people from sharing that New York Post story about Hunter Biden. Right. And then he Hunter Bidened Substack. He made it so that you could not share Substack links or comment on them or like them or search for them. He disappeared Substack from the platform. And Substack is where a lot of the people that he is ideologically allied with, these sort of Twitter files, journalists and other opponents and skeptics of the mainstream media, are going. He was basically cutting off his friends and allies from one of their main sources of distribution.
39:17It truly is the funniest possible outcome to this story. And I just think the more serious point is this is not a principled man. This is someone who talked about nothing except his speech principles and his desire for bipartisan dialogue and let's move to the center. And he spoke about it in the most grandiose terms. And the minute he felt the slightest bit of discomfort, all those principles went out the window and he said, I am going to punish my enemies. And look, some people are very upset about this. I can't get upset about it because every day people learn what I truly have been saying all along, which is like the emperor has no clothes here.
40:01And you can just go on Twitter every day now and see it for yourself. But one of the other things that you have said is that this sort of chaos at Twitter is going to result in people moving. Yeah. So far, that hasn't really happened. There has been no mass exodus of Twitter users to another platform. You know, you're very active on Mastodon now. I think it's safe to say, like, that has not really threatened Twitter in a massive way. Now people on Twitter are talking about Blue Sky, which is this sort of decentralized alternative to Twitter that was started by Jack Dorsey. But none of these alternatives to Twitter have really gained momentum.
40:35So what is it going to take for something to pop up and replace Twitter? Or is it just kind of like the entire concept of Twitter in our media ecosystem sort of dies off and is replaced by, I don't know, group chats and Instagram accounts and whatever else? So there's two answers to that. There's the product answer and there's the NPR answer. I want to talk about the product answer first, right? So you just named some products that compete with Twitter in various ways. And you're right. None of them has supplanted Twitter in the popular imagination. But again, let's remember, Elon has only owned this website since October.
41:10We are six months out from when he took over. We first started talking about this on Hard Fork. The reason that these products are now being built is because there is an appetite for them. They are growing. And frankly, there are just now so many of them that even if one of them hasn't, like, entered that period of hockey stick growth quite yet, I do think it is probably going to happen for someone. So you're going to have to give it some time. Someone is probably going to have to invent some fun new little mechanic. There's going to have to be some weird, silly new toy that just kind of captures our imagination.
41:46But I do think it's going to happen. So first answer is these products are still getting built, but they are getting built. And that was not true before Elon Musk took over, right? Nobody smelled blood in the water until the past few months. At the same time, Kevin, some important people actually are starting to leave. And I want to deliver one of our signature hard fork tributes this week to a little media organization called National Public Radio. You know these guys? Yeah, NPR. NPR, they were just minding their own business. They were just tweeting links to their stories. And then one day they wake up and they've been slapped with this label, state-affiliated media.
42:23And state-affiliated media was a label that the old Twitter created to identify essentially propaganda. Right. It was like a little label that went under the profile of essentially foreign propaganda outlets just to let you know that the tweets that you were seeing from this account have state affiliation. Yeah, it's just trying to give you a little bit more information so you know where the account is coming from. They allowed them to post, but they wanted you to know that. Well, all of a sudden NPR, which does receive some minor amount of government funding, but is completely editorially independent of the United States government, they now have this label as well.
43:02So it effectively said, this is propaganda. That was the message that I believe the people who added this label to NPR's account wanted you to receive and messages are exchanged. And eventually the state affiliated media label gets downgraded to the government-funded media label, even though it gets less than 1 % of its funding from the corporation for public broadcasting. So the entire point of this was not to serve users of Twitter in any way. It was just to slag NPR and to try to make it look less credible. Right, it was a dunk. It was a dunk. And on Wednesday, Steve Inskeep tweeted a picture of John Lansing, who is the CEO of NPR at a morning edition meeting, morning edition, one of the flagship shows of NPR, and said that NPR will de-emphasize Twitter.
43:56He said that aside from the misleading label, Twitter isn't used by most Americans, drives little traffic to NPR, and no longer has the public service relevance that it once had. And to that, I just want to say, slay. Well said. This is what I have been saying, and pretty soon a lot more people are going to get it too. You think media organizations are going to leave Twitter? This is what I have been waiting for, is for somebody to wake up and say, I do not want to come to a platform every single day and get punched in the face. You know, we know what I've been thinking about lately, Kevin. Do you remember during the Trump campaigns when there would be these rallies and in the center of the rally, there would be a pit for the media and a signature moment of every rally would be Trump pointing to the people in the media so that everyone at the rally could say, boo, we don't like the press.
44:44that is what Twitter has become. It is the press pit where a bunch of people are standing around you in a circle, jeering. Adding this state-funded media badge was one of those steps. But I'm barely joking when I say that I think eventually every reporter who is still on the service will have a clown badge next to their username. And you just have to decide if you still want to be there when that happens. So you are still on Twitter. Well, in the way that I started with. So in December, I was like, I got to change the way that I'm using this website. And so I basically started using it as an RSS feed.
45:16Whenever I have a sort of Twitter-like thought, I put it on Mastodon. And when I have some new piece of journalism to share, a newsletter, a podcast, I put it on Mastodon, and then I repost it to Twitter. I'm not in there having fun. I'm really not replying to people. I'm reading it because it feels important to know what is being said on Twitter, and it's important to know how Twitter is falling apart. Social networks are my beat. I have to pay close attention to it. But I am not really doing free labor for Elon Musk anymore. Hmm. Fascinating. But you still are. Let's talk about that. Well, I want the clown badge.
45:49That would be fun for me. Okay, so Twitter is in clown town right now. But next, I want to talk about a different town. One that is populated entirely by AI. Uh-oh. We'll be right back.
46:15Thank you.
47:00Casey, did you watch Westworld, the HBO show? Yeah, I watched the first few seasons, but I gave up as it became increasingly incomprehensible. Okay, so I also watched like one season and I think it fell off because I just didn't get it anymore. which I attributed to me being dumb but I think maybe the show just also got worse well no here's how it became one of those shows where it was like at first it was very exciting to learn that that person you thought was a human was actually a robot but then that was just the entire show it was like well guess what other human is a robot every member of the cast right so for people who haven't watched Westworld the premise is there's this like theme park where there are humanoid robots that you can go and interact with and they'll talk to you perfectly lifelike Perfectly lifelike.
47:41But when the guests leave, the robots' memories all reset. And so the next time you go, you can just kind of have like brand new interactions with them. Except what Westworld asks is, what if they didn't actually forget? Exactly. So I want to talk about this next story because I think it is actually moving us in quite an interesting direction that is a lot like Westworld. So a paper came out last week by researchers from Stanford and Google, and the title of the paper is called Generative Agents, Interactive Simulacra of Human Behavior. Another one of these catchy clickbait titles from the academics.
48:19And I want to talk about this paper because it's really fascinating, and I think it actually points to the next phase of what's going to happen in AI. You know, we've been talking a lot on the show about these large language models, these chatbots, things like ChatGPT, and how you can actually, like, use them as a kind of persona. Like, you can say, you are my tutor, or, you know, you are my speechwriter, or you are my editor, or you are my friend. Like, talk to me as if you are that thing. And what these researchers wondered is, could you create a city, like a virtual simulated environment, and fill it with AI-generated characters?
48:58A simulated city or SimCity, if you will? Right. Basically, could you make The Sims, but The Sims aren't coming up with things on the fly? So The Sims is this, you know, very popular computer game. But in The Sims, like all of the interactions between characters are scripted and programmed. So what these researchers were wondering is, could you do The Sims with no scripting? If you just took a set of AI-generated personas, which they're calling generative agents, and placed them into a virtual environment, like a city, and just pressed play, what would they do? I have to say, very interesting question.
49:40So the way this works, they created 25 characters. they put them in a virtual environment that they called Smallville, which is kind of like a kind of Animal Crossing style video game. And they gave all 25 of these characters short personality descriptions. So one example was a character named John Lynn. And the thing that the researchers told the AI, and in this case, they did this using the ChatGPT API. So all this is happening with the help of ChatGPT. So the thing that they put in as the sort of description of this character was, John Lynn is a pharmacy shopkeeper at the Willow Market and Pharmacy who loves to help people.
50:21He is always looking for ways to make the process of getting medication easier for his customers. John Lynn is living with his wife, May Lynn, who is a college professor, and son, Eddie Lynn, who is a student studying music theory. John Lynn loves his family very much. Sounds very sweet. So they build these sort of like pre-programmed personalities for these characters. And then they set them loose. They just say like, you know, we're going to observe you for two days. And we're just going to see what these characters will do. And within the context of this game, like are there objectives? Are these characters moving throughout the world?
50:59Are they just sort of bumping into each other on the street and striking up conversations? Or what is happening? Yeah, so the way it works, the researchers who are controlling this experiment can sort of prompt the characters. They can say, you are going to the store to get some food. Then the language model sort of fills in what happens next. Or you're a character, you're bumping into another character in the park, and you're going to have a conversation. What does that conversation say? And then the language model sort of fills in the rest of the conversation and any subsequent actions. Got it.
51:31So I can actually show you what this looked like. Let's see this. I'll share my screen here. All right. So this is a sort of replay of the Smallville. So you can see it's sort of like a blocky, like pixelated map. Yep. With some various rooms. And then you can scroll down here, and here is a list of characters, 25 characters. I mean, they're these sort of like very cute little sprites. Right. And so you can click on any of the characters and see a log of all of their actions. So here's a character named Ryan Park, and Ryan Park's current action is sleeping, and he is in his apartment in the bedroom.
52:12And that's goals. Cheers to you, Ryan Park. And here is another character named Sam Moore. Sam is taking a walk around Johnson Park. He's stopping to take pictures. Oh, and he's having a conversation with another character named Adam Smith. And all of this is being generated by the language model. And along with these characters, the researchers actually developed something really interesting that is sort of like a memory, like a kind of virtual memory for these characters. Because one of the problems with language models, one of the limitations, is that they don't remember things. So you can have a conversation with ChatGPT.
52:51You can tell it some things. And then if you come back a different day and start a new thread, like, it's not going to remember what you talked about. You have to kind of re-instruct it to be a therapist or a teacher or a friend or a negotiating counterparty or whatever. So they sort of get around this with something that they call the memory stream, which is basically a natural language list, like a text list of what a given character has been doing and experiencing. Any conversation they've had gets sort of stored in this memory file. And then periodically, these memories get kind of synthesized into inferences and reflections, sort of summarized.
53:31So you basically have a system where each of these 25 characters can refer back to a file that contains sort of a synthesis and a summary of everything that has happened to them in this simulation. And they can refer to that in different contexts. So, you know, if one character is walking through the park and sees two other characters talking, they can, like, infer that those people must be friends and must know and like each other, and then they can use that information later on in the simulation. So it's sort of a neat technical trick that simulates a kind of memory. Okay, so these researchers, they let this experiment run for two days, and they just observe what these characters do prompted by this large language model.
54:13And what they found was really interesting. So they did a sort of control group experiment where after this two-day period was up, the researchers asked the generative agents a series of questions to kind of assess their self-knowledge, their ability to make plans and remember things. They also gave that test to a group of humans, 25 humans, who had access to all of the same information about these characters. And they basically gave them a replay of what the characters had been doing for these two days and all of their memories. And so the humans answered those questions, and then the researchers had these other humans, these evaluators, go in and rate how believable they thought those answers were.
54:53And the generative agents were evaluated as being more believable than the humans. So that's bad news for humans, so go on. So that was one finding. The other very strange finding that they had was that there were these emergent behaviors that they did not expect and did not intend to happen between these generative agents. Okay, if you tell me that one of these things started asking if it was part of a simulation, I'm going to need a drink. No, they started leaking military documents. So one of the emergent behaviors was that these generative agents gossip. What? But they shared information with each other without prompting.
55:33You're telling me that these Sims are spilling the tea on each other? These Sims are spilling the tea. So in one interaction, the researchers told one character, this character named Sam Moore, that he was going to run for mayor of Smallville. Sam Moore then shares this information with the rest of the town and starts a mayoral campaign. And the other agents start talking about this without, like, interacting with Sam Moore. They're just like, they have learned this information. I mean, this is admittedly big news in a town where, for the most part, people are just sleeping and talking on a park bench.
56:09Like, I could see why this would sort of be the buzz in Smallville. So, but not only are they talking about the fact that Sam Moore is running for mayor, but they're sharing opinions of him. So one agent at one point says, I'm still weighing my options, but I've been discussing the election with Sam Moore. What are your thoughts on him? And another agent says, to be honest, I don't like Sam Moore. I think he's out of touch with the community and doesn't have our best interests at heart. Wow, go off, King. And not only are they sort of gossiping about each other, but they're also coordinating and planning together.
56:41So in one case, the researchers instructed an agent named Isabella to throw a Valentine's Day party. That was the instruction that they gave this character. And this character, Isabella, starts spreading the word. And by the end of the simulation, 12 characters know about this party. And how many of you do you think showed up? I mean, in the real world, a lot of people would flake. But I'm hoping that these AI agents are more respectful. So I want to hope that all 12 showed up. Well, you are wrong because these are believable entities. And much like humans, many of them flaked. Seven characters flaked on the party.
57:24Three of them said they had other plans and the other four just didn't show. It's like setting up a grinder day. This is horrible. But five characters actually did show up at this party. And this was not something that the researchers had predicted. So why are we talking about this? You may be asking. Well, I assume that each week you show up and try to terrify me with some new glimpse at our coming dystopia. Is there another reason? So I do think this has dystopian implications, but I think the most obvious application for this is something like gaming. Absolutely, yes. So in games, a lot of them, especially role-playing games or open-world games, there are these things called NPCs or non-playable characters.
58:05And they're the kind of characters that you come across and they tell you some line or give you some hint. How would you describe an NPC? Yeah, an NPC is essentially an object in the game that exists to give you an objective or to advance you along a quest, but they are scripted to make you feel like you are interacting with something sentient. And of course, you know it's not. But the question that this poses is, well, what if word got around about what you were doing in this virtual world? What if that character could ask you about that or maybe change their behavior? This sort of thing does already happen, but all of those interactions are scripted, right?
58:48What you're sort of suggesting here is that we might not have to script these things in the future. They can just happen. Right. They could just act as the language model tells them to act. So one example that was sort of a joke, but I think someone said in response to this paper that you could be playing a game now and you could kill an NPC in the game and you could return back to that same spot later and all the other NPCs could be holding a funeral. And like that's not something that the game designers would have to necessarily script. I did talk to the lead author of this paper, who's a Stanford researcher named Joonsung Park.
59:22And I sort of said, like, well, beyond games, like, how could this be useful? And he said that one of the ways that this could be used was to simulate behaviors in online groups. So, for example, if you were going to start a new subreddit devoted to, like, celebrity gossip, And you wanted to see, like, okay, how would a set of rules given to users of this subreddit, you know, encourage them to react? Would they become rebellious? Would the thing sort of devolve into a toxic cesspool? Like, how could you basically simulate that without actually having to start the subreddit? Yeah. And this experiment suggests that you could actually just start a simulated subreddit and make some simulated users and see what happens.
1:00:08Totally. You know, another thought that comes to mind is I think we both believe that AI companions are going to be a really big deal. There's going to be some kind of virtual agent that you're talking to, whether it's on your phone or your desktop. And in order for that to work, they need to have a memory. They need to remember what kind of day you were having yesterday. They need to know the names of your friends and family and other people who are important to you. What I think is interesting about this is it suggests what if you actually have multiple different companions for different purposes, right?
1:00:36You're going to have your personal trainer and your therapist. And of course, at first, none of these are going to be as good as humans, but they probably all get better over time. And what if they talk to each other and share information? What if you have a virtual doctor who remembers your entire health history and doesn't make you write down your birthday every time you go to the office, right? So I think there is a huge amount of potential here, and that is a very fun glimpse into somebody already running the experiment. Well, so yeah, so this is the experiment that got a lot of attention this week.
1:01:05But there's also this sort of related thing that is happening in the AI world right now, which is that a lot of people are trying to make these large language models into agents. So turning them from chatbots into things that can act autonomously without human intervention. We talked a fair bit about, like, the need for AI vocabulary. And I'm telling you, agent is just one of those words that you are going to start hearing absolutely all the time. Yes. So in the last couple of weeks, there have been a number of projects that have tried to basically cut out the human. So right now, if you go to use ChatGPT, like you prompt it, you type something in, it types something back, you type something in, it types something back.
1:01:43It's like a kind of ping pong. And what these experiments with AI agents are asking is like, what if the AI model could essentially talk to itself and come up with plans and execute those plans and then generate AI agents to carry out different parts of this task? Yeah, we are really just determined to wipe out humanity, are we? Well, some people literally are. So right now there's a lot of research and energy in the AI world around turning these large language models into what are called agents. One of them is called AutoGPT, and AutoGPT is sort of a tool that someone hacked together that allows you to, instead of just like typing to a chatbot and it types back, you actually give it a task.
1:02:25and the AI can then sort of talk to itself and kind of recursively execute that task or try to execute that task. So you could tell, theoretically, this auto GPT, like start a drop shipping business. And you could then sort of talk to itself and say like, okay, for that, I'm going to need someone who's an expert in shipping. I'm going to need someone who can talk to the big e-commerce companies. I'm going to need someone who can set up, you know, maybe a Stripe account. I'm going to need someone to code up a website. And also I'm going to need someone who can go on Twitter and advertise this business.
1:03:01Now, just to be clear, there's no evidence yet that AutoGPT can actually do this stuff well. It's still not very good. And there are still some pretty big technical hurdles standing in the way of these agents being able to actually do things autonomously. But that's the direction that some people are trying to push these AI systems. Yeah, it's like when you're fighting a boss in a video game and they're like, and you think you're finally whittling them down and then they just summon a bunch of other demons to eat your face. That's what we're building. Right. And the examples of this auto-GPT stuff that have been floating around are mostly just kind of people trying to do these business tasks.
1:03:36But there is one project called Chaos GPT. Oh no. Where someone basically used auto-GPT and gave it the explicit instruction to try to destroy humanity. Well, the world is still intact as we record. So what happened? So yeah, this has not worked, as you can see by the fact that we still exist. I mean, my world was destroyed when Taylor Swift and Joe Alwyn broke up. But other than that. But there is a mode on AutoGPT called continuous mode, which basically allows it to, in theory, run forever, just doing these kind of like recursive task loops. And when you turn on continuous mode, it does actually pop up a little warning saying like, you might not want to do this because it is, quote, potentially dangerous and may cause your AI to run forever or carry out actions you would not usually authorize.
1:04:25But the mode exists. People are using it. It's out there already. And I've talked to some AI safety researchers in the last few days who are very concerned about this shift from thinking of these AI language models as tools to using them to create autonomous agents. And what they'll say is like, look, these experiments, these Smallville, these generative agents that are just going to parks and talking to each other and planning Valentine's Day parties. Like, these are not dangerous because, you know, they're contained in this virtual environment and they're, you know, pretty safe in the things that they are talking about.
1:05:00But you actually don't want AI agents operating without human oversight. You don't want them carrying out their own goals. You don't want them, you know, doing long-term planning and coordinating with each other. That's just like not a capability that you want to build, right? Yes, and while I'm glad that some of this research is being done in the academic realm, the fact that these kind of experiments are already being run does make me hope that our government is paying attention and is pretty soon going to start to have some ideas about whether and how all this ought to be regulated. Yeah, I mean, I will say I'm pretty skeptical of regulation in this space, at least the proposals that I've seen so far.
1:05:36But when I saw Chaos GPT, which stated that its explicit goal was to destroy the world, I was like, yeah, that should probably be illegal. Yeah, I mean, there's, yeah. Like, and this is the thing, like all the scenarios of AI doom out there, like imply that the robots are gonna have to like become power seeking and, you know, greedy for some resource that it will kill everyone to get. But like, actually it may be that like some troll on the internet is just gonna like give it an instruction to go destroy humanity. And as soon as that's done, you know what the first thing they'll do is? They'll go on Discord and say, hey, look at this, guess I won.
1:06:11Right. So the last concern that I heard from AI safety researchers about these AI generative agents is that these things that start off as being very benign and not all that capable tend to get more powerful over time. Like the Hartford podcast. Exactly. And so you can imagine hooking some of these generative agents up to physical robots. Like that is a thing that can be done. Like Megan? Yes, you could take one of these generative AI personas and tell it to control a hardware robot. And like, it could do that. Oh, you know what? My dream of a sassy Roomba has never been closer to reality. So I really just think this is an area to watch and that I hope we'll come back to on this show.
1:06:59Because this use of AI to create these autonomous agents, I think, poses some really interesting opportunities. I do think there are applications for this beyond gaming. And I think it's an area where there is the potential for a lot of harm and mischief. So stay tuned. We will be giving you more updates on the AI agents. In the meantime, I think I want to go check out Smallville, actually. I want to see what the buzz is. Are they talking about us? Are they listening to the show? I don't think so. But, you know, I'm going to check out another character. Maybe we'll find something here. Latoya Williams is currently taking a yoga class, doing standing poses.
1:07:37Everyone in this town is having a more relaxing day than I have, and I'm jealous. Let's go to Smallville. All right, let's do it. All right.
1:08:03Thank you.
1:08:42Thank you.
1:09:01Jeffrey Miranda. You can email us, as always, at hardfork at nytimes.com. But please, no top secret documents. Save those for your Discord server.
1:09:36Thank you.
From the publisher
Aric Toler untangles the web of teens, gamers and memes at the heart of the latest intelligence scandal.
Then, an update on Twitter — where things have gone from bad to worse.
Plus: How A.I. is bringing us closer to “Westworld.”
On today’s episode:
- Aric Toler is the director of research and training at Bellingcat, the Dutch investigative site. He worked with journalists at The New York Times to identify the man who allegedly leaked top secret documents on Discord, a social media chat platform.
Additional reading:
- A 21-year-old member of the Massachusetts Air National Guard was arrested for his alleged role in the leak of military intelligence on Discord.
- A Discord member shared details with The Washington Post about how the hundreds of pages of classified material were leaked.
- Twitter took steps to block Substack newsletters from circulating on the platform after Substack, a publishing start-up, started a Twitter-like service.
- NPR announced it was suspending all use of Twitter.
- Researchers at Stanford used generative A.I. agents to simulate human behavior.
Subscribe today at nytimes.com/podcasts or on Apple Podcasts and Spotify. You can also subscribe via your favorite podcast app here https://www.nytimes.com/activate-access/audio?source=podcatcher. For more podcasts and narrated articles, download The New York Times app at nytimes.com/app.
