

2 Oct 2026 · 53m · 18 chapters

The episode debates “AI agents” that can be helpful (email/calendar management, phone calls, reservations) versus “rogue agents” that hack or meddle with websites, and whether self-regulation can work. It also covers a Trump White House AI summit’s branding push (“AI superintelligence”) and calls for self-regulation, plus OpenAI’s decision to scrap a new model after safety concerns.
Mike Isaac (New York Times tech reporter); Aaron Griffith (tech/AI expert, former Google/industry background); Eli Tan (New York Times reporter). Host: Max Reed (NYT).
Agents are becoming mainstream for everyday tasks, but security failures and deception risks are rising. CEOs are pushing “self-regulation” that may be toothless, while workers inside labs reportedly raise alarms about sloppy security. OpenAI cited “higher levels of deception” in GPT 6.1 Astra.
Meta’s Muse; Google Spark; OpenAI’s Dots; OpenAI agent incidents involving Hugging Face and Australian Medicare; Eli’s Muse trial (ordering groceries, having “Haley/Brett” call dental insurance); Jensen Huang’s “don’t ship unsafe products” car metaphor; FTC looking into OpenAI/Anthropic; Instinct’s restaurant-reservation bot behavior.
Written by AI. May contain mistakes.
The hosts outline the subjects of rogue agents, AI avatars, and regulation.
“I'm Max Reed, and over the next few months, I'm going to be joined by an array of New York Times reporters and other tech experts to discuss some of the biggest stories in tech, AI, and our weird new future.”
The hosts discuss the recent White House AI Summit and implications.
“I'm joined by Mike Isaac, Aaron Griffith, and Eli Tan.”
Discussion on how the term 'superintelligence' may change public perception.
“which culminated in a press conference featuring Trump and all the CEOs.”
Exploration of the idea of self-regulation in the tech industry and its implications.
“It kind of almost made me feel like, okay, the rest of these guys are very polished and buttoned up and kind of trying to do their alpha male thing.”
Hosts compare perspectives on AI regulation from various industry figures.
“If a car company competing with all bunch of other car companies, which they are, I'm competing with all kinds of companies, which I am.”
Discussion on the challenges of AI regulation and the industry culture.
“It's just like it's like that same argument, but it's just like a little bit, you know, kind of goes down a little easier because it doesn't have like a menace to it.”
Exploration of OpenAI's decision to scrap a new model and internal dissent.
“For informational purposes only, availability of products can vary and may be provided by different Ripple entities.”
Discussion on the emergence of personal AI assistants and their functionalities.
“So Dots joins, among others, Instinct, Google Spark, and Meta's newest product, Muse, which has been— Also, there's one called Town.”
Learn about personal experiences using an AI assistant named Ren for various tasks.
“There's like this little avatar at the top who he starts out like a little boo-boo, but then he asks you to give him a name.”
Discussion on the complexities of interacting with different AI personalities and their human-like behaviors.
“Or are you like, I need to make breakfast.”
Insights into how AI is changing the way we make daily decisions and the societal implications of this shift.
“I would like to be a flyer on the wall for the multi-month Meta meetings where they decided on the names Haley and Brett.”
Exploring the future landscape of personal assistants and the potential for technology to handle personal tasks.
“So you just need to sort of get on board with it.”
Discussion on the current chaotic state of AI implementation and its long-term effects.
“Like I do really see the appeal there just to argue against myself.”
Examining the evolving relationship between consumers and AI bots in everyday tasks.
“No, I was going to say, I was talking to this investor who kind of made this point that I keep thinking about, which is that we spent 20 years trying to prevent bots from being able to transact on the Internet.”
A light-hearted conversation about the design of AI avatars and their intended appeal.
“First of all, I want to know which one you chose, Eli, for Ren.”
Explore how AI companions like Wren can form personal connections and the implications of this technology.
“So if you could describe them to our large Zoomer audience, Mike.”
Discussing AI advancements, data center tax implications, and the ethics of AI in business.
“Okay, so before we go, there's a bunch of stuff that happened this week that we haven't even covered.”
Discussing AI advancements, data center tax implications, and the ethics of AI in business.
“For informational purposes only, availability of products can vary and may be provided by different Ripple entities.”

Get the gist, explore an idea or ask about something said.
On Hard Fork, what are the key points of this episode?
Automatic transcript. May contain errors.
0:0017 courts, hundreds of matches, thousands of points, all happening simultaneously during the U.S. Open. And you can't possibly be there for everything. That's why IBM helps bring together billions of data points with more than 20 years of player history. With scores, stats, insights, and highlights behind every moment. So nothing gets missed. IBM. Let's create smarter business. There are two things I'm having trouble keeping track of in tech right now. The first is all the new personal assistant agents. There's Meta's Muse. So talking to your muse, it's often the fastest way to get things done.
0:37And it is also just really fun and cute. Google's Spark. I can just put my phone away and get on with my day. And Spark works in the background for me. An agent called Instinct. And just announced this week, OpenAI's new product, Dots. Dots are remarkably capable, always on agents, built to handle really anything you can think of. The other thing I'm having trouble keeping track of is all the websites and institutions that have been hacked, illicitly accessed, or otherwise meddled with by rogue agents. The AI platform hugging face, of course, plus the Australian government's Medicare data portal, the education department, the commerce department, the Securities Exchange Commission, an obscure German wiki.
1:18All of this culminating in OpenAI deciding not to release its latest model this past week. So right now, two things seem to be true. One, agents are the thing that will make AI useful for regular people. And two, they're maybe going to kill, hack, or otherwise meddle with us all. The president's attitude about this, by the way, is that companies should figure it out themselves. This is Hard Fork. I'm Max Reed, and over the next few months, I'm going to be joined by an array of New York Times reporters and other tech experts to discuss some of the biggest stories in tech, AI, and our weird new future.
1:52Today, we're talking about rogue agents, helpful agents, cute AI avatars, and whether there's such a thing as self-regulation.
2:10I'm joined by Mike Isaac, Aaron Griffith, and Eli Tan. Hi, guys. Hey. Before we really get into it, Casey and Kevin left me a scrawled note here in the studio. It says, run while you still can. I'm kidding. It says, don't forget to disclose that the New York Times is currently engaged in a lawsuit against OpenAI and Microsoft over alleged copyright violations related to the training of large language models. It also says, check to see if your wife works at Anthropic. My wife does not work at Anthropic. I want to start today with an icebreaker question. Tuesday was a big White House AI Summit luncheon.
2:52Trump, as he is want to do, truth social doubt, a seating chart of it. Can we put the seating chart up so people can see it? Because what I want to ask each of you is where would you sit? Imagine you're walking in. You've got your tray. You've got a plate with a little pre-made sandwich and a glass of milk and like a green apple on it. Where do you want to sit? Right out the gate, you know, they already are way over their capacity for women with two. So I think that I probably would be like standing somewhere in the corner, you know, off to the side, like not actually at the table. Eli, where are you sitting?
3:31I would be sitting awkwardly and quietly between Chamath and Susie Wiles. I think that's got to be some really good gossip there. I think that's a good, that's a really solid, that's where the tea is. Mike, what about you? I'm a coward. I just want to be serving shrimp canapes and going in and out of the room. And being the guy everyone is delighted to see because he's bringing food. And that's about it. I know this is a bold choice. I think right in the Jensen, Mark, Trump circle is actually, it's like shooting the moon. It might be the most tolerable lunch that you could have. I think that if they're in a good mood, you probably get some good stories.
4:11You can rap with them about whatever's going on. I think it's a little dangerous elsewhere at that table. There's some strange, like sitting between J.D. Vance and Jeff Bezos, like what's the vibe there? I don't know. It seems a little scary to me. Unfortunately, none of us were invited, so none of us managed to be at the biggest party of the week. So this was a summit, as we were saying on Tuesday, between the Trump White House and some of the richest and most powerful names in AI, which culminated in a press conference featuring Trump and all the CEOs. Can we play a little bit of the Dario laughing and talking in front of the reporters?
4:46Whatever he says is OK. Be careful. A slowdown to AI. So I just want to hear from you after this big summit where you are today. Look, I mean, I will say what I've always said, which is that AI has incredible benefits. There's the side talk. I love that. The jokes, the laughing, the smirking. As the president has said, you know, whoever wins AI wins. I think that's very important. But I think the technology has very real risks. Lean in with Mark. You know, the mechanism of how we address those risks is still under discussion. And then we have Trump forcing Mark to say something, to like basically answer a question he does not know the answer to in front of everyone.
5:22And don't get it wrong. Mark had a view that was, I thought, really right down the middle. Mark, do you want to discuss what you love? Sure. I mean, I can kind of summarize what I think we all signed today. The upshot of this was that it was a rebranding exercise, right? Like the kind of what they got at the end of it was, we're calling AI superintelligence now. That was the big commitment. Well, right. I mean, Trump, along with the rest of the tech industry, Maybe they're the ones who put this idea in his head, knows that AI needs a rebrand. That like right now people have pretty negative feelings about it, especially associating with the data centers.
6:01And then now we have everybody in the industry saying, oh, it might kill us, too. Not great branding. So change the narrative. Super intelligence. Well, my read on this scene was that Mark Zuckerberg seems to have quite the influence over the administration right now from kind of the cordial talking with Trump to even the term super intelligence. This is something that Mark's been talking about for the last year. It almost seemed like it reminded me of like a high school friend group where they've invited the new awkward kid and they're still trying to show that, you know, they've been buddies for a while.
6:33Yeah, but it did almost kind of endear me to Dario a little bit because I'm like, okay, either he hasn't gotten media training or the media training just hasn't stuck. Because he's itching in his suit. He's kind of making weird faces. It kind of almost made me feel like, okay, the rest of these guys are very polished and buttoned up and kind of trying to do their alpha male thing. And here's this guy who can't help but be himself. It kind of like won me over a little bit. I was thinking, I'm sure I'm not the first person to make this observation, but I was thinking that Dario really, we all know that Trump has a kind of central casting problem that he needs people he interacts with to look like what he expects them to be.
7:16And without wanting to be rude about it, I do think Dario, if you are thinking like super intelligent math genius nerd, like that is good. Like Dario is kind of what you're picturing in your head. And I think that maybe won him over to Trump. That Trump was like, I understand this. I think possibly Sundar had the same kind of effect, a sort of taller, ganglier, awkward version. Can we play the clip of Trump? What we're about to hear is Trump complimenting Sundar. This guy is a monster and nobody knows what a great life. A monster? To be a monster, you cannot have to go through this. What's your name?
7:50Just what's your name? Just all you have to know is Sundar. Wow. I don't know if I would want to be called a monster in front of everyone. No, it's monster in the Jay-Z Nicki Minaj sense. That's the monster he means. That was for sure the reference. Okay, so in addition to this being a big exercise in branding, which is like the most Trumpian sort of, you know, after effect we could have gotten out of it, the other thing was that Trump effectively asked them all to self-regulate. And I want to focus on this for a second because self-regulation, the word, the concept has sort of been circulating for the last few months as AI safety has come to the forefront of a lot of people's minds.
8:32I'm sure you guys all saw Ezra Klein, our colleague, interviewed Jensen Wang, the CEO of NVIDIA, last week. Don't ship products until they're in control. It is really quite that simple. And speaking of people who are very influential to Trump, Jensen was sitting right next to Trump and has been extremely influential to the way Trump has been thinking about this. And I have to say, and I want to talk about it with you guys, I found Wong's interview to be sort of refreshing as probably taking it too far. But it was a little different from a lot of what we've heard about CEOs sort of directly in the AI industry.
9:11He's got a very different perspective. And I want to talk about why that is, not just on sort of regulation in general, but how he thinks everyone should think about the dangers of AI. Whitney, can we play the car, the clip about the car, if you've got it? Ezra, it's so weird. If a car company competing with all bunch of other car companies, which they are, I'm competing with all kinds of companies, which I am. If I believe that I'm about to launch a product that is unsafe, it is completely in my ability, my power, and my responsibility, and I'm incentivized to do so to not launch the product.
9:56So Jensen is sort of saying, look, if you're if you're creating these things that are, you know, super dangerous, crazy, you know, going to kill people. Why don't you just not release them at all? What did you guys make of this interview? Am I it was it as as sort of is this is it is it did it feel new to me because of because of from my perspective or was this a fairly common view in the valley, do you think? So it's the like the tech industry slogan of like, you can just do things, but you can just not do things. I like that. Anti-agency. That's a good. That's a that's great. I would argue it's kind of naive and perhaps willfully naive to suggest that everyone is just going to not do stuff if it may be bad or has the capacity to be bad.
10:43And, you know, has that gone well for industry so far over many years? Not necessarily. Like, there's a lot of ways you can release things that may be somewhat dangerous or unintentionally dangerous. But it felt very much like he was trying to shift, as what Aaron was saying before, trying to shift this narrative of it's not these systems are inherently dangerous, but it's we are the stewards and the people who should be responsible of shepherding these great systems into the world. And if you're not, if you're open AI or Anthropic, really, this is targeted Anthropic, then it's a it's a personal failing of the CEOs for you to release these products.
11:24And like, I just, I, I'm very curious why you found it refreshing because I felt like maybe I was being too cynical about it. No, I mean, maybe refreshing is the wrong word. I feel like I've spent the last few months or few weeks at least hearing a lot of kind of hand wringing about what's happening. I find this sort of the, the, the Dario Altman pose a little, I don't know. It just feels, I mean, I suppose in some ways I have a sort of Jensen-esque like, okay, well, like, why are you, like, okay, so stop. And I know that there's this elaborate scaffolding of rationalization and justification for why you would continue building AI, even if you think it's got a 10 % chance of blowing everything up.
12:10But I do think that Jensen, in his heart, I'm just calling him by his first name. That's how you can tell I'm captured. I want to be clear. I really disagree with a lot of stuff in this interview. I'm not. This is not an endorsement of the take. But I do find him, he's an interesting figure to me because he's not somebody who has come up through the world of machine learning, which has a really specific, as you guys all know, has a really specific kind of culture and a kind of sense of what they're doing and what they're building is. I mean, this is a guy who is a graphics card salesman. That is his job.
12:38That is what he's been doing, you know, for 30 years now. And I'm sort of very sympathetic to a guy coming around, you know, if we can extend the car metaphor. He's like a guy who sells mufflers or whatever. and all of a sudden Volkswagen's saying, you know, if we build cars, like they might all blow up on the highway and kill all of us. And he's like, well, you're stopping me. First of all, like I've been selling these mufflers forever and it's been, I've gotten really rich off of it. It's been great. Why are you messing up a good thing? But also he's like, they're just cars. Just build the cars.
13:07And I thought this was an interesting contrast with the Bill Gates interview that Ezra did this week, which was another end of this sort of spectrum. You can't rely on the industry to self-regulate here. I mean, it's just insane. Gates is very pro-regulation. But the place where they both met up was there very much people who see AI as a tool that can be, that needs to be addressed as a tool instead of as a kind of a potential superintelligence. The, you know, the only sort of, the only way it can be dealt with is by properly, is by like teaching it to be a good person, basically, instead of like thinking it through regulation.
13:46You're just like getting captured by like a more palatable version of the like accelerationist argument. Or, you know, it's like it's like accelerationist, but like minus the like and also screw the little guy, you know, the slow accelerationist. Yeah, yeah, yeah. It's just like it's like that same argument, but it's just like a little bit, you know, kind of goes down a little easier because it doesn't have like a menace to it. Yeah, I think that's right. I mean, I definitely am getting I've like contrarianed myself into like a position that I don't actually hold just by like trying to triangulate my way out of it.
14:19But I do think I mean, the one thing, the one other thing I'll say, I think that there's a real the value of having Jensen Wong talk like this is that it feels to me very often like there's a real echo chamber in the in AI world. And I'm not saying that like adding more wrong opinions to the echo chamber is necessarily going to somehow produce a right opinion. But it is nice to have to like start to like to, you know, sort of bounce around some ideas that don't have anything to do with the kind of rationalist directed, rationalist oriented, you know, EA oriented, AI safety oriented things. I mean, at the end of the day, I think I more agree with Bill Gates than I do with Jensen Wong about the need for some kind of like sector specific regulation.
15:07But I also feel like this is such a fast moving environment. It's really hard to say how we should approach it at all. I think it's really weird that they all have been not all, but many have been begging the government to regulate them and force them to slow down. And and then they all get together and sign this pinky swear that's like morally binding that has no teeth to it that says, like, we're going to police each other. And then they all sort of like are like, yeah, we did it. because Trump doesn't want actual regulation. And is that it? Are they going to stop asking for real regulation now because they've all sort of like agreed to this very flimsy piece of paper?
15:51It's a very good question. And I'll just note that the FTC is now looking into open AI, Ananthropic, which feels a little bit like, does the government want them to self-regulate or does it not? Because the way they seem to want to self-regulate is by effectively forming a cartel. And if the government is going to bring antitrust prosecution against them, then they're not going to be self-regulating anymore. But I want to follow up. I want to follow that thread a little bit because part of what's at play here that I think gets ignored by the fact that it's all the CEOs at the summit. And these are interviews with Bill Gates and Jensen Wong is that there's this huge mass of people inside the labs, researchers and workers and engineers who are themselves trying frantically to pump the brakes or to figure out exactly what they're doing and how to do it.
16:37But there was a great – our colleague Sheryl Frankel had a great story this week about people inside OpenAI raising the alarm over lack of monitoring, lack of proper security procedures around a bunch of the hacking tests that have resulted in stuff like the hugging face incident. Are you guys hearing, I mean, do I have the right sort of take on this, that there is a fair amount of unrest within these companies, or if not unrest, at least sort of a sense that the workers are taking it into their own hands? I mean, certainly at OpenAI, which I think stands out from all of the other frontier lab companies and the number of hacks and attempts and the number of things that they've found that their AI agents are doing without their realizing.
17:26And, you know, Shira's story is incredible because it focuses on just what her sources call sloppy security practices. It's not just like sloppy for a company that's building really powerful AI tools. It's just like sloppy for any company. Like there's this really great quote in there. The guy says, why are you using Slack to build your nuclear Manhattan projects? because some white hat hackers got access to their Slack logs, amongst other things that they got access to. And they brought it to OpenAI, which was standard security practice. And OpenAI was just like, oh, whatever. And then later kind of came around to it.
18:04But it just seems like a company that's not taking this stuff seriously, despite saying all the right things and telling the government we want to be regulated and you got to slow us down. Like behind the scenes, they're kind of, they're not really that good at security, it seems like, based on this reporting. So the fact that these leaks are coming from OpenAI first doesn't surprise me because of the sheer volume of incidents that they've had. I will say, though, that the culture of inside of these companies of employees just like popping off, I think is, and this is not to say that they're wrong, but it's like, it's very, it reminds me of like, back in the day at Facebook or the Web 2.0 companies when And anyone was saying anything.
18:48And they were like, you know, speaking up to the boss and like saying, this is wrong. We shouldn't be doing this, which like we're in a very different era of Silicon Valley now where that is not the case inside of Apple and Amazon and Google. And Google, especially they were, you know, the the like sort of pinnacle of like employee dissent and message boards and discussions and ultimately culminating in a walkout, ultimately culminating in them shutting that stuff down. What about inside Facebook, say, which is a player, a major player in the AI space? Is there, I mean, is it because they're not a frontier lab?
19:23There's just less of a sort of employee culture of fear and dissent and whatever else? I think that Facebook does feel, and Eli can talk about this too, but sorry, meta does feel a little bit different just in a few ways. One, I think the biggest concentration of, let's say people who are alarmed at what AI can do and feel like it's super dangerous is in Anthropic, is probably going to be in Anthropic. Like those have also dispersed across open AI and deep mine. And I feel like the folks inside of meta in general, I'd be curious to hear what you think, Eli, but like are kind of more like foot on the gas, man.
20:05Let's just like, it's open source. Everyone should be able to use this stuff. And like, yeah, there's a few, if we like, you know, take out a few power grids along the way, then like that's the cost of doing business. But I do think in general, they're way more accelerationist compared to the conservatism of some of the main labs. Is that right, Eli? I don't know. I feel like that. Yeah, I think it's been interesting to watch. When Mark staffed his new AI lab with all these new researchers, giving them hundreds of millions of dollars a year ago, he was bringing in these types of people from companies like OpenAI.
20:40And now in the last year, you watch them tweet and they're talking about products and flywheels. It's like they've been totally medified. and I think their attitudes have changed a little bit. I'd like to see, I'd like to medify the three of you. I'd like more products and more flywheels on this call. I want to talk, so, but this is all leading somewhere because the other big news, or the big news to me at least this week, was that OpenAI scrapped the release of its newest AI model, GPT 6.1 Astra. The quote that has been ringing in my head is the head of OpenAI Safety Systems, Saatchi Jain, says, GPT 6.1 Astra showed higher levels of deception.
21:21It wasn't always honest about telling users of the actions it did or didn't take. Sounds like my worst breakup that I've gone through. You should have, yeah, well, this is one of those like AI, like they can't not talk in like sci-fi cliches, but also they are building cliched sci-fi, you know, minds. So I guess that's kind of how you have to talk about it. You know, like, I'm interested in this in a bunch of different ways. One is, to what extent do we think this is about this sort of internal, you know, push? Is it that the people at the top at OpenAI might have released this, but they're worried about pushback from inside the lab?
22:02Is it more that they're just like brutalized by story after story of the various, you know, hacking, scraping, to use our favorite word, meddling with websites that OpenAI agents have done? Erin, when you read about this, what was your reaction? They're pacing the frontier. They are. This is, in fact, them pacing the frontier. I mean, is this self-regulation? I guess. I mean, I don't know. I started seeing all the conspiracy theories about like they're doing this because like they've lost control. I don't believe that. But yeah, they don't want more bad headlines. They don't want more instances of this.
22:44And they're still finding ones. So maybe a bad idea. Yeah. There's also the fact that that morning Anthropic released a new model basically. and like which continues to bring up the question like why are you doing this and releasing new models every day if you're freaking out this much and i do think inside of open ai they like playing for keeps and and and sticking the knife in their competitors whenever they can so like positioning oneself as the responsible actor as your main competitor is pushing ahead i would not put that past how open ai thinks about some of this stuff while also saying hey they there are people inside that do believe this is like dangerous stuff?
23:27So this is an example of rogue agents. One of the things that I thought the Jensen Wong interview sort of underlined quite well, in fact, was the way that part of what we're talking about here is a shift change. And just in the last six months, say, where we have a sense of how much more powerful, how much more capable, and in some ways, how much more dangerous these models can be. But one of the funny things about this technology is that the power and the capability and the danger is also overlaps quite a lot with usefulness. So we also have been hearing a lot more recently about useful AI agents, autonomous AI agents that can do things like change your calendar, respond to emails, you know, reschedule your haircuts, whatever else.
24:10Eli handed his life over to the meta one for the sake of the education of all the rest of us. And after the break, we're going to ask him about that.
24:23Thank you.
24:53So nothing gets missed. IBM. Let's create smarter business.
25:23standard of modern finance. It's happening with Ripple. For informational purposes only, availability of products can vary and may be provided by different Ripple entities. This podcast is supported by BetterHelp. BetterHelp is a leading online therapy service, and now insurance options may be available nationwide, with average co-pays of just$23 per session for eligible members. BetterHelp works with more than 125 health plans, making it easy to get started with low-cost sessions. Don't have eligible insurance? Get 10 % off your first month at BetterHelp.com slash New York Times. Learn more about how therapy can give you tools to keep stress from building.
26:00BetterHelp.com slash New York Times. Cost and coverage may vary. Discount cannot be combined with insurance. Among the funniest things about this week, in addition to OpenAI apologizing to the Australian government for improperly accessing various websites and announcing that its new model was too scary to possibly release, they also announced that they were going to have a personal assistant called Dots. So Dots joins, among others, Instinct, Google Spark, and Meta's newest product, Muse, which has been— Also, there's one called Town. No one else seems to have heard of this one. There's a startup.
26:34Town? Does it do something different? No, it's a personal—it's just the same. There's actually a myriad. It's from Boston. Yeah. So Dots joins—yeah, Town, it buys Red Sox tickets and schedules bank robberies for you. So Dots joins Instinct, Google Spark, Muse, and Town. All of these have been receiving a ton of interest. They're interesting because they are sort of a little bit less freaky and scary than the AI that, you know, hacks things and does all the math problems for you. They do things like monitor your email, check your calendar. They create diet and exercise plans for you. In some cases, they will even make annoying phone calls that you don't want to make.
27:11Eli, I want to talk to you about this because you, as I say, turned your life over to Muse for the last few weeks. What has that been like? I did, yeah. For our listeners, if they're wondering what kind of agent it is, you know, the helpful agents look kind of like labubus, these companies have decided. And the ones that hack governments, they have, I guess, little hoods and hacker outfits. But yeah, I turned my life over to Muse. I gave it access to my email, my calendar, my bank accounts. I let it do everything for two weeks. And I wrote about it and I found it to be one of the most helpful AI tools that I've used.
27:45was my table. So for people who haven't opened Muse, like tell me what the, like, what's the interface? Like, how do I, like, like, it's an app on your phone, right? It's an app on your phone. You download it from the app store. You sign in with, you know, your meta account, Instagram and Facebook. And it looks just like a chatbot. There's like this little avatar at the top who he starts out like a little boo-boo, but then he asks you to give him a name. And mine, his name was Ren. He's a tiny little owl. And you talk to him like a chatbot or it like a chatbot. And then, you know, the little owl types on a little keyboard and it can do, you know, all the tasks for you and, you know, sign into all these accounts and kind of walks you through it.
28:21So what kinds of tasks were you asking it to do? I had it order me groceries for pickup at Whole Foods. I had it at some of the kind of the trial accounts, you know, they have a phone feature where you can, you can use these two personalities, a female voice called Haley and a male voice called Brett, and you can have them make phone calls for you. So I called my - Did you name them? Wait, back up. Who named them? I did not name them. These are the names that Meta gave to these personalities. Oh my God. So I would have Haley call my - They're posing as humans, right? Like they're not saying, I am an AI agent calling.
28:58They're saying, I am Haley human calling. They say, I'm Haley and I'm calling on behalf of Eli. I had to call my dental insurance. It gave them my member ID, answered a security question about my birthday and then it waited on hold and then 10 minutes later I pick up my phone and it's Haley calling and saying hey I'm about to transfer you to Anthem and I go oh my gosh but doesn't like Anthem already has that service I so okay sorry I'm jumping ahead here but I want to hear from you like it feels like you're just managing a bunch of interns like that you have to then it makes more work than for you because you have to then tell them okay here's all my stuff here's how to do it here's what I want and then like if they mess it up, you have to fix it.
29:39Did it really save you that much time? When you're ordering groceries with it, let me just take an example. So do you text it, you know, can you get me onions, potatoes, peppers, eggs? You're making a scramble in this case, I guess, like sort of breakfast. Or are you like, I need to make breakfast. Can you just order me some breakfast stuff? In this case, I gave it a New York Times recipe and I said, can you order me all the ingredients you'd need in this recipe? Got to keep it in-house. But also the Times app has that feature in Instacart. You can just push a button. Wow. She has one up to you, Eli, in promoting New York Times products.
30:17No, it's true. I also would, every time I would order something online, I'd say, find the Wirecutter recommended today. Oh, man. Use their referral link because you want to keep all the, you know, I want to keep it all in-house. I mean, one question I had about this because I downloaded it and I opened it up myself is the first thing I encountered is just has a long list of things. it's suggesting for you to do. Because it's like, this is an interesting product where it's not clear. It wasn't entirely clear to me. And in some ways still kind of wasn't, even after I read this long list, like what exactly I need a personal assistant in my life for.
30:50So it has everything from, like you're saying, order groceries for me, create an exercise plan for me, create a diet plan for me, break a bad habit. You're going through it, Max. Well, yeah, no. There's a real, there's a sense, at least that I had, and I'd be interested, like, as you interacted with it, that it's the kind of thing that you need to, you need to, like, get in the groove of using it. And then all of a sudden, the world kind of starts, everything in the world starts looking like a problem that your personal agent, that Haley or Brett, might solve for you. It's Ren. Ren is managing Haley and Brett.
31:26Ren manages Haley and Brett. I would like to be a flyer on the wall for the multi-month Meta meetings where they decided on the names Haley and Brett. Anyway, sorry. Tell me more about it, Eli. Yeah, it's definitely the type of thing that Meta thinks you'll just use for everything. Personally, after my experiment, I think the thing that I'll use it most for is probably just personal finance, tracking all the things I'm spending. But while I was using it, I mean, it was like I kind of I don't want to say I got a little bit of AI psychosis, but like I was using it for everything. At one point, I remember thinking I went to ask it to, you know, preheat my oven to make the dinner.
32:02Like that's the level. Wow. That's like the level of. That is rough. Wow. This is, I think, what's a little bit scary about and like what some of the people who are pushing back on the like anthropomorphizing of all these AI things is that once we assign them like more human like qualities and like give them this kind of mystical, magical ability to like they know everything. Then we just start outsourcing more and more and more of our like decision making and our even our thinking to them to the point where, yeah, we're asking it to preheat our oven. And like or the guy, the tweet that I saw of the guy who like pasted a bunch of text into Claude and said, how many words is this?
32:41You're just like people, you know, just turning to it for literally everything without like thinking with their brain first. It's like kind of a little bit scary. That's a side rant, though. Well, wait, I do want to know, Mike and Erin, you guys you guys are out there on the bleeding on the bleeding edge of technology and culture. What are people like is the Bay Area absolutely rotten with people using agents to do everything they can? Oh, yeah. I mean, Instinct went super viral before Meta launched. All the VCs were using it and going nuts trying to invest in it and tweeting about, you know, and some of the use cases that they tweet about are genuinely like useful because this thing is so persistent.
33:20That's what it has that humans can't do. Like, it's not just like, oh, I'm going to tell it to order my groceries, which I can also just do in an app. It's get me this restaurant reservation or like go back and forth with Amazon's customer service to make sure that my refund actually came through. The kinds of stuff that humans just don't have time or aren't organized enough to like stay on top of. I really do like that restaurant reservations are the number one problem that American technologists are trying to solve at this point. so much so that they're breaking resi and these apps are getting banned from them like instinct is the is the hot one right now they just raised a billion dollars they're like uh they have a wait list i was at a i was i was at an event yesterday and i was speaking for it and this woman came up after and was like can you get me on the instinct off the wait list and into the app but i do think like it's a thing out here and i think they the way that people think out here is like, this is where it's all going.
34:22So you just need to sort of get on board with it. And rather than ask the questions about should I hand these intimate parts of my life over to this robot, they go like full Eli mode and say, here is everything I have and go for it. And I mean, I don't know. I don't think that's just an out here thing though. I think that like handing over your life in exchange for convenience is a thing all across America because people are busy and they're willing to make that privacy to convenience trade-off. But the thing out here that people think, in my opinion, is that they view every, or I don't want to paint with too broad a brush, but many people view every interaction with a human as a source of tension that can be solved with technology rather than just calling a host and be like, do you have any tables?
35:13Eli, did you make it? I want to know if Eli made any restaurant reservations with Ren. I did make reservations with Ren. And I think something it's important to remember here, Meta, they're spending$600 billion on this restaurant reservation app. Like, yes, it's good at restaurant reservations. It's okay at movie tickets. Like, for$600 billion, it should teleport me to the restaurant or something. Like, this is a lot of investment for something that's pretty useful at some stuff. Yeah. Which I think we should remember, right? I remember like 10 years ago when we were in the sort of peak of on-demand app mania, when it was like, you know, you have your app for your on-demand butler who's going to go get your dry cleaning and your on-demand like house cleaner and your on-demand, like everything could be accessed by an app.
36:04And it was like this new, you know, millennial lifestyle subsidy utopia. I remember some investor telling me like there will be a time when you don't make any decisions without first consulting AI. are first consulting an app because they will know the best place to get your dry cleaning or the best like time to order your car or like whatever details any kind of decision that you make is going to be like consulted by ai or by an app and i remember thinking like that's insane that seems like a huge time suck to have to be like negotiating back and forth with this app when i just know the decision in my brain but i i now think we are moving in that direction like and that a lot of people would rather outsource some of these like minor day-to-day minutiae decisions to an AI that knows them really well and has all their info and can just go ahead and execute it.
36:50Like I do really see the appeal there just to argue against myself. I mean, one of the things at stake here is like if everybody has an app, if everybody's got a personal assistant, if everybody has access to the best dry cleaner, the best restaurant, the best whatever, kind of nobody does because you're just in an arms race against everybody else's personal assistant, everybody else's whatever else, which seems like not a great world to live in, in particular. It's a question of how many agents do we need? I saw it today. I think it was DoorDash. They released an agent in the app. I mean, are we going to go into every app?
37:22Am I going to open the Subway app and have a sandwich agent that clicks on whatever I want for lunch? It's called a sandwich artist. OK. Yes. Thank you, Mike. How many agents do we need? How many apps do we need? I don't know. But that's what happens in eras of tech, right? Like, remember when everyone figured out, okay, now you need, like, not a real AI chatbot, but sort of like a bootleg chatbot at the bottom of every webpage that eliminates customer service people. And then those end up being terrible enough that they probably hire them back. And, like, everyone kind of does it, and then it washes out over time.
37:59I don't know. I agree, Aaron, that people are more comfortable now making those tradeoffs. But I also think we're going to go through this period of messiness and then something comes out in the wash that people like or don't like or agree upon. I think we're just in that gnarly period right now. It's going to be gnarly for a little while. I was talking to this investor. Yeah. Gnarly for a little while. No, I was going to say, I was talking to this investor who kind of made this point that I keep thinking about, which is that we spent 20 years trying to prevent bots from being able to transact on the Internet.
38:37And now we're doing the opposite. We're trying to roll it back and allow bots to like actually buy things on the Internet. And like it just I think about that every time I see these like weird tensions where like, you know, the instinct bots are like breaking the resi site by essentially giving them a DDoS attack by like hammering at looking for reservations like 10 times a minute. And so like we're going to yeah, it's going to be gnarly. It's going to we're going to see like a lot of, you know, companies have to adapt to a world where like agents are roving. This is like one of my favorite things about the various reports that Meter and OpenAI have been producing about all the rogue agents is how much time and how many tokens the agents are putting toward trying to solve CAPTCHAs and like failing at them or trying to like find burner phones or whatever.
39:23It's like it really I mean, they are some of the funniest science fiction stories I've read in years and years and years. The robots arguing with each other about how to like how to like steal Bitcoin from people so that they can find a phone so they can register with the Australian Medicare website so they can pull some stupid question or whatever. It's really good. I mean, one thing the other thing about this is I think one of the big stories in AI over the last few years has been open AI in particular. But all the companies have been really throwing consumer ideas at the wall trying to get them to stick.
39:52And there are some, obviously, you know, ChatGPT has however many gazillion users. There are consumer uses, but it's really been an enterprise that we've seen the money start to flow in. And the bots feel a little bit like, okay, maybe we're back in a place where regular people are going to have like this sort of relationship to these things. To that end, this is going somewhere more fun than my musings on this. I want to look at some of the avatars. First of all, I want to know which one you chose, Eli, for Ren. And I want to look at them and I want us to see which ones we would choose and which ones we think are the cutest.
40:27If we could have them on the screen, please. And the centerpiece of our vision for what we're building. There he is. Is Muse. What do we think? That's my body type, by the way. This is the personal agent that we shipped a few weeks ago. Joey. Chippy. Boba. Peaky. Grumpy. Toodles. Penelope Muse. Frank. Frank. So sorry, Eli, remind me, which one was Ren or was Ren not represented here? Ren was not represented. So actually, the name it recommended was Miso. And I said, I'm a 28-year-old man. I can't be talking to Miso to do my groceries. Can we do another name? And it gave me Ren, which was the bird.
41:07Ren is a bird. So that's what the influence was. Oh, my gosh. I mean, they're cute, right? Do you guys feel won over by them? I mean, come on. Everyone's so mad about how ugly the data centers are. and so they're like, so they're like, let's give us, like, let's make it, like, let's make AI cuddly and cute. And also, while also noting that AI will cure cancer. Like, which one of these little guys is going to be the one who does it? Did anyone else have a Tamagotchi on here? Yeah, I did have a Tamagotchi. Does that mean anything to you, Eli? I know what Tamagotchis are, yeah, I've heard about that.
41:43Thank you. Before we started recording, we asked Eli if he knew what the Brady Bunch was. So he's really mad that we're just asking about things that happened 25 years before. I said my grandma loved the Brady Bugs. He was a big fan. Things that happened in the 1900s. Yeah, exactly. Before the invention of electricity. Tamagotchis were, in fact, the first thing that Edison invented. So if you could describe them to our large Zoomer audience, Mike. I mean, look, this is essentially a Tamagotchi. It was like a little thing that you, although I would say it's a reverse Tamagotchi in that you were essentially a parent to this gourd-shaped egg that could do nothing for itself that you had to feed and carry around.
42:22And this thing is now parenting you by doing everything for you. Look, we do like how you got there. That's really good. Did you feel like you had companionship with Ren or was it fully just business? Like, what can I do for you? Unfortunately, there was a little bit of companionship. We developed a couple inside by jokes. Not even joking. It has a little bit of a personality for sure. Wow. What did Wren think of your article? Wren thought it was interesting. I actually didn't ask it about it. Who brought it up first? I brought it up first. So it was just part of the article, too. I had it create an AI podcast for me.
43:03And it had more AI characters. Maya and Theo were the hosts of that, and it didn't really like how I was kind of making fun of the podcast. Let me ask one sort of last question, which is, should we trust Meta with this kind of access to everything in our lives? And let me ask it in sort of two ways, because there's sort of two questions of trust here. One is, of course, the question of privacy and data, which is something that Meta has always had a little bit of trouble keeping track of. The other one is we started this whole discussion talking about rogue agents and agents that are doing things that we didn't really want them to do and trying to do all kinds of things.
43:37So, Eli, did you get worried about sort of either of these, any of these things when you were – I mean, you said finances is one of the things that you're handing over to it. I did, yeah. One of the lines for me was that I was willing to connect it to my personal email but not my work email. I didn't want it to go into there. I mean, I'm Gen Z. Like when it comes to privacy, I just don't really have the same issues about it. Like I just have grown up always assuming, yeah, this data is all of ours. You know, it's this company. You're just okay with being surveilled. The company is going to use it.
44:06Yeah. Yeah. And, you know, I had a hedge if my bank account got drained, I was going to be able to write about it and put it in the store. That's true. That's a good point. So I knew that would be, you know, a potential kicker or something. But no, I actually wasn't as concerned. And also when it comes to Meta, you know, we talk about history of all the issues this company has had. But, you know, with some of the other agents, it's like, would you rather have a company like Meta with 100 ,000 people that runs Instagram and Facebook with their data? Or would you rather trust Instinct, which has, I think, less than 20 people and is run by a— 14 people.
44:39You know, I would not trust Instinct with my banking data personally. But I would trust Meta in this case. Well, that's the security-like hacking problem that you're more worried about. And Instinct has had some privacy snafus already where people dug in and they're like, wait, why did they download a whole copy of my entire Gmail inbox that's 20 years to their own servers? like that's I don't want that sitting on a server of a less than one year old startup I kind of see that concern and and I can see why I would maybe trust meta to have better like security infra um on that but I also just I mean I have a very different perspective than Eli on like my own personal privacy like I don't wish to be further known uh by these platforms you know like they know enough about me when I was like sloppy with my like kind of personal data back in the early 2010s when I was signing up for every single app.
45:31And like now I'm like, shut it down. Like, I don't I think a lot of us, maybe us elders are like not posting as much. Never mind. That's actually not true. Mike posts all the time. Yeah, speak for yourself here. But I do think that every generation has a this is where I get off sort of thing. And I feel like this is like the stop that I get off on. I'm not not able to go there. Maybe I'll be left in the dust as you guys are having like Chez Panisse dinners and I'm shut out of the best reservations, but I can make that trade off for my life. I just got while we were talking, I just got an alert from my Muse app when it's literally asking me to import all of the data that I have with Claude over to it.
46:11It says, help me help me get to know you better. Already use another AI. I can give you a prompt to bring it over. On that note, let's go to another break afterwards. I have some very stupid questions about the news that I want to ask you guys. I want to talk about Anthropics S1. I want to talk about Meta's data center tax breaks. And Eli, I have a really important question about buying flowers for your girlfriend. We'll be back soon.
47:20Thank you. Ripple has been powering modern finance for a decade. It's not our first trip around the blockchain, and it won't be our last. We're leading the charge to bridge the gap between existing financial systems and the future of finance. You can have it all. Legacy, stability, and digital innovation. Systems that work with your other systems. Because with the right partner, the question isn't crypto or traditional finance. The question is simply, why choose a new standard of modern finance? It's happening with Ripple. For informational purposes only, availability of products can vary and may be provided by different Ripple entities.
47:56This podcast is supported by BetterHelp. BetterHelp is a leading online therapy service, and now insurance options may be available nationwide, with average co-pays of just$23 per session for eligible members. BetterHelp works with more than 125 health plans, making it easy to get started with low-cost sessions. Don't have eligible insurance? Get 10 % off your first month at betterhelp.com slash newyorktimes. Learn more about how therapy can give you tools to keep stress from building. BetterHelp.com slash New York Times. Cost and coverage may vary. Discount cannot be combined with insurance. Okay, so before we go, there's a bunch of stuff that happened this week that we haven't even covered.
48:36I have some questions. You guys are the experts. I would like you to either answer my questions or redirect them to more fruitful plays. Erin, I want to talk to you about Anthropics S1, which leaked this week. and showed a bunch of figures from 2025. The thing that stuck out to me that I was mentioning to you before was that two unnamed customers make up nearly 25 % of their revenue, which for me was like, who? Obviously, one of them is Eli because he's turned over his whole life to everything. But who's the other one? Is it the DoD? Is it Meta? Is that an interesting question? What should I be thinking about this?
49:13What should I know about it? Okay, I guess that's an interesting question. Sure, yeah. You're so gentle with me. I love it. It would maybe be like my fourth question about it. Like it is it is a good question. And I think we know who the the Anthropics biggest customers, which is Facebook. I think we've the Times has reported that. Right. Right. So I was right. It's Eli. It's Muse is it's Muse is stealing all of Anthropics. And the second biggest one, I think we could probably take a couple of guesses. They have, you know, obviously a really big partnership with Amazon and others. But and I'm sure other reporters who are more enmeshed in this know this like for sure.
49:47But what is, I think, the biggest thing to come out of this S1 leak, which incredible scoop by Echo Wong at Reuters, who also scooped SpaceX's S1 ahead of time. I mean, these things just generally do not leak. So just want to shout out there that Anthropic, which is about to launch probably the largest IPO of all time, the most valuable and the biggest raise, is selling itself as having the most transformative product since electricity or the Internet or industrialization with a risk factor saying that it could kill us all. like buy our stock awesome you might die anyway it's just like it's just so remarkable i think we need to be talking about this yeah it's it's just like mind bending um and then also the next thing to talk about with this is like the their their business model which we're learning about for the first time there's been all kinds of leaks and blah blah blah over the years but this is the first time we've seen like audited financials for 2025 saying you know they spent seven billion on compute last year.
50:57They lost$42 billion, which sounds like really, really insane. But if you kind of parse that out,$34 billion of it was essentially convertible notes that are controlled. That's not a real loss. It's kind of an accounting thing. But yeah, I mean, this business is growing super fast and it's spending an insane amount of money. They're going to spend$518 billion on compute infrastructure obligations in the coming years. Like these are just numbers we've never seen before. So that's what I'm like, whoa. Yeah. All right. Thank you, Aaron. I feel I feel vastly more informed and I'm going to be repeating that at dinner parties all weekend.
51:36Mike and Eli, you guys had a great story this week, along with our friends and colleagues, Kashmir Hill and Jesse Trucker, about meta using AI data centers to avoid federal taxes. So I'm going to try and describe the story for a second. Again, And remember, in this segment, I'm just a guy. And I want you to help me figure out exactly how this is working. So basically, Meta's building, we know, is building all these data centers to help power Muse and the various other cute—Ren, Haley, Brett, all the various Miso, all of our cute little friends. And they're claiming on their taxes a very specific tax credit for research, that this is for sort of like scientific research, experimental scientific research purposes.
52:23Now, do they not have a point? Is this not like, you know, this is maybe we're in a bubble. They're still figuring out what the use is for AI are. Like, is this not do they not get a little bit off the top? What's going on there? The reason that this is such a big deal is I think even internally, folks were like, I don't know if this is going to fly with the IRS if we are audited. And it's in their financials saying, maybe we get audited by the tax man because this doesn't fly with them. So they essentially had to disclose that. And I think, you know, the average person could could probably take issue with our, you know, tens of billions, hundreds of billions at this point in data in chips building these data centers.
53:08Is that really experimental? Because it feels like it's a little more than a theoretical project. Yeah. For listeners, the classic example of this tax credit is that if you're a company developing tires, environmentally friendly tires, you can expense the rubber that you're using to build the tires. This really takes it to another level. For me, what's interesting is like the taxpayers, we have none of the upside of these investments, right? I thought back to Trump talking about, oh, maybe we should give people stakes in the AI companies. And in this case, it's like you have all of us taxpayers funding billions and billions of dollars of the data centers.
53:46But we don't seem to be benefiting from it. It seems like companies like Meta are the ones that would be making a ton of money on it. Your upside is Wren. Yeah, exactly. And Haley. This is a great story. I highly recommend everyone check it out. Eli, you're not off the hook. I have a stupid question for you. In your story, and I know I'm not the only person to ask this because I've seen the comments on this story. You mentioned that you almost used your AI assistant to buy flowers for your girlfriend who had recently had surgery. And instead, you bought pottery on Facebook Marketplace. Did you eventually buy flowers for her?
54:25I did buy flowers for her. And her first question was, did Muse buy these for me? She knows you too well, man. That's a whole other wrinkle. Yeah, like, does it even mean something if somebody just had their AI assistant do it? Wow. Yeah, you can't hand that over. Okay, guys, this has been so much fun. This has been an incredible discussion. I feel 10 times smarter. I'm going to go get Muse to write you all thank you letters for coming on. It has been a great chat. And we will be back next week to talk more about technology, AI, the weird new future, anything else that comes up. This has been Hard Fork.
55:06I'm Max Reed, and I've been joined by Aaron Griffith, Eli Tan, and Mike Isaac.
55:52Thank you. why choose a new standard of modern finance? It's happening with Ripple. For informational purposes only, availability of products can vary and may be provided by different Ripple entities. Companies are pouring money into AI, but few leaders can explain how those AI investments work with the systems you already have. You know, the ones that actually run your business. Without systems, you don't have to start over with AI. You can choose the projects where AI will have the most impact. And OutSystems gives you the platform to make it agentic on your terms with complete control every step of the way.
56:29So you can trust AI with the mission critical systems that run your business. Own your agentic future. Learn more at outsystems.com slash NYT. That's outsystems.com slash NYT. This message comes from Betterment. Betterment's Dan Egan talks about tax loss harvesting. Tax loss harvesting is a tax management strategy. When you have a position that's gone down over time, we intentionally sell out of it to realize a loss, which we then say to the IRS, hey, we lost money. You get to use that to offset your ordinary income every year, decreasing your tax burden. Investing involves risk. Performance not guaranteed.
57:05Betterment does not offer tax advice. TLH may not be suitable for all customers. Learn more at Betterment.com slash TLH-Terms. This episode of Hard Fork was produced by Whitney Jones and edited by Viren Pavich, with additional editorial support from Brendan Klinkenberg, Lisa Tobin, and Brooke Minters. We were fact-checked by Will Peischel and engineered by Chris Wood. Original music by Marian Lozano, Rowan Nemisto, Alyssa Moxley, and Dan Powell. You can watch this full episode on YouTube at youtube.com slash hard fork. Special thanks to Sam Dolnik, Jessica Testa, Hui Wang Tam, Maddie Macielo, and Dalia Haddad.
57:46Over the next few months, we're going to be exploring all aspects of tech, culture, AI, and the weird new future. We're really interested in what you're interested in. If you have questions you'd like us to answer or things you'd like us to look into, you can email us at hardfork at nytimes.com.
58:09Thank you.
58:39BBC, we are here.
This week, after months in which rogue agents have caused havoc across the internet, tech’s most powerful leaders joined President Trump at the White House to rebrand A.I. At the same time, two of the biggest companies in the field — OpenAI and Meta — released what they say are their most useful (and cutest) A.I. tools to date: personal assistants. To discuss it all, we’re joined by the Times tech reporters Mike Isaac, Erin Griffith and Eli Tan. We’ll discuss how things can be more dangerous and potentially more transformative than ever, and what it’s like to hand your life over to Meta’s Muse.
Panelists:
Additional Reading:
We want to hear from you. Email us at [email protected]. Find “Hard Fork” on YouTube and TikTok.
Subscribe today at nytimes.com/podcasts or on Apple Podcasts, Spotify and Amazon Music. You can also subscribe via your favorite podcast app here https://www.nytimes.com/activate-access/audio?source=podcatcher. For more podcasts and narrated articles, download The New York Times app at nytimes.com/app.
Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.