The AI Industry Must Stop Doom Trolling w/ Cal Newport

19 Jun 2026 · 1 h 2 min · 24 chapters

Ask about this episode

Ask anything about it. ChatGPT or Claude reads this page and answers with the times it was said.

Connect VO and ask about every podcast you hear, including the moments you saved. Add to ChatGPT · Add to Claude

In short

Cal Newport and Ed Zitron discuss “doom trolling” in AI—how companies (Anthropic, OpenAI, DeepMind) allegedly market AI by repeatedly publishing scary, speculative future scenarios (e.g., recursive self-improvement, job apocalypse) while continuing to sell today’s products.

Guest backgrounds

Cal Newport is a computer science professor and author known for writing about technology and its social effects.

Key claims

Doom trolling is morally wrong under two possibilities: either the companies truly believe their own catastrophic warnings (so they should stop), or they don’t (so they’re exploiting public anxiety for investor returns). The episode argues “worldwide pause” calls are performative because they require global coordination they won’t enforce. The “RSI” narrative is framed as a philosophical, non-technical cult-like idea that distracts from product reality and encourages hype-driven interpretation of minor technical progress.

Notable examples

Anthropic’s “worldwide pause” white paper; Claude Code described as an LLM “harness” for coding; Sam Altman/Altman-style Slack comments about delaying IPO if RSI signs appear; “AI 2027” claims and “Agent 1” rumors.

Written by AI. May contain mistakes. Listen to the episode to check what was said.

Chapters

Tap a time to open that second in VO

Introduction to Doom Trolling

1:36 to 2:03

Discussion on doom trolling in the AI industry with Cal Newport.

“PayPal Open is the platform designed to help you grow into yours.”

Introduction to Doom Trolling

2:26 to 3:09

Discussion on doom trolling in the AI industry with Cal Newport.

“I meant I was having more of them added to make me more powerful.”

Consumer Product Companies and Fear

3:09 to 4:34

Examining the strange behavior of AI companies and their marketing tactics.

“We have consumer product companies who are on a regular basis through interviews and official white paper releases trying to terrify their consumers about the harms that their products are going to cause.”

Ethics of AI Companies

4:34 to 7:20

Analyzing the moral implications of AI companies' strategies.

“They just every two to three weeks want to drop some sort of doom troll document to get people freaked out.”

The Call for a Pause

7:20 to 8:30

Discussing the implications of calls for a pause in AI development.

“You mentioned Dario Amadei's thing about how, oh, we might need a pause in AI or we should have that option.”

Recursive Self-Improvement in AI

8:30 to 10:40

Exploring the concept of recursive self-improvement and its implications.

“I was just thinking of the little replicating thing.”

Cultural Impact of AI Narratives

10:40 to 13:07

Discussing the cultural and philosophical implications of AI narratives.

“2027, we had these sort of post GPT for warnings of, uh, you know, existential crises.”

Skepticism Towards AI Promises

13:07 to 14:00

Cal Newport expresses skepticism towards the beliefs of AI leaders.

“And one of his, you know, lieutenants left to start his own company and his name was Dario Amadei.”

The Nature of Doom Trolling in AI

14:00 to 21:55

Explore the concept of doom trolling and its impact on perceptions of AI.

“No company ever in the history of companies was ever trying to troll their own customers to be afraid of their products.”

The Nature of Doom Trolling in AI

22:00 to 22:11

Explore the concept of doom trolling and its impact on perceptions of AI.

“That's S-Q-U-A-R-E dot com slash go slash better offline.”
Show all 24 chapters

Critique of AI Predictions

28:08 to 29:16

Exploration of exaggerated AI predictions and the need for realistic discussions.

“I think the right reaction is ridicule and embarrassment.”

The Moral Argument in AI Development

29:16 to 30:40

Discussion on the moral implications of AI development and competition.

“about the future in which we'll have transformers that will like help us police our streets.”

Engineers' Responsibility in AI

30:40 to 31:59

Call for engineers to focus on realistic AI applications and reject fear-mongering.

“But my bigger point here is like, yeah, I think we need to activate.”

Critique of Future AI Narratives

31:59 to 33:07

Examination of the trend to focus on future AI capabilities rather than present functionality.

“You're a real company trying to sell real things.”

The Pitfalls of Doom Trolling

33:07 to 34:16

Discussion on the societal impact of doom trolling in the AI space and its implications.

“in comparison to a big, sexy, autonomous robot, it's incredibly boring to say, but also, the business doesn't work.”

Understanding AI's Present Limitations

34:16 to 35:55

Exploration of the current limitations of AI technology and its actual performance.

“Is that, is that, I mean, it's like, do you like it's turning a big dial?”

Psychological Aspects of AI Enthusiasm

35:55 to 37:53

Insights into the psychological factors driving enthusiasm and fear surrounding AI.

“And I think it's, I don't know, psychological self-preservation, or I don't know what it is, but I don't under, this is, again, from a logic point of view, I teach logic to undergraduates, like propositional logic.”

Dealing with Anxiety Through AI Expectations

37:53 to 42:04

Discussion on how expectations of AI can serve as a coping mechanism for anxiety.

“Does that mean like recursive self-improvement is coming?”

Psychology of Doom Trolling

42:04 to 46:07

Explore how doom trolling serves as a coping mechanism for anxiety about technology.

“Like, doesn't that mean that means I think that means it is going to take it over.”

Cynicism and Economic Reality

48:56 to 56:06

Discuss the cynical rationalizations surrounding AI technology and its economic implications.

“I also think that there is, and I do think there is a deeply cynical thing here, well, let me reframe that.”

The Psychological Impact of AI and Media Responsibility

56:06 to 59:50

Explore the psychological harms of AI and the media's role in shaping public perception.

“He'd be like, stop building the viruses then.”

Venture Capital's Influence on AI Development

59:50 to 1:04:40

Discuss the role of venture capital in driving AI narratives and the implications for society.

“What I really think happened is it didn't cross their minds that these people are super strange cultist weirdos.”

Doom Trolling and the Future of AI

1:04:40 to 1:08:54

Examine the concept of doom trolling and propose a more rational approach to discussing AI.

“do not interpret this conversation as oh I'm going to categorize this in a claim that AI doesn't work and therefore if I see something cool that AI does because this conversation isn't relevant.”

Doom Trolling and the Future of AI

1:11:42 to 1:12:13

Examine the concept of doom trolling and propose a more rational approach to discussing AI.

“We upgraded our phones, our cars, even our coffee.”
Hear the part that matters, and keep it.Open this episode in VO. Double tap your headphones to save a moment as you listen.
Get VO free

Transcript

Automatic transcript. May contain errors.

0:00This is an iHeart Podcast. Guaranteed human. Hey everyone, it's Cal Penn. I'm inviting you to join the best sounding book club you've ever heard with my podcast, Earsay, the Audible and iHeart Audiobook Club. Every episode, I nerd out with amazing guests and dive into the best new audiobooks available on Audible. It's the book club for your ears. Listen to Earsay, the Audible and iHeart Audiobook Club on the iHeartRadio app or wherever you get your podcasts.

0:53at collagen peptides so you can stay vital, stay you. Visit vitalproteins.com to learn more and where to buy. These statements have not been evaluated by the Food and Drug Administration. This product is not intended to diagnose, treat, cure, or prevent any disease. You're locked into a lot of things you can't change. Weather, traffic. Hey, stay in your lane. Your wireless carrier's latest price hike. But you can unlock a better way. Unlock the savings at Boost Mobile and save up to$600 a year. Switch to the$25 a month unlimited wireless plan. No contracts, no price hikes, and you keep your phone.

1:22Stop being locked into their games. Unlock the savings at boostmobile.com slash unlock. Based on average annual single line of payment of AT &T, Verizon, and T-Mobile customers, compared to 12 months on the Boost Mobile Unlimited Wireless Plan as of January 2026. For full offer details, visit boostmobile.com. Every business has an ambition. PayPal Open is the platform designed to help you grow into yours. With access to business loans so you can expand, and hundreds of millions of PayPal customers worldwide. Your customers can pay all the ways they want today. with PayPal, Venmo, Pay Later, and all major cards, so you can focus on the future.

1:55When you need a partner trusted by millions, there's one platform for all business. PayPal Open. Grow today at paypalopen.com. Loan subject to approval in available locations. CallZone Media. Hello and welcome to Better Offline. I'm, of course, your host, Ed Zitron.

2:26That's right, I'm back, all of you, and to be clear, when I said I was having wisdom teeth surgery, I meant I was having more of them added to make me more powerful. The operation was a success, I apologize also for doing this week in reverse with the longer episode on the Friday and the monologue on the, well, I guess Tuesday, I guess. I had to put out OpenAI's financials at the last minute, and well, here we are. Subscribe to the newsletter, ideally the premium to support your local Zitron. And as ever, if you have anyone else's financials, you can catch me on ezitron.76 on Signal. It's going to be in the episode notes.

2:56Anyway, today, now that I'm done drinking milkshakes, I'm joined by the wonderful computer science professor and writer Cal Newport to talk about AI, but specifically to talk about what he calls doom trolling in one of the best pieces I have read on AI ever. Cal? Well, first of all, I'm disappointed. I've sent you my financials multiple times in your signal chat and and yet you have not written 10 000 words about them yet so i don't know what you're doing here you haven't lost 11 billion dollars or anything you you need to get those numbers down no i i write about bad companies i wrote it off though and it's okay yeah you moved it to an spv that's right i may have spent 11 billion dollars but really i was profitable it's just a matter exactly you look at it but let's talk doom trolling because you have this fantastic piece that talks about the fact that all these companies uh anthropic open ai even deep mind to an extent uh just keep selling things based on the destruction that ai will allegedly cause though they appear to be talking about another kind of technology entirely when you think about it yeah i mean look i think we we have forgotten or overlooking how strange this is right because what we have here let's just let's abstract away from the particular products here and just say, what do we have here more abstractly as a business story?

4:14We have consumer product companies who are on a regular basis through interviews and official white paper releases trying to terrify their consumers about the harms that their products are going to cause. And if this was any other industry, this would be completely mind-boggling. The example I had in the New York Times op-ed is like, if the CEO of Ford put out a white paper and was like, we're really worried that our f-150s are going to start catching on fire and burning people to death uh but you know automotive technology we can't impede it uh and we're just going to get back to making them we're like what are they going to go 2 000 miles an hour at some point in the future yeah we would just ban yeah we'd ban it yeah let's consumer no one would buy yeah just it's really it is something that's genuine i love the term doom trolling as well because it really frames it well because it's it's all part of a larger complex of them never talking about what they're building today it's always this theoretical scary thingy that might it's always two years or two minutes away depending on who you're talking to yeah so what what i did was i said let's actually think this through because i'm also a digital ethicist i was like let's actually think this through with our ethics hat on right like let's think through what particularly anthropic i think is the most systematic in this propaganda campaign that uh i you know i analogized it to a a cat leaving a dead bird on your doorstep and walking away.

5:36They just every two to three weeks want to drop some sort of doom troll document to get people freaked out. And then they just back away and go back to what they're doing. And I kind of got fed up with this. So I said, let's do a moral analysis about this strategy. And I said, look, there's only two options here. Option number one, they really do think that technology they're building has put them on a trajectory to, and the best case destroying the economy or in the worst case, wiping out humanity, in which case every ethical system of any merit would say you have no other choice but to stop immediately what you're doing and use all of your time, energy, and treasure to try to stop other people from doing the same.

6:13The second case is you don't fully believe it, which means you are laundering the anxiety of hundreds of millions of people to try to make the bank balances of a vanishingly small number of original stockholders larger, which I think is equally as morally monstrous. There is no moral analysis that says trying to frequently terrify people about the things you're building while making no adjustments to the things you're building. There's no moral calculus that says that makes sense. But because AI is new and people don't understand the technology and it's shiny, and we saw James Cameron's movies, we somehow treat this different.

6:47And I say, it's not different. This is a product that they are selling. They are not the stewards of an inevitable technology. They are building products according to business plans and trying to sell them. They need to act like consumer product companies. We need to demand that they act like consumer product companies. Well, another thing that you have in the piece is that it's unclear, like that dichotomy is, it isn't clear why they're even doing this other than to make money. And also they're not acting as if any of this is true. They're not doing anything that suggests that they're actually concerned.

7:23You mentioned Dario Amadei's thing about how, oh, we might need a pause in AI or we should have that option. But that isn't actually what he was suggesting. He was suggesting something entirely different. Well, what they said was, and they got headlines. I had to look this up for the fact checker. They got every major publication to say Anthropic calls for worldwide pause in AI development. You read that section of their white paper, which by the way, reads like sci-fi that a ninth grader wrote, right? It's not, it's pseudoscientific at best. It's not even really scientific. It's it's I find their white papers sort of laughable, but they said in it, we should do a worldwide pause because the thing we're building is so dangerous dot dot dot.

8:01But we can't do that unless everybody in the world does the same thing, including China, essentially. And if that's not the case, we have to just keep going full speed. So what they said was we should do a worldwide pause. But of course, we're not going to. It's really what they were saying there. But the point is, all right, so the report we're talking about here came out a few weeks ago. So if you haven't read it, this is basically the report where they just out of nowhere wrote a white paper with a bunch of charts. They always have charts where they were saying pretty pictures and pictures and an animation.

8:30I was just thinking of the little replicating thing. We'll get to self-learning AI in a second. But the report basically said, huh, Claude Code, which is a harness on top of an LLM for helping to run computer programming. Just to be clear, a harness is basically a series of scripts that runs on top of the LLM. It's a computer program that prompts an LLM and then parses the response the LLM gives and then actually takes actions on your computer based on what it reads. Right. Yeah. And that's a whole other conversation about the coding world and how much is the harness and how much is the LLM. But they basically said this tool, which is a harness, it's an LLM and some other things.

9:07This tool that computer software developers are using is getting really good. and you know that could be we think that it might be looks like it's getting closer to be able to improve itself and if it does recursive self-improvement which by the way is that just it's at the core of philosophical super intelligence right this sort of silicon valley cult-like thinking about computers replacing us if it does hey maybe that'll be good for humanity it'll cure all diseases but also we could lose control of it thank you have a nice day and they walked away They just put out that report. That's the report.

9:39And the thing that I like about it as well is I think that we're in the next big thing is going to be RSI. Because so just to be clear for the listeners, recursive self-improvement is just AI that builds itself. It is a theoretical concept. It has not happened yet. But mysteriously, within the same six, seven day period, this came out and Sam Altman said to his staff in a Slack message he knew would leak. oh yeah we might delay our ipo if we have signs of rsi if we have signs of ai that can build itself meta a year ago said in personal super intelligence we're seeing the early signs and they're doing this because in my opinion maybe disagree cal they've run out of ideas to the point that they're literally going back to what sam altman said in 2019 yeah we'll just ask the ai what to do yeah ask the ai out build it these guys have so few ideas they're just like christ can't we just make the AI do it?

10:35RSI is a get out of jail free card from a technical expertise standpoint. So, you know, we, we, we saw a lot of this a year or two ago when we had like project 2027, we had these sort of post GPT for warnings of, uh, you know, existential crises. It's a get out of jail free card because if you ask like the authors of 2027, well, explain to me what a system that is smarter than humans and can fire the missiles and over, what does it look like how you architect it like what what what allows it to do it and their answer is we don't have to figure that out the ai will right now this is perfect not the history problem we could history lesson this this although this goes all the way back to the 1960s so there's a there's a statistician applied mathematician named ij good and he wrote a paper it's really like an information theory paper but he wrote a paper where he said um we uh if we think about called it ultra intelligence.

11:32Really, all you have to do is build a machine smart enough to improve itself. And then that machine will improve itself, that machine will improve itself, and then we'll get to ultra intelligence. So we don't have to figure out how to do it. The danger lies in just making the machine fast enough. So it was like a bit of a semi-thought experiment. That became the ur-document of what I call like the philosophical superintelligence cultist. So this sort of where the philosophers took this idea away from the technologist and began turning it into a sort of digital era scholasticism where they sort of abstracted away all technical details and just started building lists of lists of lists of lists of all the different things that could happen.

12:11They just did a bunch of thought experiments about superintelligence and recursive self-improvement. They then merged with the utopian singularity people that were coming out of sort of Kurzweil's orbit. And you kind of created this group that was non-technical. This is not engineers. This is philosophers, ethicists, and sort of gadflies and speculative fiction writers and fan fiction writers like Joukowsky. And they kind of created this sort of doomerous utopian cult. And then what happened is that group was like, we should create a nonprofit to look at these ideas. And we'll take Sam Altman and put him in charge.

12:46We'll call this open AI. And then suddenly they were like, oh my God, this Gen AI thing is working better than we thought. And we have now someone coming out of this general kind of cultish, let's eschatological, you know, in times you could come through computers was suddenly and accidentally in charge of the most important company in AI. And one of his, you know, lieutenants left to start his own company and his name was Dario Amadei. So these, the two major players we have in AI right now come out of philosophical super intelligence, which uses this idea of RSI. And it's like a, it's like a parable.

13:24It's like an abstraction. This is not like a serious, it wasn't like a technical concern. It was like a thought experiment. And they are completely influencing the daily lives and psychological well-being of hundreds of millions and like the economic health of the entire world. So it's really an interesting world we've ended up in now. And all of which is to say, I don't think we're talking enough about how weird these people are. I think we keep steering the conversation back to the technology itself. We keep steering the conversation back to like, well, could it take over or not? And we need to spend some more time saying, wait, who are these people and what are they doing?

14:00They're doom trolling. This makes no sense. No company ever in the history of companies was ever trying to troll their own customers to be afraid of their products. They're treating their technology like a religious object. Like we are underestimating the weirdness of these people. And when we put that into focus, it completely changes, I think, our own psychological relationship with what's going on right now. Yeah, and I fully agree that it is almost, I think it's a distraction as well from the actual reality of what these things are. And I think it's a deliberate one. I naturally fall on the side of just thinking these people are deeply cynical.

14:39I've met people who think that Dario Amadei believes this stuff. I actually don't. I don't think they believe a fucking thing. I think that however you feel is however you feel, but I think that they correctly realized that they could very easily make people talk about something that doesn't exist just by mentioning it. I saw a bunch of headlines that were like, wow, Anthropic sees the path to self-building AI. No, they don't. Other than the fact they had a single sentence saying, I see the path to this. They don't have any proof. They don't have anything. And yeah, you're right. These people are weird.

15:12I have seen people on XDEverything app, Twitter, actually posting that we are in AI 2027, that everything matches up with AI 2027. I want to be clear, and the reason I mentioned this, I just brought this up, is that in early 2026 in AI 2027, they say that Agent 1 has already started doing its own research. That's not happening. None of that's happening. In fact, none of this is happening. These people are just weird fantasists. I think while there's the poison of the philosophers in them, I just think that Wario Amadei and Sam Altman both, I think that they both realize that journalists are easily con, that investors are easily con, that you can just say shit and anyone will print it and believe you because you're a CEO.

16:02I don't know how to answer that question because the more I look into how quasi-religious and cultish this sort of philosophical superintelligence community is, the more I get confused about what these people actually believe. So I go spend time in Silicon Valley. Go spend time with - Oh, I mean, to be clear, when I say they, I'm referring specifically to Amadei and Allman. I could fully believe that there are tons of people in the Valley that 100 % believe this, that they believe that this is the path to that. I think just to be abundantly clear, I don't think everyone is cynical. I think they've been easily conned, but I don't think that they're cynical.

16:43No, I could believe that as, and I could believe that as their companies got larger and their leadership roles got larger, that they have stepped away like, oh, this was a little naive. That's possible. But also I saw a news report today that Dario, I don't know if this is true. So I'm just, there's a headline I haven't read yet. that he has like one direct report yes so i don't think you know he's he's necessarily in the war room with a thousand engineers and like doing a lot of business strategy here too so it's possible that these guys are more isolated than than we think i don't know but if he has one direct report he's not doing anything he's just what he's going to meetings sorry what were you saying yeah but but but coming back to it like what what are the whether they how much they believe or not and i hope they don't because again i think it would be morally monstrous if you really believe this, that you're like, yeah, but I want to win an IPO.

17:35Like I want to make more money. Exactly. Yeah. Yeah. I think that would be morally monstrous. Right. But like, if you think about what the benefits would, would be, they've, this has led to a sort of discourse environment, um, essentially where you have a normal technology that's, that's advancing along a jagged frontier, which is what happens with like new technologies. There's like certain applications where they feel like they're making progress and a lot of other applications where they're stuck. And so like they've been making progress with these coding systems. That's kind of a scenario in which there's a lot of room for play with these type of systems.

18:10A lot of other things like non-coding agents, et cetera, is not going so well. In math, they're making progress, but that's such a narrow field that it's not economically relevant to them. So you could see this as just like a normal technology. And in chat, chat search, which is basically running Google search results through a language model, the natural language search basically. So there are places they're making progress, other places they're stuck. That's like an interesting normal technology story. But if you layer on this other sort of eschological story about we are on our way to utopia or dystopia and we keep trying to keep you upset about that, think about the way now when you're online how people think and talk about AI.

18:49It's all about if there's some new feature that works, if there's some new chart that goes better, that's evidence for the prophecy is true. Yes. And so then that puts so much more power. Like if you otherwise just came to me and said like, hey, we have this like advance in our coding harnesses, I'd be like, I don't care. I'm not a software developer. But if you say, oh, that means that the prophecy of the RSI gods is true now, suddenly that is really eventful and I'm really excited or scared, but I'm giving a lot of import to your company. So I do think it generates way more sense of import on these otherwise, like I think very, often very minor and jagged improvements.

19:33I mean, I think with other companies, if you kept putting out graphs that you created on measures you created, I was like, I don't know what that means. Tell me when like my business is going to be doing better, right? So there is a huge advantage, regardless of intention. There is a huge advantage to have the doom troll because as long as people are terrified or extremely excited about this future, and then there's a secondary advantage. This is cynical, but I just want to throw it out here, Ed, because I'm sensing this more. I think there's a whole other substrata of sort of like tech adjacent people who are online or not, who got caught up a little bit in that type of hype type vision.

20:10And now their pride is engaged. And so now they will interpret, I encounter this all the time, not even skepticism, just literally saying, oh, I don't think that tool, people are struggling to use that tool well, or this is not a very profitable model here. They'll have to find another model. They interpret it as like, well, this is embarrassing because I was just telling my siblings and everyone at dinner last night about – because I use Claude Code and I think it's HAL 9000 and I was just so excited about it. It's cognitive dissonance and I'm embarrassed and so now I'm a warrior for the prophecy.

20:44So I think you also have that substrate who are like, yeah, but what about – and then some metric that went up or something like that. And that's way in their benefit as well. You have a soldier as a marketer that are trying to basically protect their pride.

21:04Support for today's episode comes from Square, the business platform that helps sellers become neighborhood favorites. Whether you're gearing up for a busy season or just trying to keep up with everyday demand, Square keeps your business running smoothly, from payments and POS to online orders, inventory, staff, and more, all in one place so you can focus on your customers, not your to-do list. I like Square a lot as a customer, and from talking to various business owners who use it, everybody seems really happy with how easy and intuitive everything is. Business owners don't have to juggle a bunch of tools, and their hardware and software are designed to be easy to use, so day-to-day options feel a lot simpler.

21:37With three clear plans depending on the tools you need, sellers who use Square see 9 % higher sales on average. Square helps you run your business more smoothly, bringing payments, operations, and insights together in one place, so you're ready for whatever's next. Right now, listeners can get up to$200 off Square hardware when you sign up at square.com slash go slash better offline. That's S-Q-U-A-R-E dot com slash go slash better offline. Get started with Square and build a setup that works the way you do. And now another appliance triumph from our friends at Grand Appliance. With two dogs, every wash load came out covered in fur.

22:19I went into Grand Appliance looking for a fix, And they recommended the Maytag Top Load with PetPro Hair Removal System. They had it in stock and installed it days later. And you know what? It really works. Lint rollers are a thing of my past now. Great recommendations from the appliance experts. Shop GrandAppliance.com. GrandAppliance.com. Who doesn't love warm, carby comfort? Satisfying sandwiches, loaded bagels, rich mac and cheese. Crape-worthy and smart. Hero Bread's Loaves Bagels and Noodles have just 0-5 gram snack carbs, zero gram sugar and up to 19 grams of protein and 32 grams of fiber per serving hero bread bakes with heart healthy olive oil and delivers a soft fluffy flavorful experience you love shop now on hero.co use code iheart for 10 off that's hero.co per serving not a low calorie food some products contain allulose see nutrition info on hero.co for sodium and sugar content every business has an ambition paypal open is the platform designed to help you grow into yours with access to business loans so you can expand and hundreds of millions of PayPal customers worldwide.

23:22Your customers can pay all the ways they want today with PayPal, Venmo, Pay Later, and all major cards so you can focus on the future. When you need a partner trusted by millions, there's one platform for all business. PayPal Open. Grow today at paypalopen.com. Loan subject to approval in available locations.

23:45Yeah, you've absolutely nailed it. it's the pride thing again hadn't thought of that but you're right the way that they react when you give i mean i just published open ai's financials and the pretzels they're contorting themselves into the ways in which it's silicon valley has always been this proudly atheistic meritocratic rugged pragmatism world or at least this is how they sold themselves it's not about your feelings it's about can you ship co is your software good does it make money but something about this is really entered into the realm of religiosity not even faith because faith is like faith is a much stronger and more fundamentally sound thing this is religious cultism but the god is capital like you can say it's ai but the god is capitalism it is this idea that the the big money people who are constantly threatening you.

24:43Like, they just they're like, yeah, it's gonna kill you, it's gonna take everything. I guess it's Pascal's wager as well, it's well, I don't know if this is the case, but if they're all saying it, and if I'm wrong, Rocco's Basilisk will drop an anvil on me, I guess. It's frustrating, but also, I don't know what these people will do if the bubble, when the bubble bursts, I don't know why I'm saying if, when it bursts, I don't know what these people will do, because their worldview is built around existing outside of reality almost like that just this chatbot will become god will become autonomous and because i was there saying it would become autonomous i will be given something it's unclear what the reward is other than simpering and there's something in it for them that's the that's the thing it's like i guess maybe it's community they're finding it's replace ai with god just like with church and they would mock whoever was talking about it they would mock anyone who took a sign of well this is proof that god exists but they would look at a meter study and they go well that's proof that agi is coming yeah and it's so strange yeah it's like hey look at how complicated the structure of the leaf is it's paley intelligent design like god exists because of the algorithm design like they would mock that right and now they're in two seconds yeah but like hey we we can draw a unicorn and ticks using like a gpt4 prompt yeah the the ai god is coming but it's it's so strange as well i've been writing about silicon valley bubble recently this idea that basically the valley itself is is a bubble inflating that will burst going back 10 15 years because they ran out of new ideas that they've not had anything good not had a new smartphone or a new app store or a new cloud computing in a while and i think that that's what's fed into this as well because you've got that kind of desperation that we've run out of big ideas and then added this layer of fear-mongering plus childish philosophy yeah very like very much like this shit must have hit so this would hit so hard if i was 12 yeah like i was 12 i'd be like holy shit yeah oh i'm using this computer today and tomorrow it will be ultra intelligent i'm so smart for finding this first.

26:58It's deeply sad. I didn't think I could be more embarrassed by Silicon Valley, but the fact that these people are being this weird is, we need to call them weird. It's actually kind of unsettling as well. It's unsettling also that you are one of the few people just saying it, that everyone else is acting like this is normal or rational or in any way logical. Well, I'm trying to activate a bigger crowd here, right? And here's what I think we need. I think your use of the word embarrassing is key because the trend I'm seeing, which I don't like, is this idea of the people who instinctually do not like what's going on with these AI companies are trying to match the intensity and hype of what they're saying, but going the other direction, right?

27:45And so they're like, they're destroying everything, right? Like the environment will all be destroyed by the data centers and all education is going to end. And the idea being is like, I need to be as like as intense about all of the terribleness that your technology will cause as you are about like the good it will cause. Where I don't think that's playing into their hands. I think the right reaction is ridicule and embarrassment. this is where things make fun of them if you read anthropic white paper you read these things it's we're now going to go through we envision four possible futures for where this technology could come and then they just make up like four or twelve year old sci-fi maybe the technology will take over but it will be in more of a sort of a Churchillian mold and will wear top hats and that we could imagine a council of of humans but it would probably be like one third humans and two third robots and you know like just like work it's just It's just nonsense, right?

28:44It's goofy. It's not philosophy. It's not technology. It's not political science. It's just goofy, right? And I said this in the op-ed. I said the zeitgeist on this could change really quickly, right? Where it's like, all right, Dario, is the AGI in the room with you right now? Can you see the AGI in the room with you right now? Because that's the reaction I think we need. Plus, forget that. Justify why I'm spending$1 ,000 a month on tokens. Like, I don't want to hear your report about, you know, hey, Ford, I don't need your report about the future in which we'll have transformers that will like help us police our streets.

Read the full transcript

29:24I am spending this much money on gas for my F-150. Like, tell me like why that's worth it, right? Like, just continually bring it back to you have really three products you're selling right now. Great. Sell a product. It's interesting technology. You're making a good product out of it. sell me what are the benefits why is it worth the money and i will take for granted you better say it's not going to harm anyone because otherwise fix it so it doesn't like that should just be yeah that's your job to fix that's your job to fix and you don't and just to throw in another moral argument i put in the new york times op-ed it is not actually a moral argument to say there's this thing we want to do that's going to cause potentially a lot of harm and destruction but that guy's going to do it.

30:04And as long as he's doing it, I get to do it too. That is what my eight-year-old says, right? He's like, I know, but like he stole the cookies. Why can't I steal it too? So I do not understand this argument. It was in the latest Anthropic paper. We're building this technology. It might come alive and we might lose control of it. But how can we stop? Because China is also building the technology. And what if they build it and it comes alive and comes control? Why don't we get to do it too? What's the moral argument there? This is not like a nuclear deterrence argument that if you somehow destroy humanity first, what's the advantage there, right?

30:38What game have you won? So I don't understand that. But my bigger point here is like, yeah, I think we need to activate. I'm working on a big article now for a trade magazine for engineers, actually, where I'm making this case. It's a cry to cure. You need to stand up and say, that's nonsense. Let's talk about your real technology. I know about this because I think there's a lot of people like me who are on the wrong coast. We're not on the West coast. We don't, we haven't gone to those cold meetings who were like, there's interesting technology here. And I want to hear about the products. And this is actually where you and I maybe even differ a little bit.

31:09I end that piece by saying I'm pissed off because this should have been for a nerd like me, an exciting time. This is a cool technology. It's hard to make products out of it, but we should have been like, it kind of excited about, Oh, I never thought about doing that with this. isn't that cool? What's going on? Instead, everyone is terrified. Like you ruin this moment because of God knows why. We don't even have to get into it. So I think the right response from like actual engineers who are not part of that cult and you know, you got to swallow your pride. I get it. You were really excited to your cousin after you use cloud code.

31:40Like that's okay. Swallow your pride a little bit and say, this is doom trolling and it's embarrassing. Can we talk about the real technology like a normal product? There's cool things you can build. Some stuff isn't working. I want to know if my stock market portfolio is going to crash. Like let's just be normal. Stop the weird stuff. Just stop it. You're a real company trying to sell real things. Let's talk about products. I want to spark a revolution to bring things back to normal. I fully agree. And I even said I was on Chris Hayes' show a couple of weeks ago. And I said, I think we should legally ban boosters from using the future tense.

32:19I don't think they should be allowed to say if either. I don't think they should be able to say will. I think they should only be allowed to talk about what's coming out today. you can go two weeks in the future max yeah i think that because when you read any story about ai that's positive it always speaks in the future tense it does not speak about what's happening now and when they do speak about what's happening now it's the vaguest stuff in the world it's like it can write or it can autonomously write software is the software good no is it stable no can you rely can you even actually do anything with it if you don't know what you're doing no is the code overly verbose yes like it's like there are tons of problems with it but one sentence allows the generalities to grow.

33:00And also, I think there's a very obvious reason they don't talk about the present, because it's kind of boring. It is. Like, it's just, in comparison to a big, sexy, autonomous robot, it's incredibly boring to say, but also, the business doesn't work. The business doesn't function. If they have to talk about why it costs$1 ,000 of API tokens to do something, they have to talk about their business, and they have to talk about what it does today. And the problem is with that is, so my position on this is, I don't mind on-device models. I actually think that's all that's going to remain of LLMs. I think maybe we'll get some rag search stuff here and there, but I don't have an animus with the non-data center ones.

33:44But I do agree that there needs to be, like people do need to stop fighting fire with fire as far as being like, if they're going to doom her, we're going to say that all data centers are the worst which they are the water story is murky but the environmental story is very real especially with the behind the meter gas turbines but and the economic story which you've been good on too is like there's so much more money coming into building these centers and their centers being built and that's going to be its own issue but also just just fundamentally these weirdos are trying to make you scared of cloud software like that's that's my thing that i keep it's like if satan adela every two weeks is like you'll never fucking believe what microsoft word's gonna do next mate you're never gonna believe what power bi is gonna do with the dashboard i saw a dashboard on power bi and i'm pretty sure next week it's gonna it's gonna try and kill someone you'd be like you sound like a lunatic man you sound like a crazy person this is an insane uh sundar peshai yeah google search is good oh oh any any week now you just laugh at him and the two Microsoft guys are Mustafa Suleiman he's trying to use the Dario Sam playbook but he's not good at it he's like I think AI is going to it's not only going to take over all jobs it's going to create new jobs just to automate them and it's going to do it Thursday.

35:16It'll do it Thursday. How about that? Is that guys? Is that, is that, I mean, it's like, do you like it's turning a big dial? It says AI on it. It's just like, do you like this? I love it as well. Because he'll, he'll even talk and be like, yeah, 12 to 18 months away. We're going to have super intelligence, but also Anthropics too expensive. We can't pay the money more. Yeah. But also this is normal and it's not going to take jobs, but it's going to take all the jobs in two years, but not today, but not next week, but maybe in six months and it's just that yeah they're using the dario playbook with everything because they're just making the same things and they don't work particularly well it's just so these people are so weird the more now you've said it now it's all i can think about so here's the here's the logic i also want people to avoid because i came up into what you were saying there is and i feel like maybe chris did this a little bit in your interview i have to go back and listen to it but this this logic and i and i get it and i'll give an explanation for it from from a psychological perspective in a second, but there's this logic of, if there's something I can point to where AI did something that I thought was impressive or interesting or better than I thought, every prophecy is true.

36:25And I think it's, I don't know, psychological self-preservation, or I don't know what it is, but I don't under, this is, again, from a logic point of view, I teach logic to undergraduates, like propositional logic. I don't understand, And this is a, it's an argument that's missing premises, right? So they're going from the premise of, hey, and it's almost always the same thing. It's almost always a non-engineer using cloud code because it's really fun. It's like a slot machine. It, especially, you know, it just like creates code that works for simple things. And you're like, this, it's really fun.

37:04Like I've talked, I know people who are like, they're just like, this is my new hobby. Like it's all, it's really fun. if you're into that type of thing, right? We talked about this earlier. It's like model trains for engineers. You do that. You're like, that was really cool. And then you translate that experience of like, I really enjoyed that to, um, you know, I wonder what salt mine, the AI overlords are going to assign me to. And it's a weird, that, that leap of logic. Uh, how can we just keep it as like, okay, this was really cool that you built this dashboard. Like we don't have to leap from that to therefore everything Dario Amadei said must be true it's not this binary uh balancing on a fulcrum where we're just looking for like one one little piece of evidence will tip it one way or the other so i i think we need to be careful about these elaborations it's a jagged technology some things make more progress than others some things are cool some things are more narrow than uh you would think but like you know the ceo i i built a really cool web-based game in in fable 5 which actually is probably just copying the source code of a similar game.

38:06Yeah. Does that mean like recursive self-improvement is coming? So what I'm hoping we can do is stop making these leaps of logic where if you, if you encounter any sort of feature or have any sort of positive experience with an AI product that you then leap immediately to the conclusion that everything involved in the prophecy about the future of AI must be true or to put, you know, someone like you and me now it has to be put on the defensive of, I did something positive with AI. All right, Ed, doesn't that now mean everything anyone has ever said about AI is true? Convince me I'm wrong. I think that logic is backwards, that these grand proclamations of we're going to have self-improving AI, we're going to automate all jobs, used a Carl Sagan quote, those remarkable claims require a remarkable amount of evidence.

38:55Why is everyone so quick of like, this product which you're working on and putting billions of dollars on, of course you're going to keep adding new features or finding things to improve. That is a given, of course. What technology in the history of the world would you have no improvements on if you're spending$10 to$20 billion a year in R &D? Of course it's going to have improvements. Why are we leaping from that? That means that anything you say, any speculative future you give about some sci-fi future is now the default unless we can prove otherwise. So we got to stop that logic too. We should be able to discuss, enjoy, or get around the implications of particular AI features without having to have that shift to a conversation about RSI or widespread job automation?

39:37I think what it is, it comes back to the pride thing. I think there's also something about LLMs and the way they make people feel. I'm on the spectrum, autistic. People have probably worked that out from the third 10 ,000-word article, but I don't feel anything when they're nice to me. I feel absolutely nothing. When the chatbot is like, wow, that was a great idea. I don't have, I don't respect it. I don't care what it thinks because it doesn't think. I don't see anything about what it says. If it tells me I have a good idea, I'm like, I don't care. I feel nothing. I think that a lot of people do feel something.

40:14I think when they see these things, compliment them and do an impression of brainstorming with them, which is really just talking to yourself in the mirror, which can help. That can help. I've done it. I think that it makes them feel good and also your Claude Code example I think that people feel very good about that and they feel very proficient and it makes them feel capable at something perhaps they were incapable of before and thus if you say to them well okay that's just that's fine they go no no I'm a big boy I think there's something kind of almost childish about it like no I'm special I'm special why aren't you impressed with and it's something the models are built to do the ingratiation i think is important but also i think that the tech industry has done a really good job over the years of convincing us that everything gets better and better and better even though it doesn't even though a lot of google search has got worse facebook's got worse twitter's got worse honestly argue many parts of blue sky have got worse it's less reliable at least the experience of using the computer has got worse we've hit a wall with innovation in general but this thing because it can kind of resemble anything if you want it to i think touches something dark in some people not evil but just like something very vulnerable and kind of weak and kind of gullible where they say well if i'm getting this out of this then i'm part of the future and i need someone to be impressed by this this is now a part of my identity and that's i think that that might also be the differentiator here as well I don't remember tech sure you had forum wars but about gaming consoles I'm sure you had you have android versus ios whatever not like this yeah nothing like this and I think that it touches something in people well I so I think there's a whole class of people where that's what's going on especially the sort of bro adjacent tech bro adjacent people on you know x who are who are always yelling well but what about this what about this right it and then I think the the other thing that happens for a lot of people, especially who are a little bit more tech distance is it's a way of dealing with anxiety.

42:26Right. Yeah. And if you think about this and like, we've talked about COVID before you and I, but I think it, it, it offers some good, you know, analogies here is like one of the ways when, you know, the virus was spreading, but hadn't quite got to the U S or was just coming or the hospitals were overloaded in Italy or whatever. It's like one of the ways to deal with it psychologically was to get out in front of it and be like, this is going to be really bad like i i you know i'm on it and you know you feel more prepared like i'm not i'm not going to be caught off guard i'll be the one telling people how bad this is and like somehow that does help you a little bit deal with like the anxiety of like impending dread and i think there's a lot of that going on with this as well is like i'm anxious about this doom troll and i've been doom trolled so many times i'm going to kind of get out in front of it now if i'm the one saying well wait a second i get so many i am for a lot of people now they're like stress pacifier of like, well, what about this?

43:19Go, right? Like I saw this thing that upset me. Like, doesn't that mean that means I think that means it is going to take it over. And then they're kind of hoping that me or someone else will come in and be like, you don't really, it's okay. Like that's not as big of a deal as it seems. So I think both are going on. It's either like, this gives me meaning. Like I'm a part of the future. If you're like using cloud code and if you're just using like chat GPT for natural language search, you might just be really anxious because you, you know, you hear these earnest podcasts where people are interviewing people about, you know, we'll have to eat our dogs when the jobs are gone.

43:50And you're like, well, if I get out in front of it, at least I feel like I have some autonomy in this dark thing that's happening. And so it's like common psychology, both of the psychologies equal dollar and cents for a, again, I keep going back to, remember, it's a vanishingly small number of early investors who have large equity positions in these companies. That is who benefits from all of that. They will benefit immensely because no matter what that psychology is, this company is at the fulcrum of the future and that's worthy of investing in even if their revenue story is murky even if their product story is um there's no moat and it is i mean i don't want to get into the economic weeds but this is like a clayton christensen fever dream what is happening with these companies and their products what does that mean uh so he had this idea of um you know talking about disruption from below that the problem is is you're working on a high-end version of a product and you don't want to undermine your market.

44:45So you try to keep it expensive and high-end. And then someone comes in from below with a different way of doing it this much cheaper and you're screwed because you ignored that market. All of the use cases that are useful now that people are spending money on, like software development tools and natural language search, here's the problem. You don't need a 10 trillion parameter language model to do this. And this is why these companies are so screwed and I think are trying to IPO as fast as they can is that like someone's going to come along and say we're using a 20 billion parameter open source model with a really smart coding harness that we just coded ourselves on top of it and tweaked for the last two years and you know what people like it better than cloud code and it's a hundredth of the price right or natural language search you don't need cloud fable five to summarize google search results right and the economics make no sense but a small model could a non-chip model could.

45:37That is why they're in trouble economically.

46:06place so you can focus on your customers, not your to-do list. I like Square a lot as a customer, and from talking to various business owners who use it, everybody seems really happy with how easy and intuitive everything is. Business owners don't have to juggle a bunch of tools, and their hardware and software are designed to be easy to use, so day-to-day options feel a lot simpler. With three clear plans depending on the tools you need, sellers who use Square see 9 % higher sales on average. Square helps you run your business more smoothly, bringing payments, operations, and insights together in one place.

46:36So you're ready for whatever's next. Right now, listeners can get up to$200 off Square hardware when you sign up at square.com slash go slash better offline. That's S-Q-U-A-R-E dot com slash go slash better offline. Get started with Square and build a setup that works the way you do. And now, another appliance triumph from our friends at Grand Appliance. With two dogs, every wash load came out covered in fur. I went into Grand Appliance looking for a fix, and they recommended the Maytag Top Load with Pet Pro Hair Removal System. They had it in stock and installed it days later. And you know what?

47:16It really works. Lint rollers are a thing of my past now. Great recommendations from the appliance experts. Shop GrandAppliance.com. GrandAppliance.com. Love bread, baked goods, and pasta, but not the way they make you feel? What if I told you there are macro-friendly options that don't taste like sawdust and sadness? Satisfying sandwiches, fully loaded bagels, noodles that can stand up to your favorite chunky sauces. All delicious. Crave-worthy and smart, each serving of Hero Bread has up to 19 grams of protein and 32 grams of fiber, and just 0 to 5 grams net carbs and 0 grams sugar. Hero Bread bakes with heart-healthy olive oil and delivers the soft, fluffy, flavorful experience you love.

47:56Breakfast burritos, schmear-loaded bagels, real mac and cheese. Hero Bread bakes loaves, bagels, and tortillas that don't taste or feel like cardboard. Noodles that don't fall apart in hearty sauces. Plus, limited-edition small batch bakes like the 2-grams Net Carb Hero Croissant or 1-gram Net Carb Hero Cheddar Biscuit, handmade in a Sonoma-based French bakery. Shop now on Hero.co. Use code IHEART for 10 % off. That's Hero.co. Per serving, not a low-calorie food. Some products contain allulose. See nutrition info on Hero.co for sodium and sugar content. Every business has an ambition. PayPal Open is the platform designed to help you grow into yours with access to business loans so you can expand and hundreds of millions of PayPal customers worldwide.

48:39Your customers can pay all the ways they want today with PayPal, Venmo, Pay Later and all major cards so you can focus on the future. When you need a partner trusted by millions, there's one platform for all business. PayPal Open. Grow today at PayPalOpen.com. Loan subject to approval in available locations.

49:01I also think that there is, and I do think there is a deeply cynical thing here, well, let me reframe that. I think that people have to find ways to rationalize capitalism. I think that the only way that they could, the amount of times I hear a week of, just like Amazon Web Services, just like Uber, just like this, I have restated that point a hundred times, people sometimes listen, people sometimes don't, but people need to find a way i think to rationalize the massive expenditures and the current products do not provide that rationalization nothing about chat gpt or claude or claude code or fable or whatever actually rationalizes this doesn't make a trillion dollars is too much money for anything outside of like universal health care and housing in fact probably could have taken care of that really easily but nevertheless people see that and they don't want to deal with the natural kind of dissonance they get which is wow are all the companies run by people who don't know what's going on and the answer is yes like i don't think that there's actually a grand conspiracy oh my god the emails i get every week people being like it's surveillance it's a secret surveillance state it's secret it's yeah it's so secret it's on cnbc every day oh they're all they're doing secret data centers yeah it's called oracle yeah it's being it's called oracle that's what oracle does oracle has a huge class like that's very well known what do you like i think people need there to be a conspiracy because otherwise the answer is which is what i believe which is none of these companies had a plan i think sam altman and darry amity thought we're going to throw a bunch of money at this and then god will come out yeah money money so much money and then they will have asi agi whatever they call it and then it happened and then that didn't they hit the diminishing returns at the end 2024 and since then they've been kind of harnessing non-llm stuff on top of llms in an attempt to make them do stuff but that's been so successful by the way think about the doom trolling this is another advantage of it they've completely obfuscated exactly that point that you just made which is that pre-training scaling again had we've talked about this on the show but it's had diminishing returns you know uh starting after 2024 and so all of the improvements that have come since then has been post-training, pre-trained models and building hand-coding harnesses with more and more special cases plugged into it to find more places for them to be useful, which is a completely different trajectory than 2023, where they were like, no, we'll just keep pre-trained, scaling these things till we have AGI.

51:35And they've created a sense of like, well, AI has been drastically improving, hasn't it? And you say, well, wait a second. Like if you told me in 2022, you know, when you're like, we're going to scale our way to AGI and our vision of agi is software development tools yeah like it's just dreadfully boring in comparison that's boring or natural language google but you're like but it's not just like a feature that like google will just kind of otherwise would have just kept adding and tweaking in a very like economically uh reasonable way saying forever it's like yeah i thought like the reason that people like llm search is pretty simple that it responds to search how people have always used search which is questions you're like hey what about this and this i've used ai mode with google maybe three times and i always use it as like a trawling expedition to say like has anyone ever said anything like this and then it would give me a bunch of fake citations like just that happens every time but then i'll find one weird pdf and it'll be like oh cool but isn't that if you didn't if llms didn't exist i would expect google search to do that by now like that would that feels like a natural progression but it's just normal kind of boring so i always say it's like oh if they called it library models it wouldn't be that big a deal but it would be a more accurate like you just choose a regular name this people weren't freaking out about platform as a service tools didn't hear all this bullshit about kubernetes which is way more fun to say than large language models people have taken this and the thing is i don't think that the strategy was always we're a doom troll like i don't think they sat and thought about it very much i think they just kind of oaf max their way they just bumbled into it and like it's scary and then they saw how well it worked yeah i think i genuinely think on an ethical level it's one of the most disgraceful things anyone's ever done technology technologically i think it's just on top of the obfuscation of what these things actually do it's horrible it's a it's a cruel thing to do i hear from people all the time just being like am i gonna lose my job to this am i good why is my boss telling me i'm gonna lose my job to this why what is this why is it different why am and i think when they hear all the doomerism and they use the product and they use claw code and they go oh it buffed out an open source crm they're like oh god they're right imagine what someone who kind of knew what they were doing could do oh i'm scared i don't think that i think that that i they shouldn't be able to sleep at night.

54:03I think it's an evil way to market things. I would say the way I would think of it, I put on my Bentham hat here, right? Let's use like utilitarian calculus. The net harm that doom trolling as a communication strategy has caused in terms of mental health, right? Just like people feeling bad. The net harm caused by doom trolling far, far, far, far, far exceeds any the grand total of benefits that this AI technology has produced so far. Like I don't see any other way for that calculus to work out. I was just reading one of the many papers that are actually now surveying and studying AI in the workforce.

54:39And they looked at this paper and they asked people, these software developers, like estimate how much time you've saved or whatever. And it was 11 hours a week we're saving. And then they asked them, is your company performing better at all? Like, has this made any impact on your bottom line? And it was like a vanishingly small percent that was like, yeah, there's anything different on the performance. Was that worth, or making like software developers, maybe by some measures, 1.2 times more efficient, worth causing, I think the negative toll of this psychologically is like getting close to like COVID territory.

55:17It's like population-wide, you are stressing out everybody day after day. They've made the last two years for anyone who's following the news psychologically miserable. that is a real harm. That is a real measurable harm. Like I really hate that I have to deal with this like time. And again, uh, it reminds me of having to deal with the pandemic, which was like a, a, like a psychologically fraught time because every day you were being bombarded, but at this time, you know, a, there's not a virus that's infecting a lot of people and be the people who are like warning about all the doom in this analogy.

55:55It would be as if like they were the ones in the lab doing the research that was producing the virus like that's the craziest thing about it right i mean imagine if in like 2019 someone was like these viruses coronaviruses doing gain-of-function research could really really like infect the whole world like of course they're going to get out we can't contain them oh by the way we are curiously doing this gain-of-function research on these viruses and we're not going to stop because you know the well in this case but whatever yeah someone else might go a different direction there yeah someone else might do it.

56:26So like, what can we do? He'd be like, stop building the viruses then. Anyways. So, so I think we have to account for the net psychological harm. And I think, I mean, I don't think our current government can do this, but I think that that's something where the government should in an abstract world be involved. Like, Oh, there's a small number of people who are causing a huge amount of distress and anxiety around our entire country. Of course, we're going to get in the game and we're going to pause all your model deployments until like you either convince us that that's not the case and you admit like, yeah, we were kind of making that up.

56:57Or if you don't want to say that, then like, no, you don't get to release this product. You're causing mass, mass unhappiness and damage, right? To our entire country. You have to account for that. You don't get to just do that. So it is, I think the harms so far have exponentially outweighed the tangible benefits. I'm just also going to be honest. Yeah. The mobile AI companies are terrible. I also think the media has categorically failed here and should feel fucking ashamed of themselves. I think the media is as much to blame. I think I'm going to put a fundamental blame on venture capital. I'll give you my quick pitch on that.

57:33Yes, absolutely. I mean, you have to understand the economics of especially high tech venture capital coming out of Silicon Valley. The whole model, and again, this is all just because you have some institutional investors and rich people that you want to make richer. That's Like that's the whole underlying goal, right? And their whole model is we have to find new areas where there's something to be monetized in which there's possibilities for unicorns. So we have to find new territories where you have the possibility of getting in early and having an investment turn out to be a multi-billion dollar company, right?

58:07The web, that's what started in the 90s with the web. And most of those bets failed because of the first dot-com crash. A couple paid off like Amazon. Then you had Web2. It turned out attention was a resource you could monetize. So it's like discovering a new mineral or oil. There was a huge fortune to be had. The venture capitalists could get in there early. They had massive returns, betting on Meta, betting on the social media companies, right? Then they're like, we need another because you have to keep finding. Every time you raise a new fund, you need a giant new resource that you can monetize to get to early.

58:38So the next thing they tried was crypto. Crypto was just Andreessen Horowitz saying, there's no more unicorns left in social. We're going to try to create a new field in which we can create unicorns. And they really flogged crypto. This is the future. This is the future. Oh, yeah, yeah. And it wasn't, especially for software. And I got yelled at for saying this, but I'm literally an expert on this. My doctorate's in the theory of distributed systems. It's a stupid way to build a distributed system. And I was right. And no one built the systems that way. So that kind of failed. This was the next territory.

59:09And it doesn't say this technology is not interesting or potentially useful. But as you said, it's not trillion dollar useful. Not yet. So why did all that money come in is because we're talking about one street in one city. We're talking like Sand Hill Road in Palo Alto. Like the people on that one street are like, we need to find a new territory that can produce $100 billion companies so that we can get the returns that we expect to keep our lifestyle up. And that's it. I've been saying this for years. It's the rock con bubble. It's they're out of big ideas. And AI was the panacea. it was the it was the api would be the way to build new startups it would be the way for enterprise companies to sell more software with new add-ons it would be the way for business software to take off consumer software it was meant to be the solution because they're doing exactly the same thing as the ai companies are doing saying yeah the ai will just fix this what are we going to build with this or the ai will work out what's the product ai will work it out it's honestly a kind of a pathetic culture i don't think they even care about that i like they're like okay if we put the money in this now what's the strike price going to be at the ipo that's what yeah but that's why i'm i'm getting at that they don't care if it works in the end or not they're they're like we we want to spacex look at that but the theoretical that i'm saying is that the idea of large language models as an api or a consumer product was what they're excited about because you can just extrapolate the various things but i must i must get back to it i think the media is responsible i 100 believe the media is responsible they are the ones that at the times Ezra Klein how much AGI bullshit is that guy shoveled how many times Bernie Sanders going out there and talking to Claude I realize that's politics but they put it on YouTube for a reason how many different outlets have talked about the jobpocalypse that does not exist or the sasspocalypse claiming that software companies are being sold off because of AI disruption that doesn't exist the media bought and sold this in 2023 there was Guardian headline that said Sam was a little bit scared it's just without that none of this was possible and perhaps they were just being a megaphone for real anxieties from these companies or perhaps they were just looking for a narrative that would get clicks i just think yeah i don't think it's clicks i think they underestimated the weirdness of these people and they took them at face this is my you know having many feet within the world of media.

1:01:35What I really think happened is it didn't cross their minds that these people are super strange cultist weirdos. They don't know about Yukowski. They don't know about the rationalist. They don't know about the exorist community that came out of the rationalist and then merged with the technological singularities and that they also think they're going to live forever by harvesting the blood of children. They were just like, these are engineers. I don't know about technology they do. They're telling me this. Why would they lie? I, I've heard that word for word from multiple early on, multiple journalists.

1:02:08And I think it was all being seen through the frame of COVID where that was in the recent history. If the virus, I don't know anything about viruses, but the virologists were like, trust me, like, this is something I can't directly observe, right? Because there's not very many people sick, but like, trust us, this is going to spread and this is a really big deal. And like, well, trucks, the virologists know what they talk about. Why would they lie? And I don't want to miss that story. I think there was a lot of that going on of these are the people building the tech because I heard this phrase from so many people.

1:02:38These are the people building the technology. They know about it best. I'm not a computer scientist. I mean, I am. But like if I'm being the journalist and this is why like the people who were not like, where is the resistance is coming from is computer scientists like me who don't live near Silicon Valley. And we're like, well, I do understand this technology. And what the hell are you talking about? but i think for the journalist it was and now they're just this is why i'm wrote that op-ed i'm trying to spread the word more these guys are weird they're weird and by the way they're mainly guys too because i think women are going to put up with this weird you know i'm going to go in my room and play with my star war toys nonsense right uh i don't want to who knows what that tells us about our our gender ed but it's not great that it's all men doing this craziness yeah it's like tim tim rey gabrie isn't particularly sold on this for example like i don't think emily bender like a lot of the like hardcore skeptics are like you boys with your star wars what are you up to lads yeah what do you mean you don't have friends do you is this is this related to fantasy football like what guys what is this right which is what's that the funny thing is though there is something to that where it's it is a very male technology and i do want it like it's not not something i think two white guys can necessarily get into in any depth without a woman present so that we could actually have a rounded conversation but it is interesting that pretty much everyone running this stuff is a guy and the majority of them are white fellas and they're all claiming that everything they build is amazing I don't know perhaps there's something going on there too is there something white guys are good at is thinking everything we do is amazing we are pretty well trained we are pretty well trained at that but this is why I do think it's important why I wrote that op-ed is like I want to name what they're doing this is doom trolling I think you need to understand these people are weird and we can't take what they're saying at face value we just can't because they're too weird they've proven time and again but the key message I would also want like if you're listening to this pod if you're listening to this podcast now do not interpret this conversation as oh I'm going to categorize this in a claim that AI doesn't work and therefore if I see something cool that AI does because this conversation isn't relevant.

1:04:54You know, Cal was wrong. This is, it's really not about that is not what I'm talking about right now. I am talking about the way that we actually talk about AI, how we treat it as a business, what is morally appropriate and what is morally not. And these are normal products. And I don't, I don't, to me, this isn't, it's not vaporware. I mean, I think the ability to parse natural language like a language model can do is like, it's fascinating. And I'm also surprised by how hard it's been to come up with a lot of good, useful, economically viable products off of that ability. Like we're still with software development tools and rewriting Google search results.

1:05:34I actually thought we would have a lot more interesting tools that we were using in our everyday life right now. And it's because there's been some problems that we didn't think about. So this whole conversation is about stop treating this like a demon that's been summoned, make fun of doom trolling because it's kind of embarrassing. This is the, you know, this is the, the, the magic, the gathering club at the high school table. Um, and just treat this like a normal product. And like, I don't want to hear, let's just, what are the products you're selling? What are the benefits? How much do they cost?

1:06:05Is it worth the money? And, uh, what other products are you working on? Like, let's just have normal conversations. So do not, as a listener, categorize this in this, in this, in this sort of, uh, light first dark is like, okay, this means AI doesn't work. and this team says it does work. And then I'm going to try to assess in my mind is AI useful or not. And if it is, then I have to be ready to mate with machines. And if it doesn't, then stop all that sort of extreme thinking. I just want us to talk about this like a normal, interesting, but normal technology. And normal people should look at the way that these companies are doom trolling us and say, that's strange.

1:06:41Please stop. And in the meantime, I am going to have to really make fun of you. I think that's where we need to be. I fully agree. And I think all of this, large language models in a vacuum, very interesting technology. The problem is they tried to scale them like a giant multi-trillion dollar industry, which I don't think they fit into. The future of LLMs in whatever form they have is on device. They never should have been scaled at this scale. Like it never made sense. Never once. And in the end, it is normal technology. And that is the thing to always take away from this, which is you wouldn't freak out about kubernetes you wouldn't microsoft word doing autocomplete shouldn't scare you grammarly shouldn't scare you this is be the actual technology itself is not scaring you it's the people around it and the people's extrapolations and also like you said the willingness we have to believe people who are working on something who have supposed expertise as if expertise guarantees that you're correct or indeed guarantees that you know what you're talking about or indeed that you can see the future yeah so there we go i mean i think that's yeah yeah i mean i don't know who knows no no i'm already seeing like the comments on my new york times piece is just falling into the like uh-oh you you you said somewhere in there there could be a benefit of ai you apostate ai is terrible or like the other side is is like well well how do you explain the fact, you know, I'm, oh my God, it's just written by AI, these comments, I get sent this all the time.

1:08:14These, these comments that are like, I work for a such and such company and what used to take me three weeks, I now do in like six seconds. And, you know, it's just like falling, people are just falling into their camps about like, either you're one of the, the priest of the new religion or, you know, you're the, you're the, the, the, the Canaanites who were, who were kicked out of the land or something. Right. Like, it's like, you got to be in like one of these two like extremes and don't do that just say like treat it like a normal technology stop doom trolling is is stupid stop it like treat it like a normal technology either stop if you really think you're destroying the world or start talking about it like pickup trucks right we don't need this in between so hopefully hopefully we can convince a few more people about that i hope so cal thank you so much for joining me always a pleasure

1:09:09Thank you for listening to Better Offline. The editor and composer of the Better Offline theme song is Matt Ossowski. You can check out more of his music and audio projects at matosowski.com. M-A-T-T-O-S-O-W-S-K-I.com. You can email me at ez at betteroffline.com or visit betteroffline.com to find more podcast links and, of course, my newsletter. I also really recommend you go to chat.wheresyoured.at to visit the Discord and go to r slash betteroffline to check out our Reddit. Thank you so much for listening. Better Offline is a production of Cool Zone Media. For more from Cool Zone Media, visit our website, coolzonemedia.com, or check us out on the iHeartRadio app, Apple Podcasts, or wherever you get your podcasts.

1:10:13If your best finance people are doing expense reports, chasing receipts, or spending time on month-end close, it's time to get Brex AF, a Gentic finance that eliminates that work before it starts. Learn more at brex.com slash AF. And now another appliance triumph from our friends at Grand Appliance With two dogs, every wash load came out covered in fur I went into Grand Appliance looking for a fix And they recommended the Maytag top load with PetPro hair removal system They had it in stock and installed it days later And you know what? It really works Lint rollers are a thing of my past now Great recommendations from the appliance experts Shop GrandAppliance.com GrandAppliance.com Running a business shouldn't feel like surviving a software group project.

1:11:04One app for accounting, another for inventory, another for sales. And somehow, none of them talk to each other. That's where Odoo comes in. An all-in-one business management software that brings every part of your business together. From sales and accounting to inventory and marketing. All in one powerful platform. No messy integrations, no bouncing between tabs. And best of all, no spreadsheets. Stop managing software and start managing your business with one unified system. Try for free today at odoo.com slash iHeartRadio. That's odoo.com slash iHeartRadio. It's 2026. We upgraded our phones, our cars, even our coffee.

1:11:47So why are we still acting like pleasure is negotiable? At Pink Cherry, it's not. They've got hundreds of toys that actually deliver. and whether you know exactly what you like or you're still figuring it out, there is a wide range to explore. If you'd rather skip the guesswork, their mystery boxes make it easy. They curate a mix for you so you can discover new favorites without overthinking it. And they ship discreetly with free shipping on orders over$59, which we love. So go to PinkCherry.com and use promo code CHELSEA to save up to 80 % off site-wide because life is hard, feeling good shouldn't be.

1:12:21PinkCherry.com because everyone deserves pleasure. This is an iHeart Podcast. Guaranteed human.

From the publisher

In this week’s Better Offline, Ed talks with computer science professor and writer Cal Newport about AI companies “doom trolling” consumers using scary stories about conscious computers, and how we need to make fun of the scare-mongering and ridicule the executives peddling in it.

Please support me by subscribing to my premium newsletter - here’s $10 off your first year of annual https://edzitronswheresyouredatghostio.outpost.pub/public/promo-subscription/84rt762qen 

Cal Newport’s “Dear A.I. Companies: The Doom Trolling Needs To Stop https://www.nytimes.com/2026/06/17/opinion/ai-dangerous-openai-anthropic.html 

Podcast & Videos: https://www.youtube.com/@CalNewportMedia/

Newsletter: https://calnewport.com

New Yorker archive: https://www.newyorker.com/contributors/cal-newport

YOU CAN NOW BUY BETTER OFFLINE MERCH! Go to https://cottonbureau.com/people/better-offline and use code FREE99 for free shipping on orders of $99 or more.

---

LINKS: https://www.tinyurl.com/betterofflinelinks

Newsletter: https://www.wheresyoured.at/

Reddit: https://www.reddit.com/r/BetterOffline/ 

Discord: chat.wheresyoured.at

Ed's Socials:

https://twitter.com/edzitron

https://www.instagram.com/edzitron

https://bsky.app/profile/edzitron.com

https://www.threads.net/@edzitron

Email Me: ez@betteroffline.com

See omnystudio.com/listener for privacy information.

More from Better Offline

All 276 episodes
The AI Industry Must Stop Doom Trolling w/ Cal NewportBetter Offline · 1 h 2 min
Listen in VO