No Mercy / No Malice: Oppenheimer, Inc.

0:00If your best finance people are doing expense reports, chasing receipts, or spending time on month-end clothes, it's time to get Brex AF, a gentic finance that eliminates that work before it starts. Learn more at brex.com slash AF.

0:20This episode is brought to you by Google Chrome. You think you know a browser, but Gemini and Chrome? That's new. It can help you with practically anything on the web, like restoring a vintage motorcycle from a 50-page restoration block, or finally break down that long article you've had open for weeks. Gemini and Chrome is here for it. Ready to make anything online make sense? There's no place like Chrome. Check responses set up required, compatibility and availability varies 18+. Ryan Reynolds here for Mint Mobile with your summer price forecast. Now, unfortunately, we're seeing rising costs across the country with possibility that big wireless hates you 100%.

0:56Now, over here at Mint Mobile, we're seeing sunny skies and dropping prices. Every plan to just$15 a month. Give it a try at mintmobile.com slash switch. Upfront payment of$45 for three months,$90 for six months, or$180 for 12-month plan required. $15 per month equivalent. Taxes and fees extra. New customer offer for initial plan term only greater than 50 gigabytes may slow when network is busy. See terms.

1:17George Hahn:I'm George Hahn, and this is No Mercy, No Malice. AI researchers believe superintelligence is an inevitability, and that there's a non-zero chance its arrival could trigger an extinction-level event for humanity. We're at a fork in the road, and the window for choosing which path to take is closing at an unknown rate. In fact, one of the few certainties here is that nobody knows what happens next. Oppenheimer, Inc.

1:57George Hahn:A 27-year-old resigns from a firm he spent four months at, triggers a global panic, drawing comments from a former president and calls from the leaders of Frontier Labs for a slowdown. In 1946, would we have let Robert Oppenheimer raise money from Sequoia Capital and begin selling nukes to the UAE and Procter & Gamble? I'm going on Smirconish tomorrow where I'll be asked, what the fuck is going on? The honest answer is I don't know. What I am certain of? This is another example of a small number of players capturing staggering economic upside while outsourcing the downside risks or harms to the broader public.

2:47George Hahn:In 2024, a year after Dr. Jeffrey Hinton, the godfather of AI, quit Google in order to speak freely about the risks of AI, he won the Nobel Prize in physics. In an interview for the Nobel website, Hinton described two kinds of AI risks. There's relatively short-term risks, which are very important and very urgent. They're mainly to do with people misusing AI. Examples include a job apocalypse. Bullshit, in my opinion. Productivity gains accelerating wealth inequality. Deepfakes destabilizing democracy. Cybercriminals picking up a dangerous new tool. bias getting embedded in criminal justice, healthcare, and hiring, and the proliferation of more powerful biological weapons that can be produced more easily by middle powers and non-state actors.

3:43George Hahn:There's also longer-term problems of these things taking over, Hinton continued. The question is what's going to happen when we've created beings that are more intelligent than us? We've never been in that situation before, Anybody who says it's all going to be fine is crazy. Anybody who says they're inevitably going to take over, they're crazy too. Humanity is at a fork in the road. But the choice isn't whether to develop AI superintelligence. It's how to proceed in the face of a technology we cannot fully comprehend or control. One path is to regulate AI such that we mitigate the risks but reap the rewards.

4:28George Hahn:The other path is to continue full speed ahead Despite a widespread belief among researchers, including Hinton That there's a non-zero chance that AI superintelligence Could present an extinction-level event for humanity in the near future If the right thing seems obvious Remember that the right thing and the hard thing Are usually the same thing Increasingly, the AI narrative resembles a Terminator reboot nobody asked for. We've gone from AI will take your job to AI will spike your power bill and devour your water supply to AI will kill everyone. Inspiring stuff if you're looking to inspire a mob with pitchforks.

5:18George Hahn:Technology writer Jasmine Sun described AI populism as a worldview that regards AI as a thing manufactured by out-of-touch billionaires and pushed onto an unwilling public to achieve sinister aims like capitalist efficiency, layoffs, and population management, surveillance. This year, voters in seven states will decide on at least 16 local ballot measures related to data centers. Senator Ted Cruz called for substantially more regulation, but stopped short of a moratorium, telling Politico, If they're going to be killer robots, I'd rather they be American killer robots than Chinese killer robots.

6:07George Hahn:Senator Bernie Sanders has proposed a ban on superintelligence and threatened 20-year prison sentences for developers who violate it. Interestingly, Sanders and Steve Bannon both appeared at the Pro-Human Assembly this week. AI politics is manufacturing the strangest bedfellows. As populist anger bubbles up, Anthropic CEO Dario Amodi, who briefly held adult-in-the-room status, and other less well-known AI founders are becoming honorary members of the algorithmic oligarchy. They're joining Sam Altman, who equated the resources needed to raise children to training AI, and Elon Musk, who slashed aid to the world's most vulnerable people.

6:58George Hahn:That AI founders are suddenly concerned about the peril they've created after vesting their way to billionaire status is obnoxious and unhelpful, akin to Dr. Frankenstein begging us to rein in his monster while creating new self-replicating monsters. The robber barons left behind libraries and concert halls. The broligarchs will leave behind server farms, a bot infestation, and conviction that we should have been more grateful for everything they did. We're watching the fourth game in the Fuck Around and Find Out World series. Before we're swept up in the populist moment, we should ask, what's going right with AI?

7:47George Hahn:Answer? Plenty. Recently, I interviewed journalist Josh Teringel on my podcast. Researching his book, AI for Good, took Terengel to the Cleveland Clinic, where doctors deployed an AI model to better detect sepsis. It's the leading cause of death in hospitals, killing about 350 ,000 Americans each year. If caught early, it can be treated with antibiotics. The challenge is detection. This is a perfect problem for AI and machine learning because sepsis masks itself by looking like almost anything else, Taringell told me. The Cleveland Clinic AI helped reduce the hospital's sepsis mortality rate by 41%.

8:34George Hahn:Deployed across American health care, that model could save more than 140 ,000 lives every year. Speaking of saving lives, AI is helping to design antibiotics to kill drug-resistant bacteria and accelerating the timeline for detecting pancreatic cancer by up to three years. Pancreatic cancer kills 52 ,000 Americans per year. 85 % of patients receive a diagnosis after the disease has already spread, and the five-year survival rate remains below 15%. AI is also aiding in the early detection of wildfires, improving hurricane forecasting, and helping archaeologists decipher previously unreadable ancient scrolls.

9:26George Hahn:Banning AI research or slowing the pace of the frontier, whatever that means, will spill over into areas where AI is rapidly improving our lives. That's why, in 2023, climate scientists opposed halting generative AI research, saying that might throttle the development of tools needed to advance knowledge on complex problems with hidden interactions, such as climate change. In other words, we risk throwing the baby out with the bathwater. AI founders are alarmed by the non-zero possibility of extinction, but they've still lined up bankers for an IPO. I'm looking forward to the risks section of the S1s that cast risking an extinction event as the price for progress.

10:22George Hahn:Cybersecurity is also on the front line of the short-term risks. According to recent data from IBM, one in four data breaches so far this year were AI-enabled, a 56 % increase year on year. When I spoke with cybersecurity expert Alex Stamos on my podcast, he likened AI's democratizing impact on cybercrime to Premier League teams moving up a division. All of the hacking teams are getting promoted up to the next level. Small countries now have the power of big countries. From a hacking perspective, you're going to see people stand up capabilities that used to be the kind only intelligence agencies could do.

11:11George Hahn:Sophos, a cybersecurity company, puts the average current cost to recover from a ransomware attack, excluding the ransom, at$1.7 million, up 11 % year on year. In the aggregate, cyber attacks cost the global economy$10.5 trillion last year. If cybercrime were a country, it would be the world's third largest economy. Meanwhile, the cost of entry for mass harm has gone from a nation-state's budget to a laptop and a grudge. One of the blind spots in Silicon Valley's Milton Friedman mindset is the belief that all regulation exists in opposition to shareholder value. After Upton Sinclair's The Jungle exposed unsanitary conditions in the meatpacking industry, regulatory compliance in the form of a USDA stamp-certified quality.

12:16George Hahn:Likewise, SEC and FDIC regulations created in the aftermath of the 1929 crash restored investor and customer confidence. The absence of regulation makes AI so fragile that valuations soar on wild speculation and collapse under clickbait. That fragility extends to the whole market, since the MAG-7 stocks register one-third of the S &P 500's value, and to the broader economy, as the AI build-out has driven a 32 % increase in S &P earnings growth this year. Put simply, if AI sneezes, the market gets walking pneumonia, i.e. a recession. Regulation is the bulwark that keeps a tragedy from becoming a catastrophe Mark Zuckerberg, the poster boy for negative externalities run amok says every AI lab has the responsibility and incentive to move at the pace required to train its models safely We should trust Zuck as social media is going great Donald Trump believes a smart president is the only regulator AI needs Unfortunately, we can't wait until 2029 Altman, Amodi, and Musk aren't clowns like Trump But their regulatory ideas Employee-like access to external evaluators And vague promises to welcome a federal safety framework Are reminiscent of Sheryl Sandberg's calls for regulation performative bullshit.

14:08George Hahn:It's time for an International Artificial Intelligence Agency, IAIA, modeled after the International Atomic Energy Agency. We could start with a U.S. regulator similar to the Department of Energy that records incidents, approves new models, promulgates safety rules, and has subpoena powers. The key, as Fareed Zakaria wrote in June, is to combine private expertise with public authority. Ultimately, that regulator should share bilateral authority with a counterpart in China, where AI is already heavily regulated. As Alice Han, director at Greenmantle, told my markets co-host Ed Elson, sentiment around AI is largely positive in China, but leaders there worry that the absence of a global AI governance authority could set us up for potentially catastrophic AI-related risks.

15:13George Hahn:The AI race isn't a reason to delay regulation. It's a reason to speed it up. That's the lesson of the Cold War, when adversaries cooperated to build real safeguards that have limited weapons proliferation to nine countries, even as they facilitated nuclear power plants in 31 countries. Mutually assured destruction worked because everyone was terrified. A crisis is a terrible thing to waste, and we have one on our hands. People are terrified again. Every apocalypse needs a villain who insists he's the hero. We have ours, and they believe they can sound the alarm while ringing the NASDAQ bell. History disagrees.

16:09George Hahn:Life is so rich.

16:39We'll be right back. switch. Upfront payment of$45 for three months,$90 for six months, or$180 for 12-month plan required. $15 per month equivalent. Taxes and fees extra. New customer offer for initial plan term only. Greater than 50 gigabytes may slow when network is busy. See terms. Push your limits. Train with precision. See the results. At Equinox, that's high performance loving. Everything you need to lock in and unlock your potential at Equinox. Start today at equinox.com. This episode is brought to you by ChatGPT. Hey, it's Bill Simmons from the Bill Simmons podcast. Have you guys heard about chat GPT work?

17:16It's the new way to use chat GPT for bigger multi-step projects. And when you need more than just answers, give chat GPT work access to your apps and files, and it can create real work documents like spreadsheets, slides, and structured reports. Get started at chat GPT.com by selecting work mode available on plus and pro plans.