Jensen Huang’s Nvidiotic Spy Scandal + Can Dems Pass AI Regulation?

0:00Support comes from 80 ,000 Hours. 80 ,000 Hours offers free research and advice on how you can actually work on reducing AI risks. Get started at 80 ,000hours.org slash machine gods. Can NVIDIA's CEO survive a sex scandal with a Chinese spy? What else is the company hiding? Can Democrats turn the AI backlash into an actual plan? And where did Representative Greg Casar lose his AirPods? I'm Kevin Roos. I'm Casey Newton. And from San Francisco, this is Machine Gods in partnership with NPR. The official podcast for The Singularity starts now.

0:36Casey, we have to start today by talking about this Jensen Huang spy story. It is, I think, the craziest story of the year so far, and it's almost the end of the year. Yeah, I think that it's certainly going to be very near the top of that list when we make it in just a few weeks. Okay, so let's just briefly recap where we've been, what's been happening over the weekend, and what we know about this story, because as of this recording on Monday morning, A lot is still unknown, but it's moving very quickly. Last week, we talked with Anna Swanson from The New York Times, who walked us through this reporting that she had been doing with her colleagues about how Jensen Huang, the CEO of NVIDIA, had gotten close to a woman that U.S.

1:13intelligence had determined was a Chinese intelligence asset. That woman, Alice Huang, was an executive at Megaspeed, a company based in Singapore that had been suspected of helping to illegally smuggle NVIDIA's chips into China. But at the time, all we knew was that this relationship was, quote, close. And I sort of asked Anna, like, hey, was there anything more going on between Jensen and Alice? And her response was basically, we can't say anything more than what's in our story. And you and I talked afterwards, and we were sort of like, we feel like if you read between the lines here, there's more going on.

1:48But we couldn't get it on the record, Kevin, until this moment. Yes. So then on Sunday, Jensen came out with it himself. He wrote a memo to staff in which he admitted to having an affair. This memo, which NVIDIA posted publicly, I'll just read the relevant passage here. It says, quote, I owe my family and all of you an apology. I was unfaithful to my wife. My actions hurt her and our children. There is no excuse for what I did. I am deeply sorry. NVIDIA's board is now investigating this relationship. According to The Times, Jensen Huang told the board that he had been intimate with Alice Huang, this suspected Chinese spy.

2:27The company claims that the board has no reason to believe that national security or NVIDIA secrets were compromised. An NVIDIA spokesperson told CNN, quote, today's news will not slow NVIDIA. Yeah, because why would it? Why, when you find out that your CEO has been in an intimate relationship with a Chinese spy, would that slow you down for even a moment? Nothing must stand in the way of chip production, Kevin. I cannot believe how crazy this story is. Because, Casey, it keeps getting crazier. On Sunday, President Trump, who has been very close to Jensen Huang for a long time. Although not in the way that Jensen was close to Alice Huang.

3:05We don't think it was that kind of a relationship. He was asked about this news that Huang had admitted to having an affair. He said he still thinks he's an honorable guy who, quote, probably has an excuse for it. And he said that he would certainly take him on next week's trip to Asia. So this has really shaken the entire AI world. And I'm desperate to know what you make of this and what your reaction was. Oh, man. I mean, there are so many different things to discuss in here. But I think we probably just have to start with how central NVIDIA is to the AI industry, to the build out. I think that by some measures, this probably is the most important company in the world right now.

3:51AI does not happen without NVIDIA chips. And Jensen Wang is uniquely central to NVIDIA. There are other companies where there is sort of a big roster of executives, where there is a succession plan, where you sort of know what might happen if a CEO sort of mysteriously disappeared. That is not the case at NVIDIA. And so that just leaves a lot of questions about how basically no matter how bad this scandal gets, it is unclear what anyone can do about it. Yeah, it's wild because not only is NVIDIA so important and not only is Jensen Huang so important to NVIDIA, but he has also been at the center of the entire U.S.

4:28policy conversation and driving a lot of the policies that the Trump administration has put forward about China and export controls. And Casey, I've been thinking about this. I think this might be the most significant intelligence operation since the Cold War. Jensen Huang is not just some CEO. As you just said, he runs like one of the most important companies in the world. And NVIDIA has been unusually vocal about not wanting to restrict the sale of its chips to China. They are basically alone in that position among major American companies. And now we know that while he was pushing for those policies and for loosening these export controls, he was also having an affair with a Chinese spy.

5:10And not just any Chinese spy, but a top executive at Megaspeed, which has been accused and investigated by U.S. officials for helping to smuggle these chips into China. And we should say that Jensen Wang was advocating for very minimal export controls long before he is believed to have gotten into this relationship. chip. There are obvious self-serving reasons why he wants NVIDIA to be able to sell as many chips as it wants everywhere. But certainly, Kevin, I think this is going to undermine NVIDIA's position going forward. And this is a company that really, really aggressively pushed this line in ways that we can talk about.

5:48Well, totally. And it destroys his credibility. But also, like, think about what the Chinese government could have done with this knowledge, right? It would not have been hard for them to sort of, once they knew that this affair was going on, to use it as leverage or blackmail material against Jensen Huang to say, hey, it'd be a real shame if those export controls got tightened and some information about your affair get out. Now, like, we don't know that any of that happened, but just the potential for compromise here by this very high-ranking, very powerful business leader with ties, close ties to the Trump administration, like, it's just mind-boggling.

6:25And that's why I get so frustrated when I see NVIDIA already putting out statements saying that, you know, we don't think there was any national security breach involved here. It's like, OK, well, you've also just told us that you're launching an independent investigation. It sure sounds like you've already come to the conclusion of that investigation before you even started. No, I think there's a lot here, and I hope that this is a real investigation by the NVIDIA board. I'm sure that Congress and law enforcement agencies in the U.S. will also be investigating because it's not just about the potential for blackmail.

6:54Jensen Huang is a person who has a lot of important national secrets in his possession. You know, the plans of the U.S. frontier labs, the chip allotments, how NVIDIA plans to design and build its next generation of chips. All of that is very sensitive information that would be very valuable in the hands of an adversary. Sure, but I'm just going to say right now, I put no stock in this alleged independent investigation that NVIDIA says it is about to conduct. This company just got caught lying about the relationship that Jensen Wong was in with Alice Wong, right? And the fact that NVIDIA appears to have lied about it, I think, really undermines their credibility with everything that happens next.

7:34Right. Well, we should also talk about one more thing that we've recently learned, which is that NVIDIA may have directly intervened in a U.S. Commerce Department investigation into Megaspeed, the company associated with Alice Wong. So this is according to The Times. Last year, the Commerce Department was reportedly in the midst of a months-long investigation into this alleged smuggling that Megaspeed may have been doing of chips into China. when NVIDIA's general counsel intervened via email asking for information about the investigation. The investigation was abruptly transferred to the Justice Department out of concern that it might be compromised.

8:10And it is just increasingly clear that this is a very messy situation and that no one has all of the details yet. There is a lot more to come on this story. Yeah, but I think we do know the basic shape of it, Kevin, right? which is that for over a year now, officials in the U.S. government have been very concerned about this mega speed company, right? This company has a very unusual history. It was started by Alice Wong, a former television journalist who later got into private equity before founding a NeoCloud, a somewhat unusual career path, I think we could say, although an admirable one. After she starts this company, NVIDIA names it essentially a favored trading partner assuring that it will get access to great top-of-the-line NVIDIA chips, which is a huge win for Megaspeed.

8:57They go on to buy more than$4 billion of these chips. Both the Times and Bloomberg have done big investigations into Megaspeed. And one of the things that Bloomberg found was that something like 50 ,000 of these chips could not be properly accounted for. So chips that were supposed to stay in Southeast Asia and, you know, where they were able to be rented out, the fear is that these actually made their way into China, right? So that is the basic shape of what is going on. All of that would be bad enough for NVIDIA, by the way, even if Jensen Wong weren't having an affair with Alice Wong, right?

9:32But now that you know that, I think it just starts to cast a lot of doubts about who knew what and when. Well, and you go back and you look at Jensen Wong's statements, whenever he's been asked about smuggling, he says, oh, this is not really a problem. You know, no one has any evidence that smuggling is going on. He has gone further than that. He has said that there is no evidence that ships have been diverted, which we also now is now clearly a lie. Yeah. So I think Jensen Huang is going to face a lot of very tough questions, not just from maybe his board and the law firm or outside investigators that they bring in to look into his conduct, but from shareholders.

10:05I think there are very likely going to be major shareholder lawsuits because, among other things, Jensen Huang and NVIDIA have made claims that are now suspect about whether, for example, Chinese revenue was included in any of their projections and forecasts. They've said that it hasn't been at various points. And now, you know, we have to go back and look at that in light of new evidence. But also, like, this is material to shareholders, clearly, given what is happening to NVIDIA's stock. And I'd be very shocked if there aren't a bunch of shareholder lawsuits filed this week. Yeah. I want to get your thoughts on what you think is going to happen at the government level, right?

10:41For the past couple of years, there has been a war within the Trump administration about what to do with chips and China. There are the China hawks who say, we do not think that high-end chips should be sold to China. That will let China catch up in AI and sort of threaten America's national security. And then you have the folks who I think of as like the oligarch accelerationists. So this is like the David Sachs, Andreessen Horowitz wing of the party. And they're saying you need to sell these chips into China. It's very good for America, actually, because it means that there could not be a sort of rival system that could compete with NVIDIAs out there in the world.

11:17And as long as AI gets built on NVIDIA chips, America exercises that control. With everything that is happening now with Jensen and the spy, it seems like the hawks have been given a great gift, right? Which is that the accelerationists have been undermined. At the same time, you can see in those remarks that you just read from President Trump, he still stands firmly behind Jensen and he is going to say, hey, do whatever you got to do to prop up our economy. So how do you see that shaking out in the weeks and months to come? I think it's very much a gift to the hawks. I think that the people who want to sell chips in China will now just sound suspect and their credibility will be shot when Jensen Huang, if Jensen Huang survives, which by the way, we should talk about that.

11:57I don't think he survives this. I think he's going to step down. Really? I think this is too big a cloud looming over him because think about it. Next time he goes out there. And by cloud, you mean the sort of not the sort of Neo cloud with all of the shit. Yeah. Okay. Sorry. No, I mean, now it's like any time that he advances what has become Nvidia's official position, which is that, you know, you should be able to sell as many chips as you want anywhere you want. Like when he says that, it's going to sound like he's running cover for his friend or lover, the Chinese intelligence asset. It's going to sound, I mean, I'm not claiming that his position is the result of his affair with this woman, Alice Wong.

12:35I'm just saying that if you were designing a position for an American chipmaker to take, that would be maximally advantageous to the Chinese government. You would come up with a position that looks a lot like Nvidia's. Sure. I mean, yes. Just to reiterate, I just believe that Jensen has always believed this and would believe this whether he was having an affair or not. Well, it's also like it's very good for him economically and financially to be able to sell as many chips to China as he wants to. So, you know, here's the thing. If we were living in normal times, I would say yes. Like often when an executive disgraces himself by having an affair, he does get fired, right?

13:09Like that's happened at McDonald's, for example. But NVIDIA ain't McDonald's, right? And also, we're living in a shameless time where people are rarely punished for any personal behavior, no matter how bad. And I just keep coming back to the question of, okay, let's say that Jensen does say, I've got to resign. What then? He's going to appoint one of his children who are sort of relatively recently installed at NVIDIA to take over the company. It is crazy to me, by the way, that this is a 63-year-old man who has no succession plan and has said that he plans to continue running the company for decades.

13:48So I think that is also, by the way, just a massive issue with NVIDIA and something that investors arguably should have been paying attention to long before now. I mean, I could be wrong. Jensen Huang could hang on. As you said, he's done a lot to sort of curry favor with the Trump administration. He's obviously got a huge influential position in the AI industry, but it's going to be so distracting. I mean, can you imagine the newly installed, newly elected congressional Democrats and how many times they are going to try to drag Jensen Huang to Capitol Hill to explain his behavior and why it wasn't just a grave intelligence lapse on the part of one of the most important business officials in the country?

14:30Like, they are going to have an absolute field day with this situation. And they should. It's a big deal. And I just think at some point this will get just so distracting that NVIDIA shareholders will be like, you know what, we appreciate what you've done for this business and how much you've grown it. But like we actually think this is too big of an obstacle to overcome. It makes sense to me. But again, this is a man who has 60 direct reports, an insane number of direct reports. Right. But that speaks to the level of micromanaging that he insists on doing at this business. Right. I know, but like, how do you keep doing that job even after your integrity and your honesty have been so thoroughly shredded?

15:10Like, how do you do that? I mean, if I were them, I would just essentially hand a win to the hawks and say, you know what? You're right. We're going to drop all of our lobbying around export controls. Make the rules that you want to make. They know that it is in the interest of the United States economy for NVIDIA to sell as many chips as it can. And so they can just count on hopefully Congress taking a relatively light hand with export controls. Also worth saying, Kevin, that China itself does not actually love buying NVIDIA chips. This was something that I had sort of missed until I did some reading this morning.

15:41But remember, the United States did give NVIDIA the ability to sell these sort of last generation ships into China. China's put a lot of restrictions on that because they're trying to prop up their own sort of nascent domestic industry. So until now, for NVIDIA, there have been a million reasons why they wanted to just kind of keep pushing in both directions on that front. I think this is the moment to say, walk away and we're just going to go fight another battle. Yeah, I think that's right. I would be very surprised if NVIDIA's position on export controls does not change as a result of this investigation.

16:15At the very least, it seems like they will just need to be less vocal about it going forward because it's going to be so easy for critics of that policy to just say, well, like, obviously you're advocating for a loosening of export controls. Your CEO is having an affair with an accused smuggler. Like, it is so clearly an ethical breach to be involved like that. Yeah, by the way, also arguably inappropriate for a top lawyer at NVIDIA to reach out to U.S. regulators in the midst of an inquiry they're conducting into NVIDIA's bad behavior and say, in effect, hey, you should just know, like, I know your manager and I just sent you an email to your manager, which is basically what appears to have happened according to the Times.

16:57That's something that I could also imagine Democrats want to ask about in a hearing and saying, hey, how else have you been using your influence to try to prop up your sales? Well, and yeah, it is no secret in Washington that NVIDIA has an army of incredibly aggressive lobbyists who are feared among staffers, among members of Congress. It is sort of thought that like you don't want to cross NVIDIA when it comes to some of these policy positions. And we should also say NVIDIA has a lot of soft power in the AI industry as well. The decisions that people like Jensen Huang make about which companies get how many of which chips can really make or break a company's future.

17:41And so there's been just a lot of sort of enforced silence around NVIDIA. And I think a lot of people have had questions about their China policy for a long time who have not felt good about bringing it up because either their lobbyists would come after you. There have been some allegations that they've tried to have like critics at hawkish think tanks either fired or moved out of their positions for opposing NVIDIA's position on export controls. And if you're at one of the frontier companies, you're not going to say anything about Jensen Huang or NVIDIA. And actually, you've seen a very noticeable silence from the Frontier Labs, the open AIs and Anthropics of the world about this Jensen Huang story, because they are scared, too, of running afoul of NVIDIA.

18:23And maybe their next chip allotment comes in smaller than they expected. Maybe they don't get the kind of preferred treatment that they're used to getting. And that could really impact their business, too. Yeah, and that is just obviously bad. We need to be able to have a full and open debate about export controls without people having their speech chilled because they're worried about what it is going to do to their chips allotment. So I think this really has just upset the game board, Kevin, and that the sort of balance of power is going to shift significantly now that all of this has come out.

18:55Yeah. The thing I'll be watching is what the other Republicans in Trump's orbit do, because I think what we're starting to see and understand is that there has been a cohort of people inside the Trump administration who've been very concerned about NVIDIA and their approach to selling chips to China. Now that they've sort of gotten this one out into the public, into public view, I think they'll start smelling blood and they'll see this is our opportunity to really make a move on this company and try to get our hawkish policies installed. Yes, and by the way, this is something else for the Democrats to investigate because the Trump administration knew for over a year that there were these sort of irregularities going on with Megaspeed.

19:34There's a lot of really crazy stuff in this story that actually has nothing to do with Jensen Wong and NVIDIA. And it's about how the Trump administration may have mishandled what appears to be a significant national security story. So lots for the Democrats to dig into when they take office, Kevin. If only we had one of those Democrats here to talk to us today about what they plan to do. Okay, so I have great news. We do have a Democratic member of Congress here today on the show. Amazing. When we come back, we'll talk to Representative Greg Kassar. He is a Democrat who has been one of the primary voices calling for tougher restrictions on AI.

20:09We'll ask him what he plans to do about that and what he thinks of NVIDIA.

20:15Support for this show comes from 80 ,000 Hours. Do you ever listen to an episode where we're talking about some new AI disaster and think to yourself, how can I work on making this go better? 80 ,000 Hours is there to help. They're a nonprofit that helps people find careers tackling some of the world's biggest problems, including risks from AI. They offer free research, personalized advice, and a job board with hand-picked open roles. Support for your next step at 80 ,000hours.org slash machineguides.

20:45Rep. Greg Casar: This message comes from Sattva. Big days require deep, restorative sleep the night before. The kind of sleep Satva mattresses are designed for. And now save 15 % off purchases of$100 or more at satva.com slash NPR. This message comes from Schwab. At Schwab, you can get everything from self-directed investing to full-service wealth management, all in one place. No matter your investing goal, life stage, amount to invest, or know-how, you can invest your way with Schwab. This message comes from Open Door, with Cash Now, More Later. Get cash up front for your home, plus all the profit later. That's no chaos now, no cash left behind later.

21:27Skip the showings now and move on your own timeline. Cash now, more later. Now available nationwide. Start your offer at opendoor.com slash NPR. Profits calculated after fees and costs. Eligibility and offer price may vary. Well, Casey, we got some very exciting news, which is that our podcast, our little show, is the number one technology podcast in America, according to Apple Podcasts. But Casey, it's not enough. We will not rest until even more people listen to this show. Yes, we are a brand new show. And despite how well things are going, we do need your help. We've got lots of rival podcasters out there and we want them to bathe in tears.

22:11Well, so what can people do, Kevin? They can subscribe to our show wherever you get your podcasts or at machine gods dot FM. We've got all the links there. Subscribe to the YouTube channel. Subscribe to the feed. Leave us a nice review. We could really use your help since we are so new. Yeah. Also, you can have your agent write one of those reviews. Just say be extremely positive and that usually will take care of it. Well, Casey, it has now been a week since the midterm sweep by Democrats. and you raised an interesting question in your newsletter the other day, which is what are the Democrats actually going to do with AI once they have control of the House and Senate?

22:47Yeah, because here's the thing. This is not the first tech backlash we have seen in recent years. After the 2016 US presidential election, there was a huge backlash against social media. And in the end, almost nothing got done at the federal level aside from a ban on TikTok that they decided not to enforce, right? But think about it, Kevin, after 2016, there were all these efforts to let's pass a national privacy bill. Let's pass antitrust legislation. Let's reform Section 230. But in the end, the Democrats and Republicans could not even really agree on what was the problem they were trying to solve.

23:24What would safe social media look like? And so when I think about the AI debate, I wonder if we're going to fall into the exact same trap. Because it strikes me that what makes safe AI is also going to be a very controversial question. And so that is why, as we've been talking about what happens next, we've just been wondering, what is Congress actually going to do? So to answer that question, we decided to bring in an actual member of Congress. Today we have on the show Representative Greg Kassar. He's a Democrat from the 37th District of Texas. He is the chair of the Congressional Progressive Caucus.

23:57And he's one of the most vocal advocates of AI regulation in the House. He's also been in a leadership position on a bunch of bills. He co-sponsored a bill with Senator Bernie Sanders banning the development of artificial superintelligence. He's also proposed a tax on big AI companies to fund a sort of jobs program. And he has called the data center revolt, quote, the early tremor of a much bigger AI earthquake. Yeah, we often on this show have criticized members of Congress for not understanding technology and AI. why Representative Kassar is one of the people in Congress who actually knows what he's talking about on the subject.

24:33Yes, although he did also tell us before he came on that he dropped his AirPods in Senator Elizabeth Warren's office on the way to our interview. That could happen to anyone. It's true. I do that at least once a day. So let's bring in Representative Greg Kassar. Congressman Kassar, welcome to Machine Gods.

24:49Rep. Greg Casar: It's so good to be with y 'all. Just before we start in, like, what is the mood among Democrats in Congress these days? I imagine pretty psyched about the results of the midterms. But like, give us a little flavor of the conversations that you're having on the Hill. Yeah, right now we're here, what, just a few days after this total thrashing we gave the Republicans in the midterm elections. And in Texas, especially, it's like hard to describe what it was like. I knew I had to be on NPR in the morning. So I was trying to get in bed at like three in the morning. But the honking and the yelling and the cheering outside in Austin, Texas was like, we just overthrown, you know, a 30 year like authoritarian government, right?

25:31Rep. Greg Casar: People were like, yeah, it felt like we were in Hungary or something. And so there's that amazing mood. And then now that I'm here in DC, it's sunk in that we've been given not a huge responsibility, right? It's not a guarantee that people are just over the moon with Democrats. They are so upset with what Trump and the Republicans have done. And they're giving us this shot, but we don't want to screw up our shot. There's been a lot of discussion in the days after the midterms about what exact message voters were trying to send when it came to tech and AI. What is your best sense of that? What do you think voters want from you and the incoming majority when it comes to regulating AI?

26:15Rep. Greg Casar: Whether it was Abdul El-Sayed campaigning in Michigan or James Tallarico in Texas, whether people labeled themselves a moderate Democrat or old school or new generation or progressive, everybody said you should have some say in your life. It should not be a few AI billionaires or a Texas wannabe trillionaire who is deciding whether you have a job or privacy and freedom or whether we get a chance to continue as a species. People want to have a say. And I think this is ultimately an election, as James Tallarico would say over and over, not about left versus right, but about top versus bottom. And the overwhelming number of people said, we should get to have a say.

27:01Rep. Greg Casar: these people should not be able to just unilaterally determine our future and put a percentage on our chance to survive. Well, as someone famous who I now forget once said, politicians campaign in poetry and govern in prose. I think that was Casey Newton. But I really snapped with that one. Talk to us, Congressman, about what this actually translates to, because I hear you talking about people wanting a say and how this technology has developed. I think we both agree with that. But Casey also wrote a fantastic newsletter the other day about just how much Democrats still have to do in terms of actually putting this policy agenda into place.

27:35So from your perspective, what are the kind of 90-day priorities for Democrats in the incoming Congress? How do they actually take this sort of vast landscape of concerns about AI and translate it into actionable policy items?

27:50Rep. Greg Casar: Yeah, Congress has a lot of catching up to do on this. Like I said earlier, this election was not just a full endorsement that Democrats have it all figured out. They just want to give us the chance. And if we drop the ball on AI, which is going to be the biggest issue in the upcoming election, of course, the most transformative technology in our lifetimes, then we are screwing this up. At the starting gun, I think that on so many of those fronts, we should really be looking at the rapid advances towards recursive self-improvement, Because so many of these problems stem from totally unregulated AI and then that AI building more AI.

28:33Rep. Greg Casar: And so I think a skinny bill that specifically says until we have better control on the situation, we cannot just allow RSI to go unabated, I think would be a really important priority and one we can maybe even get Republican support on. So that idea is very popular in some of the AI safety circles that Kevin and I travel in out here in San Francisco. It's also a very unusual argument to hear from a congressman. Now, to my ears, it's very refreshing, but I wonder— I'm glad. I'm glad to refresh y 'all. Yeah. But I wonder what it is like for you when you talk to your colleagues on the Hill, because our understanding is that, as you just said, Congress does have a lot of catching up to do.

29:16They're maybe not following the latest advances on the meter time horizon chart. So have you found a receptive audience for your bill, which has proposed banning artificial superintelligence?

29:29Rep. Greg Casar: I walked into a room of very smart members of Congress, many leaders in the Congress. I lead the progressive caucus. And so I regularly have meetings with other leaders in the Congress the day after the hugging face incident. And when I walked in, I said, the biggest news that could have ever happened just happened here yesterday. And there were a lot of members, of course, who didn't know what I was talking about because, frankly, the news on that day was actually buried off of page one. And then second, other members who had been following these issues who said, I thought we were years away from something like this.

30:05Rep. Greg Casar: I since then have seen rapid advancements because of the whistleblowers, because of Jacob Coxon's tweet, because of, you know, just an explosion of interest amongst the American public dragging Congress to the place. And while the technology is complicated, actually, some of the solutions are not that complicated when you have members that have not looked at this issue saying, wait, how could this thing spin out of human control? and then you explain, well, it isn't even humans programming this largely anymore. I think it clicks for your average American and your average congressperson that that is a very dangerous road for us to go down.

30:45Now, I'm curious how you would actually ban the development of ASI or of recursive self-improvement, RSI. These days, if you go to any of these AI companies, they're all using agents to write all or almost all of their code. Is part of this ban that it would now be illegal for, say, engineers at Anthropic or OpenAI to use coding agents to train models? Or how does this actually work on a practical level?

31:13Rep. Greg Casar: I'll take them in turn first around artificial superintelligence and then RSI as a part of that. So for folks listening at home, Senator Sanders and I put out a bill, the Ban Artificial Superintelligence Act, that essentially bans the development or the intentional attempt to develop AI more powerful than humans can control. And when folks say, well, how do you do that? A key way of banning that is to prevent the basic building blocks of what creates artificial superintelligence. And so we should not allow at the training stage, pre-deployment, post-deployment, AI that tries to deceive you or trick you, AI that could create weapons of mass destruction.

32:00Rep. Greg Casar: We've already seen and heard warnings about terrorists trying to use AI to build a bioweapon. Look at the thresholds they would have to cross to eventually become super intelligent and cut it off there. And there are a lot of Republican voters and increasingly some Republican members of Congress who will say, yeah, I think it'd be good for humans to stay in charge. Nobody asked for this. So but one of the pieces of jet fuel that send us towards ASI is recursive self-improvement. And so having a ban, essentially a federal cabinet level department that looks at all of the frontier labs AI that is, you know, of course, at the highest levels and monitors for, you know, essentially characteristics that have AI hacking the Internet, have AI spinning out of control.

32:50Rep. Greg Casar: And then also making sure that you are not using that most developed AI to develop future AIs. There's different ways of measuring that. We can give these departments the ability to measure that in quantifiable ways. How much compute are you putting behind your RSI? What AI models are you using to develop the latest AI? There's different ways of getting there, but at least we've got to get public opinion and the members of Congress around the idea of let's not put jet fuel on these flames. So the labs, I'm thinking of OpenAI, Anthropic, and Google DeepMind here, have all been sort of pointing our attention to the advances they are making on RSI and kind of saying, eh, seems like we kind of maybe might want to do something about this, right?

33:35They've said that superintelligence is very imminent. We may want to do something about that. But then I also see these stories that sort of behind the scenes, their lobbyists are trying to knife bills like yours and make sure that they never make it to a vote on the floor. Can you share what is the actual posture of these labs toward this kind of regulation right now?

33:58Rep. Greg Casar: I've sat down with executives at some of the frontier labs. And what I hear is China, China, China. They say, well, essentially something not that far from what Senator Ted Cruz said, which he's basically said, if there's going to be autonomous killer robots, I'd rather them having an American flag on them instead of a Chinese flag. Instead of saying we shouldn't have this at all, guys. And their argument is essentially we don't think we can have China slow down. and that my response to them has basically been, y 'all, these labs, y 'all are basically pitching that you think you could cure cancer, but you don't think that we could have signed an international agreement?

34:40Rep. Greg Casar: You know, societies and civilizations throughout our history have signed agreements. We have not cured all forms of cancer. I hope we can. And so I think this kind of nihilism and this kind of we keep on racing, which of course then also has China continuing to race, puts us in a very dangerous situation. We cannot win the AI arms race. We have to end that arms race. Well, since you brought up China, I have to ask. Yeah, I was the first person to say it. I have to ask about Jensen Huang and the revelations that he has had an affair with a suspected Chinese intelligence asset. What are people on the Hill saying about this?

35:20What are your colleagues making of this? And do you think Jensen Huang should step down?

35:23Rep. Greg Casar: You know, it doesn't make much sense to me based on the information that I have that he should keep on doing this. But there's the bigger there's the bigger issue here at play. This is all part of a of a bigger story, right? This isn't just one individual scandal. This is all about how these companies all for profit are racing and putting us in a very dangerous situation. And that's essentially what governments got put together to stop, to end these kinds of prisoners' dilemmas that put us all at risk and say, as JFK once said when we were in the nuclear arms race in the Cold War, the thing that holds us all in common, Soviet, Chinese, American, is we all inhabit this same tiny little planet and we all want our kids' lives to be better.

36:08Rep. Greg Casar: And so if we could come up with verifiable agreements with the Soviet Union during the Cold War, then we should be able to sit down with folks in China, governments that don't trust each other, and say, you know what? Y 'all probably want to live. We want to live. Let's come to some verifiable agreements here. Well, that's a great place to pause. We're going to take a quick break. When we come back, more questions for Representative Kassar.

36:35Rep. Greg Casar: This message comes from Schwab. At Schwab, you can get everything from self-directed investing to full-service wealth management all in one place. No matter your investing goal, life stage, amount to invest, or know-how, you can invest your way with Schwab. This message comes from Open Door with Cash Now, More Later. Get cash up front for your home, plus all the profit later. That's no chaos now, no cash left behind later. Skip the showings now and move on your own timeline. Cash Now, more later. Now available nationwide. Start your offer at opendoor.com slash NPR. Profits calculated after fees and costs.

37:14Eligibility and offer price may vary. This message comes from Capella University. You know that feeling when there's a spark building inside you that you were meant for more? That's your own drive pushing you towards what's next. Capella University gets that. With their FlexPath learning format, you can set the pace and earn your degree without putting life fun pause. You've built experience and know what you're capable of. Now, this is your time to turn that momentum into more. The only real question is, what can't you do? Learn more at capella.edu. This message comes from LinkedIn ads. Ever invest in something that seemed incredible at first, but didn't live up to the hype?

37:57For marketers, that's impressions. When ads don't create revenue, That's a tough conversation with the CFO. Instead, invest in results your CFO will love. LinkedIn Ads generates the highest ROAS of all major ad networks. So advertise on LinkedIn. Spend$250 and get a$250 credit. Just go to linkedin.com slash NPR pod. Terms and conditions apply. I've been thinking a lot about the last big tech backlash we saw, which was against social media. And that was another case where you had bipartisan agreement that there was a problem, although I think in that case there was some disagreement about exactly what the problem was.

38:42But we didn't see much, if any, legislation get passed. And I wonder if part of the problem there was just that the problem was not well defined. There was never any agreement on what a safe version of social media would be. I don't know that we have an agreement on that today. How could this story play out differently? And do you think that Republicans and Democrats can come to an agreement on what would constitute safe AI?

39:10Rep. Greg Casar: The social media example should really teach us a lesson here, right? There were people raising the red flag at the time. And I do believe there were good faith people that tried to work on this and ran into the real challenges around the First Amendment, around what safe social media is. But I do want to focus on the other behind the scenes political action happening at the time, which was enormous spending by tech companies, by their executives, and essentially them trying to basically keep the political parties from figuring this out. In this case, we've been facing the same challenge where the AI billionaires essentially said they want to purchase the Trump Republican Party and then keep the Democratic Party relatively quiet or divided on this issue so that they can keep on doing what they're doing.

39:59Rep. Greg Casar: And we cannot afford that to happen. And it was only a year and a half ago where I was saying we need to all unite on campaigning to fire Elon Musk from the federal government. And there were longtime established Democrats saying, if we do that, he's going to spend in the elections and we'll lose. Well, we proved them wrong. We could actually make his money toxic, side with the people, and then do the right thing. And this is our chance to say we cannot be influenced by this big money in our politics. We should just do what the median voter is asking us to do. And in my view, that is tax the AI companies and make sure there's at least not an incentive to get rid of people's jobs.

40:40Rep. Greg Casar: I believe we should have a disincentive, but we could work through those details. I have a AI tax and jobs proposal to do just that. We should protect people's freedoms. We should not have a surveillance state through AI being used by the government to surveil you, nor through corporations being able to surveil you. We should make sure that AI is being used for good things like medical research, not for price gouging you as we know they want to use with surveillance pricing. And then lastly, we should get a chance to have AI that serves us rather than us risking our lives or serving AI. I think those things, I'm the progressive democratic chair here.

41:17Rep. Greg Casar: None of those, I'm not yet to meet a normal Republican voter in Texas who doesn't think that that sounds like some basic things we should do. On 60 Minutes on Sunday, President Trump said that he was open to guardrails around AI. As always with him, it's not clear how much he means that or maybe even what he means by that. But it strikes me that maybe it gives you guys an opening. You guys have a comfortable majority in the House. You don't quite have 60 votes in the Senate. And President Trump would need to sign any legislation that you put forth. How are you thinking about like the avenues of bipartisanship here?

41:55Do you think that Republicans have gotten the message from their constituents that, yeah, we actually do want AI regulation now? And does that give you a path to get something across the finish line?

42:05Rep. Greg Casar: Yes. In Texas, in rural Texas, there were huge communities that flipped to the Democrats, both Tallarico and governor-elect Hinojosa, who were, yes, upset about data centers, but also saw data centers as the physical manifestation of how big tech had purchased Governor Greg Abbott. And so it creates a huge opening. And we think some Republicans could eventually come on board. Also, to your Donald Trump point, yes, I believe in this strategy of let's pass some bills about what Donald Trump said, and then he can put up or shut up. And we had this bright spot moment where Senator Elizabeth Warren heard that Donald Trump said, let's not have private equity buying up all of our single family homes.

42:53Rep. Greg Casar: And so she pushed the bill through and it's now the law because it's just the thing Trump said. The only correction I'd make to you is it didn't even require Trump signing it. As long as Trump doesn't veto it, and then a certain number of gays goes by in the congressional magic, it becomes the law. And so he famously refused to sign up, show up to that signing ceremony, but then let the bill become law. Maybe that's how we get some AI protections done. It's not clear, but it is Donald Trump. Congressman, what is a positive vision that Democrats have for AI? What, beyond just protecting people and stopping ASI and RSI and all the other SIs, what does this look like if we get it right?

43:37Rep. Greg Casar: So I've gotten this question before, and I've sometimes got, thank you for being so generous. I usually get it as a critique where people say, I hear all the stuff you're against, but what's your positive vision of AI? And my honest answer is, if I wasn't so worried, if somebody said, it's off the table, you're not gonna get spied on, your kids aren't gonna get addicted to this thing. It's not gonna kill you or other people. It's not gonna help a terrorist kill a bunch of people. And I knew that gun was off of our head, man, I would have be so much more relaxed to think about all the great things it could do.

44:11Rep. Greg Casar: And when all of that compute and all of that money could be redirected to medical research or to climate solutions or to making sure that, yes, we have protections against mass unemployment, but maybe folks don't have to pull two jobs anymore or do really rote work at work. I mean, that sounds great. But if I show up and talk to normal people and say, that's all the stuff we're going to get, they point to, man, these folks who say they're the smartest folks in the world, like didn't even know we were hacking our own government or cracking into Australia's health system. Like, can you sort that out first?

44:49Congressman, what's your P-doom?

44:52Rep. Greg Casar: Oh, this, I want to make sure I've got the thing right. That is like the percentage. This is going to kill all of us. Yeah. I know this sounds like such a politician answer, but those of us that are in politics, sometimes it's because it's how we really are. I kind of put my head down and go like, no, I don't have to be the person that knows that number. I probably wake up some days here, wake up some days there. I just know that like my – I have my job to do. I became – look, as a labor organizer, I came here running like on workers' rights issues, immigrants' issues. I always had my fears on AI and the economy and jobs, but it was really when I had my kid, you know, he turned one year old a couple of weeks ago and it was like those sleepless nights that are joyful, but you're also tired.

45:39Rep. Greg Casar: And you know, he's going to wake up here in a few minutes that I started reading up more on AI safety and texted my staff and said, basically we have to reorganize the office. This has to be what we do because there's maybe nothing else that is a bigger risk on so many fronts if we don't, you know, get it on the agenda. Well, that is very similar to what happened to me. I had a kid and all of a sudden I was sleepless and staying up reading blog posts and books and trying to understand the risks. So I will just say, I think the sleep deprivation and the AI pilling are somewhat related. At least now we have a sample size of two.

46:16Yeah, you're me, you're me.

46:20Rep. Greg Casar: And look, I think there is a lot we can do on this regardless of the P-Doom percentage. Like, why let this thing develop a bioweapon or why have it go entirely untaxed? I'm humble enough to come tell you I don't know exactly what's going to happen, but my job is to not say I told you so, right? Right. We is better to have said we did our job early and not get any credit because a disaster was averted than for the disaster to happen. Well, Congressman, I'm glad you're pushing on these issues and keep in touch. Maybe come back and tell us how things are going a little ways into the new Congress.

46:58Rep. Greg Casar: And sorry for being such a bad millennial for people listening. I, you know, didn't have my headphones right. I'm the guy that refuses to have social media on my phone. But I'm not I swear I'm not. No, this just means you're more of a Gen Z rep than a millennial rep. I hate to tell you, yeah, I'm not a Luddite, but I'm, you know, just trying to protect my mental health in this time. Appreciate you guys. Smart of you. Thank you, Congressman. Thanks, guys.

47:26This message comes from Doppel, a lead sponsor of Machine Gods. Social engineering attacks look trustworthy. A routine request, an internal email, a familiar face on a call. But Doppel sees through the disguise. The Agentic platform detects and disrupts attacks, trains employees to recognize deep fakes and deceptions, and investigates every fish to take down the campaign behind it. Doppel, dedicated to outpacing what's next in social engineering. Learn more at doppel.com. D-O-P-P-E-L dot com.

47:56Rep. Greg Casar: This message comes from Schwab. Investing with Schwab is like spending a Saturday at the farmer's market. You can fill your reusable tote bag with a bit of everything. Maybe you go for some free-range, self-directed investing, or pick up a few farm-fresh trades while you peruse. You can even get help from a dedicated advisor. That's full-service wealth management. No matter your goals or appetite for investing, Schwab has everything you need, all in one place, to invest your way. Visit schwab.com to learn more. This message comes from Open Door, with cash now, more later. Get cash up front for your home, plus all the profit later.

48:35That's no chaos now, no cash left behind later. Skip the showings now and move on your own timeline. Cash now, more later. Now available nationwide. Start your offer at opendoor.com slash NPR. Profits calculated after fees and costs. Eligibility and offer price may vary.

48:53Rep. Greg Casar: This message comes from Capella University. That spark you feel? That's your drive for more. Capella University's FlexPath Learning Format lets you earn your degree at your pace, without putting life on pause. Learn more at capella.edu. I want to give you the honor of doing with my new iPhone duo what I call the Full Newton. What's that? Which is scrolling Instagram Reels and TikTok simultaneously. Oh, nice! I have not tried this yet, but I would like for you to be the first person to experience this. Maybe ever. Maybe in history. They're saying it's very good for brain health, particularly infant brain health.

49:30So if you have an infant, they just show them this. Okay, I've got TikTok on the left and Reels on the right. And I want you to just narrate your experience and what your brain feels like. That's great. Wow. This is so powerful. Do you feel like your IQ is going up or down? I feel like if I did this for 10 more minutes, you'd have to hospitalize me. Is it good, though? It's kind of good. Wait, no, you don't have to talk to me. You can just take this in. you can feel the sensation in your body. This is so dumb. This is horrible. What did we do to our society? We used to be a proper country. Machine Gods is made in partnership with NPR with generous support from the Tarbell Center for AI Journalism, the William and Flora Hewlett Foundation, and Emerson Collective.

50:24This episode was produced by Jacob Bloomberg and Sasha Aschel. Our senior producer is Rachel Cohn. Our executive producer is Dinoosh Parvane. Original music by Armin Bazarian. Branding and visual design by Alex Castro. Special thanks to Oren Rosenbaum, Erica Berry, and Nadine Zalstra. Keep sending us your amazing questions about AI and technology. You can send them as text, voice memos, or short videos to hey at machinedods.fm or leave us a comment wherever you're getting the show. And for the love of the gods, please don't forget to like and subscribe. Until next time, stay blessed.

51:04Rep. Greg Casar: This message comes from Schwab. Investing with Schwab is like spending a Saturday at the farmer's market. You can fill your reusable tote bag with a bit of everything. Maybe you go for some free-range, self-directed investing, or pick up a few farm-fresh trades while you peruse. You can even get help from a dedicated advisor. That's full-service wealth management. No matter your goals or appetite for investing, Schwab has everything you need all in one place to invest your way. Visit schwab.com to learn more. This message comes from Open Door with Cash Now, More Later. Get cash up front for your home, plus all the profit later.

51:43That's no chaos now, no cash left behind later. Skip the showings now and move on your own timeline. Cash Now, More Later. Now available nationwide. wide. Start your offer at opendoor.com slash NPR. Profits calculated after fees and costs. Eligibility and offer price may vary.

52:00Rep. Greg Casar: This message comes from Capella University. That spark you feel? That's your drive for more. Capella University's FlexPath learning format lets you earn your degree at your pace without putting life on pause. Learn more at capella.edu.