Who gets to pull the plug on AI?

0:00Aria Finger:Reid, thank you so much for being here in New York to film this Reid Riffs. Great to be in person always when we're chatting. So let's dive right in. The Financial Times recently reported that big tech is using guarantees to keep roughly$300 billion of AI exposure off its balance sheet. And the basic arrangement is that separate companies take out loans to build data centers or buy chips and have separate agreements with tech companies to cover losses if things go wrong. And so this helps finance the build out, but it means that people from the outside can't really see the full risk that's happening.

0:33Aria Finger:And when you look at Alphabet, they alone doubled their exposure under these credit backstops in six months from about$17 billion to$44 billion, while recording a liability of just$815 million. dollars. And so this might be a smart way to finance data centers, which you and I probably agree that we need to finance the AI revolution. Or this could be companies that are taking on much more risk than they should and obscuring it from the government, the American people, etc. What do you think about this way that we're financing? Well, so I think there's two different issues here. So one issue is taking the risk, which I think they should do.

1:11I think it's worth it. I think intelligence at the scale and cost electricity applied to a whole wide variety of things is a good thing. And yes, there might be, it's not guaranteeing that every dollar will be efficiently spent or effectively spent because, you know, when does the revenue exactly come in? And at these numbers, you get worried that if it's, call it four years versus two years and that kind of thing, and there's some legitimate kind of financial aspects. Now, there's the other thing, which is the lack of transparency, which is almost always a bad thing because it's kind of like if you're hiding something, why are you hiding it?

1:45And so people should be, like, in a sense, like my recommendation would have been if you said, look, we need to do this kind of legal structure because we want to still be reporting our books. Because there's weird things about how expenses and other kinds of things come on the books. And people say, oh, you should be doing stock charges as expenses. And there's all this stuff. You say, look, we want to report our books legitimately, legally, this way. And so we're going to do that. And so we'll do these deals. But we're going to tell people that were doing these deals so that they're aware of them.

2:15I mean, it's just kind of always in the case of when you're hiding something and you're obscuring something, like that's mostly a very bad thing. Why are you doing that?

2:28Aria Finger:And so, I mean, we talked about this last week. AI has sort of broken containment from a news perspective. Now everyone's talking about it. Everyday people, we're talking about different things. And it's even reached the government and the president. I will just start with that. And so very important question, Reid, and I will not be doing any impersonations. Many people think that the words artificial intelligence are inaccurate and very ineloquent relative to AI or artificial intelligence. A far more elegant and accurate description of this new phenomena would be superior intelligence, SI, or extreme intelligence, EI, or supreme intelligence, SI.

3:05Aria Finger:This is a poll, and I would appreciate everyone voting. What do you think is the best name for this ever-growing revolution? Well, what I put in impromptu and super agency is amplification intelligence, right? Because I'm very focused on how it helps human beings in terms of how it operates. Now, in terms of that truth social tweet, it neglected natural stupidity or some other things as possible answers. And so, but I think that the real question, and by the way, if I were really picking a term that I actually probably more like than artificial intelligence, it'd be synthetic intelligence. Oh, interesting.

3:48Right, because part of this synthetic intelligence is to, it's kind of like, it's not artificial, it's real intelligence, but it's being constructed in various ways. And artificial has weird echoes in human language. It's like artificial sweetener or, you know, and it's like, you know, and it is artifice, right? So that thing, but it's kind of got a negative connotation that I think is broadly unhelpful.

4:21Aria Finger:And I think it also keeps some of the connotations that we were talking about that we're not trying to mimic humans. We are not trying to replace humans. And we are not we are trying to create an intelligence that will augment, amplify, help us do our jobs. But again, the you know, a lot of people, especially in Silicon Valley, it's like, let's just build this. We don't want to deal with government. We don't want to deal with politics. Let's just, you know, bring about the future through technology. But this is a time when we're going to have to have politicians in Silicon Valley sort of come together for these new rules.

4:49Aria Finger:And so on a more serious note, the AI debate in Washington. That wasn't serious. Anytime I quote Truth Social, you know I'm not exactly thrilled. Trump did say a few weeks ago that he'll appoint a new AI czar and stand up an AI force modeled on Space Force. And Trump dismissed safety concerns as a hoax, as he does with pretty much everything in everyday life. And he promised that the White House won't hinder growth. I mean, you and I agree with that. We don't want the White House to hinder growth either. But is he missing something crucial? Like, what do you think of Trump's play here, calling AI a hoax and saying, you know, he won't regulate or anything on the federal level?

5:32Look, I think there are some good limited regulations that can be done on the federal level. I think the likelihood that you will get any regulations and then followed by good regulations are very low in this administration. because I think that when you look at freedom coin and planes as gifts and so forth, those whole range of things, more stock trading than the entire Congress combined and all the rest of this stuff, I don't think there's going to be any play here other than things that are self-enrichment. So I don't think there's going to be a concern for, well, how do we slow down terrorism or how do we make businesses safer or how do we make your average American safer, all of which would be the kinds of considerations of what you do.

6:23I think the previous AI czar was trying to kill every single regulation that was actually internally the various cabinet secretaries and so forth were trying to do. So my guess is that will be the same thing as the new A.I. czar will probably be that. Although, you know, maybe they'll appoint Buzz Lightyear as the A.I. czar, and, you know, it'll be to infinity and beyond, you know, as kind of, as a way of doing this. And that would at least be a friendlier, kinder one than previous. And so, you know, I think that very little will happen there. Now, you said, well, what kinds of things should happen?

7:04And, for example, some of the simple things are, I think since we have uncertainties, having a kill switch is a good idea. I think having a kind of smart auditors looking at the stuff you're doing. And I think part of what Dario and Sam have been calling for is, hey, there's not only the old auditors, which you could still use in various things, but there's new auditors who have a much more deep technical sophistication that can be kind of reporting on what you're doing. I think that's a good thing. I think, for example, an international treaty on cyber would be a very good thing and apply that to AI.

7:38Now, you probably want... Most people don't realize how much... We're in a state of cyber warfare constantly. Most people don't realize that because most of it's economic... Well, it's either anti-economic, anti-government. Neither of those two want reports as to what's happening. And AI is only going to intensify that, and that's going to be intensified through open-weight models. Matter of fact, reports I'm seeing is already seeing that intensifying through those. And so I think there's a whole bunch of good things that could be done in theory. But the theory likelihood of any delivery in a griftocracy is very low.

8:16Hey, y 'all. Master to the Scale Summit returns October 20th to 22nd in San Francisco. If you've joined me at Summit before, you know how different it feels from other business or tech conferences. Van Jones calls it the highest concentration of heart with smart you're ever going to find. Every element, the line of speakers, the curated audience of founders is designed to spark ideas that transform your business. You'll see people you know from possible. Reed Hastings, Amjad Massad, Kara Swisher. Take the summit stage live alongside leaders like Nobel Laureate Maria Ressa, Walmart's John Furner and Cloudflare's Matthew Prince.

8:53Be in the room this year and walk away feeling it's possible to scale your next great idea. Join us. Visit mastersofscale.com slash summit to learn more.

9:05Aria Finger:I think many people think that, you know, regulation at the federal level is better than having a patchwork of state regulation. But like you said, if we're not going to get it at the federal level, I think we are going to see states come forward and say we have to regulate this technology. You mentioned a kill switch. You mentioned outside auditors. And actually, Governor Newsom recently signed an executive order giving state officials until November 16th to recommend whether California should require a kill switch for frontier models, embed these independent auditors in the largest labs, and expand incident reporting.

9:36Aria Finger:And so a lot of the things that you're talking about that you would seem to want, Governor Newsom also vetoed a bill with these nearly identical provisions, some differences, in 2024. And so California is now trying to mandate the thing that Dario asked for. He asked for this kill switch, and yet Newsom vetoed this two years ago. So where do you stand? Are you in favor of this new bill? And why were you potentially opposed to it a few years ago? So I was opposed to it a few years ago. There were actually some other provisions in that, like, for example, you must validate that it has no negative impacts.

10:11And that validation was also squishy. Like, well, what negative impacts? Do you mean like one person might run into something, five people, et cetera? And who litigates that and how is that interpreted? And are you just going to create full-time employment for all lawyers in the state and maybe in all the states for a long time in doing this? Like all of that kind of stuff, which is part of the reason that earlier bill was not a good bill. And I think that's probably I don't think Gavin has probably changed his mind a lot. I think he pays a lot of attention. He does learn. And if it were like he signed another bill even before this, where it's like, look, data is good.

10:53Auditing is good. Killswitch, obviously a good thing to add in. But you have to be, in order to not be just massively restrictive on the whole industry, you have to be precise about what kinds of things you're doing. You have to not make a, hey, we'll just sort out all the ambiguities in the courts is not the way that one should almost ever do policy, legislation, regulation, et cetera. And so I think that's the difference between them. And I think that part of the, you know, I know that from discussions with Gavin, I know that he actually, in fact, regularly calls like many of the tech companies and says, explain X, explain Y, what's going on here?

11:35Why do you think this? Because he's trying to navigate in his own way the thing I was kind of calling for in a dual mandate, which is how do we be successful with AI? And as governor of California, how do we help California be responsible, but also help all of its businesses and people? And so doing that, it's kind of that question is the thing he's trying to navigate. And I think when, like in the previous bill, Anthropic was supportive, but most of the other people weren't. I think in this one, more of the other people were like, okay, that's now gotten sharper. That's now implementable while we continue to develop and deploy services.

12:14And so I think it has a much broader base of support.

12:16Aria Finger:I mean, I think in every industry you have to, you know, you always worry about the regulators getting too close to the companies they're trying to regulate. But I'd say that especially with AI, we need our politicians and our regulators to actually understand the technology. And so for them being in conversation with Dario and Sam and the heads of the other labs, it's really positive because we need to get this regulation right. Yeah. And so, one, you talk to multiple companies because the companies are competing with each other and have different points of view and so forth. Then you say, well, but there are some things where the whole companies have a collective interest that a blind spot they're missing.

12:47And that's part of the reason why you talk to NGOs and you talk to universities and so forth. And you should have all of those conversations. And I know that Gavin is actually having them because I've also seen him show up at Stanford and talk to professors. And part of how I met Gavin the first time was he's literally like, I'm curious about what's going on in tech investing. And he literally came by our offices at Greylock to say, I want to talk to you about this because I want to learn about what you guys are doing. And that's obviously the kind of leader is like, hey, I want to learn about this.

13:16And I'm always much more sympathetic, even in cases where I disagree. It's like, I'm trying to learn. I'm trying to understand. I'm not just grandstanding. And people will not be surprised. That's a small number of politicians who have that intellectual curiosity.

13:32Aria Finger:Reid, thanks so much for being here today. Well, and thank you as well. Always fun. Possible is produced by Pallet Media. It's hosted by Ari Finger and me, Reid Hoffman. Our showrunner is Sean Young.

13:53Possible is produced by

13:54Aria Finger:Special thanks to Surya Yalamanchili, Sayida Sepieva, Ian Alice, Greg Beato, Parth Patil, and Ben Rallis.