Democracy in the Age of AI (1/5): How AI could hack democracy | Lawrence Lessig

0:00Hey, it's Sherrell, host of TED Tech. Election season is here and this year there's a new player on the ballot. So I put together a playlist of talks around one urgent question. What happens when AI gets a vote? You'll hear how AI could hack the system we use to govern ourselves. Who we can trust when reality itself can be faked. Why your creativity might be one of democracy's best defenses. how we can govern a technology no one can fully predict, and how AI and democracy could actually fix each other. The stakes are real and the clock is running. So I hope you get as much out of these talks as I did.

0:48Today, we're diving deep into the heart of a chilling paradox. How the very tools that promise to connect and enlighten us could also be eroding the foundations of democracy. AI obviously comes to mind, but this isn't just a story about the dangers of any specific tech. It's a story about human vulnerability, about the ways in which our own biases and desires can be weaponized against us. And it's a call to action, a plea to find ways to protect ourselves from this invisible threat before it's too late. This is TED Tech, a podcast from the TED Audio Collective. I'm your host, Sherelle Dorsey. Today's speaker is Lawrence Lessig, a Harvard Law professor and political advocate.

1:40His work is dedicated to fostering a more representative government here in the U.S. In this powerful talk, he unveils an insidious threat to this mission, one that's woven into the fabric of our digital lives. Before we dive in, a quick break to hear from our sponsors.

2:13Hi there, it's Adam Grant from TED's Rethinking Podcast, and this episode is brought to you by ServiceNow. I get to spend my days studying how people think and what it actually takes to change our minds. it's work I find deeply meaningful. But even in meaningful work, there's still busy work. The admin, the repetitive processes, the invisible load that pulls attention away from what really matters. That's where ServiceNow's AI specialists come in. They don't just tell you what you should do about your busy work. They actually do it. Start to finish. Cases closed. Requests handled. No extra work for you.

2:46To learn how to put AI to work for people, visit servicenow.com.

2:53This episode is sponsored by Charles Schwab. Wouldn't it be great if life's little upgrades didn't feel like a splurge? Like getting the aisle seat with extra legroom for a one-hour flight, ordering extra guac with zero hesitation, or paying for assembly on that swing set because you'd rather spend your Saturday doing literally anything else. It's called Living Filthy Comfortable, and whatever filthy comfortable looks like to you, Schwab can help you find it with investing, trading, education, and human help all in one place. Learn more at schwab.com. Investing involves risk, including loss of principle.

3:32This episode is brought to you by Planet Visionaries, a podcast in partnership with the Rolex Perpetual Planet Initiative. What connects a hidden laboratory in the Amazon, giant pandas in China's mountain forests, research relating to the ocean, and communities living alongside wildlife in India. That's what you'll hear on Season 6 of Planet Visionaries, stories from the explorers, scientists, and conservation leaders whose work addresses research, biodiversity, and conservation issues in specific locations. Planet Visionaries, hosted by environmental advocate and professional climber Alex Honnold, brings you real stories of discovery, determination, and research and initiatives relating to environmental change.

4:12In partnership with the Rolex Perpetual Planet Initiative, This is Planet Visionaries. Listen or watch wherever you get your podcasts.

4:26And now, Lawrence Lessig takes the TED stage.

4:30Lawrence Lessig: So on January 6, 2021, my nation suffered a little bit of a democracy heart attack. thousands of Americans had been told that the election had been stolen and tens of thousands of them showed up because they believed the election had been stolen. And indeed in polling immediately after January 6th the Washington Post found 70 percent of Republicans believed the election had been stolen, and a majority of college-educated Republicans believed the election had been stolen. That was their perception. And I don't know what the right way to act on that perception is. They thought the right way was to defend what they thought was a democracy stolen.

5:29Lawrence Lessig: Now, these numbers were astonishing. 30 % or two-thirds of Republicans believing the election was stolen. But even more extraordinary are these numbers. The fact that in the three years since that astonishing event, the numbers have not changed. The same number believed today that the election was stolen as believed it was stolen three years ago, despite the fact that we've had investigations and overwhelming evidence that there was no fraud sufficient to ever change even a single state. This is something new. When Richard Nixon went through the Watergate scandal, as the news was being reported, Nixon's popularity collapsed, not just among Democrats, but among independents and Republicans.

6:19Lawrence Lessig: But we're at a stage where it doesn't matter what happens. This is Donald Trump's popularity over the course of his administration. Nothing changes. The facts don't matter. Now, I think this truth should bother us a lot. I think we need to develop a kind of paranoia about what produces this reality. a particular paranoia, the paranoia of the hunted. Think of the kids in The Birds first realizing that those crows were attacking them, or black mirrors, metalheads, when you see these creatures chasing and surrounding you. The point is we need to recognize that there is an intelligence out there to get us.

7:14Because our perceptions, our collective perceptions, our collective

7:21Lawrence Lessig: misimpressions are not accidental. They are expected. They are intended. They are the product of the thing. Okay, I want to be careful introducing the thing. I'm going to talk a little bit about AI, but I'm not going to slag on AI. I think AI is the most extraordinary technology humanity has ever even conceived of, but I also think it has the potential to end humanity. But I'm not going to slag on AI because I'm pretty sure that our robot overlord is going to be listening to these TED Talks someday, and I don't want to be on the wrong side of the overlord. So So AI is just fine. I'm not going to talk about this AI first.

8:06Lawrence Lessig: I want to instead put AI in a little bit of a perspective. Because I think that we're too obsessed with the new, and we fail to recognize the significance of AI in the old. We think about intelligence, and we're distinguishing between artificial and natural intelligence. And we, of course, as humans, claim pride of kingdom in the world of natural intelligence. And then we build artificial intelligence. It's intelligence that we make. But here's the critical point. We have already, for a long time, lived with systems of artificial intelligence. I don't mean digital AI. I mean analog AI. Any entity or institution that we build with a purpose that acts instrumentally in the world is, in this sense, an AI.

9:01Lawrence Lessig: It is an instrumentally rational entity that's mapping how it should behave, given the way the world evolves and responds to it. So think about democracy as an AI. It has institutions, elections, parliaments, constitutions, for the purpose of some collective ends. Our constitution says it's for the common good. So the democracy in our constitution is an analog artificial intelligence devoted to the common good. We're thinking about corporations as an AI. They have institutions, boards, management, finance for the purpose of making money, or at least conceived of narrowly. Today, that's the way it is.

9:44Lawrence Lessig: Their corporation is an analog intelligence devoted to maximizing shareholder value. These are AIs. They have purposes and objectives sometimes complementing each other. So the purpose of a school bus company complements the purpose of a school board to produce school bus transportation in a district. That's just beautiful. But sometimes they're competing. The purpose of a government in having a clean environment conflicts with the purpose of a coal company designing to produce electricity by spewing carbon and soot into the environment. And when they conflict, we tell ourselves this happy story.

10:25Lawrence Lessig: We tell ourselves the story that democracy is going to stand up and discipline that evil corporation. To get the corporation to do the right thing, to do the thing that's in the interest of all of us. That's our happy story. It's also a fantasy. Because at least in my country, corporations are more effective AIs than democracy. Think about it a little bit like this. If we think about instrumental rationality along one axis of this graph and time across the other, humans, of course, are the first instrumentally rational entity we care about. We're better than cows, maybe not as good as ants, but the point is we're pretty good as individuals figuring out how to do things strategically.

11:14Lawrence Lessig: And then we build democracy to do that a little bit better, to act collectively for all of us, and that's a more instrumentally rational entity than we individual humans can be. Then we created corporations. And it turns out they have become, at least in corrupted political regimes, which I'll just submit my political regime is, better than democracy in bringing about their objective ends. Now, of course, in this system, each of these layers has an aspiration to control the higher layer. So humans try to control democracy through elections. Democracy tries to control corporations through regulation.

11:55Lawrence Lessig: But the reality of control is, of course, a little bit different. In the United States, corporations control democracy through the extraordinary amount of money they pour into elections, making our representatives dependent not on us but on them. And in democracy, then controls the humans by making representation, not actually representation, corrupting representation. Now, this structure, this layer of higher-order intelligence or instrumental rationality might evoke, for those of you who think about AI, a statement by the godfather of AI, Jeffrey Hinton. Hinton warns us there are a few examples of a more intelligent thing being controlled by a less intelligent thing.

12:44Lawrence Lessig: Or we could say a more instrumentally rational thing being controlled by a less instrumentally rational thing. And that is consistent with this picture of AIs. And then we add digital AI into this mix. And here too, once again, we have corporations attempting to control their digital AI. But the reality of that control is not quite perfect. Facebook in September of 2017 was revealed to have a term in their ad system called Jew haters. You could buy ads targeting Jew haters. Now, nobody in Facebook created that category. There was not a human in Facebook who decided, we're going to start targeting Jew haters.

13:39Its AI created that category.

13:42Lawrence Lessig: Because its AI figured Jew haters would be a profitable category for them to begin to sell ads to. And the company was, of course, embarrassed that it turned out they didn't actually have control over the machine that ran their machines that run our lives. The real difference in this story, though, is the extraordinary potential of this instrumentally rational entity versus us. This massively better instrumentally rational entity versus even corporations and certainly democracies, because it's going to be more efficient at achieving its objective than we are. And here's where we cue the paranoia I began to seed, because our collective perception our collective misconceptions, perceptions, are not accidental.

14:32Lawrence Lessig: They are expected, intended, the product of this AI. We could think of it as the AI perception machine. We are its targets. Now, the first contact we had with this AI, as Tristan Harris described it, came from social media. Tristan Harris, who started the Center for Humane Technology, co-founded it, famous in this extraordinary documentary, The Social Dilemma. Before he was famous, he was just an engineer at Google. And at Google, he was focused on the science of attention, using AI to engineer attention to overcome resistance, to increase human engagement with the platform, because engagement is the business model.

15:22Compare this to, think of it as brain

15:25Lawrence Lessig: hacking. We can compare it to what we could call body hacking. This is the exploiting of food science. Scientists engineer food to exploit our evolution, our mix of salt, fat, and sugar, to overcome the natural resistance so you can't stop eating food, so that they can sell food or sell, quote, food more profitably. Brain hacking is the same but focused on attention. It's exploiting evolution, the fact that we have an irrational response to random rewards, or can't stop consuming bottomless pits of content with the aim to increase engagement to sell more ads. And it just so happens, too bad for us, that we engage more the more extreme, the more polarizing, the more hate-filled this content is.

16:18Lawrence Lessig: So that is what we're fed by these AIs. With the consequence that we produce a people more polarized and ignorant and angry than at any time in democracy's history in America since the Civil War, and democracy is thereby weakened. They give us what we want. What we want makes us into this. Okay, but recognize something really critically important. This is not because AI is so strong. It's because we are so weak. Here's Tristan Harris describing this. We're all looking out for the moment when technology would overwhelm human strengths and intelligence. When is it going to cross the singularity, replace our jobs, be smarter than humans?

17:10But there's this much earlier moment when technology exceeds and overwhelms human weaknesses. This point being crossed is at the root of addiction, polarization, radicalization, outrage-ification, vanity-ification, the entire thing. This is overpowering human nature.

17:33Lawrence Lessig: And this is checkmate on humanity. So Tristan's point is we're always focused on this corner. When AGI comes, when it's super intelligent, when it's more intelligent than any of us. And that's what we now fear. Whether we will get there in three years or 20 years, what will happen then? But his point is it's actually this place that we must begin to worry. Because at this place, it can overcome our weaknesses. The social dilemma was about the individual weaknesses we have, not to be able to turn away from our phones or to convince our children to turn away from their phones. But I want you to see that there's also a collective human weakness, that this technology drives us to disable our capacity to act collectively in ways that any of us would want.

18:29Lawrence Lessig: So we are surrounded individually by these metalheads, and we are also surrounded as a people by these metalheads long before AGI is anywhere on the horizon. It overwhelms us. AI gets us to do what it seeks, which is engagement. And we get democracy hacked in return. Now, if the first contact that we had gave us that, if social media circa 2020 gave us that, what's this second contact with AI going to produce? When AI is capable not just in figuring out how to target you with the content it knows will elicit the most reaction and engagement from you, but can create content that it knows will react or get you to engage more directly, whether true or false, whether slanderous or not, what does that contact do?

19:35Lawrence Lessig: I so hate the writers of Game of Thrones because their last season, they so completely ruined the whole series. That we can't use memes from Game of Thrones anymore. But if we could, I would say, winter is coming, friends. Well, I'm just going to say it anyway. Winter is coming, friends. And these AIs are the source that we have to worry about. So then, what is to be done? Well, you know, if there's a flood, what you do is you turn around and run. You move. You move to higher ground or protected ground. You find a way to insulate democracy or to shelter democracy from AI's force or from AI's harmful force.

20:30Lawrence Lessig: And, you know, the law does this in America with juries. We have juries. They deliberate. but they are protected in the types of information that they're allowed to hear or talk about or deliberate upon because we know we need to protect them if they're to reach a judgment that is just. And democracy reformers, especially across Europe, are trying to do this right now. Reformers building citizen assemblies across Europe, mainly in Japan as well. And citizen assemblies are these random representative, representative, informed, and deliberated bodies that take on particular democratic questions and address them in a way that could be protected from this corruption of the AI.

21:17Lawrence Lessig: So Iceland was able to craft a constitution out of a process like this. Ireland was able to approve gay marriage and deregulation of abortion through a process like this. France has addressed climate change and also end-of-life decisions. And across Germany, there are many of these entities that are boiling up to find ways for a different democratic voice to find voice. But here's the point. These are extraordinarily hopeful and exciting, no doubt. But they are not just a good idea. They are existential for democracy. They are security for democracy. They are a way to protect us from this AI hacking that steers against a public will.

22:09Lawrence Lessig: This is change not just to make democracy better, a tweak, to just make it a little bit more democratic. It's a change to let democracy survive given what we know technology will become. This is a terrifying moment. It's an exhilarating moment. Long before superintelligence, long before AGI threatens us, a different AI threatens us. But there's something to do while we still can do something. We should know enough now to know we can't trust democracy just now. We should see that we still have time to build something different. We should act with the love that makes anything possible. Not because we know we will succeed.

23:07Lawrence Lessig: I'm pretty sure we won't. But because this is what love means. You do whatever you can. Whatever the odds for your children, for your family, for your country, for humanity, while there is still time, while our robot overlord is still just a sci-fi fantasy. Thank you very much.

23:41That was Lawrence Lessig at TEDxBerlin.

23:49In a world where information flows freely, but the truth is increasingly elusive, it's more important than ever to cultivate critical thinking, media literacy, and a shared commitment to facts and evidence. Our social media platforms are spaces for connection, community, and temperature checks for what's happening in society, sure, but they're also bastions for misinformation, harmful propaganda, and polarization that has harmful effects on us all, not the least of which is our ability to be in harmony with one another. Lessig's call for a paranoia of the hunted might seem dramatic, but it serves as a potent reminder that we cannot take our democracy for granted.

24:32We must remain vigilant, engaged, and willing to defend the values that underpin a free and just society. And that's it for today. TED Tech is part of the TED Audio Collective. This episode was produced by Nina Byrd-Lawrence, edited by Alejandra Salazar, and Fact Check by Julia Dickerson. Special thanks to Maria Latias, Farrah DeGrange, Daniela Belareso, and Roxanne Hilash. I'm Sherelle Dorsey. Thanks for listening.

25:17Lawrence Lessig: Self-directed investing. Trading. full-service wealth management, automated investing, financial planning, thematic investing, retirement planning. And to think, that's just a small taste of what Schwab offers. Because Schwab knows that when it comes to your finances, choice matters. No matter your goals, investing style, life stage, or experience, Schwab has everything you need all in one place. So you can invest your way. Visit schwab.com to learn more. The holidays bring brand new gadgets, bigger spending, and even more on your to-do list. Good thing Verizon gives you more than just a great network.

25:53We give you a whole lineup of products and services. Like a protection plan for your family's home tech that covers everyday mishaps. A credit card that rewards holiday shopping with real savings. And a smartwatch built specifically for keeping up with your kids. Take the stress out of the season. Pick what works for you at Verizon.com slash extras. Hi there, it's Adam Grant from Ted's Rethinking Podcast, and this episode is brought to you by ServiceNow. I get to spend my days studying how people think and what it actually takes to change our minds. It's work I find deeply meaningful. But even in meaningful work, there's still busy work.

26:31The admin, the repetitive processes, the invisible load that pulls attention away from what really matters. That's where ServiceNow's AI specialists come in. They don't just tell you what you should do about your busy work. They actually do it. Start to finish. Cases closed. Requests handled. No extra work for you. To learn how to put AI to work for people, visit servicenow.com.