Democracy in the Age of AI (2/5): When AI can fake reality, who can you trust? | Sam Gregory

0:00Hey, it's Sherelle, host of TED Tech. Election season is here and this year there's a new player on the ballot. So I put together a playlist of talks around one urgent question. What happens when AI gets a vote? You'll hear how AI could hack the system we use to govern ourselves. Who we can trust when reality itself can be faked. Why your creativity might be one of democracy's best defenses. how we can govern a technology no one can fully predict, and how AI and democracy could actually fix each other. The stakes are real and the clock is running. So I hope you get as much out of these talks as I did.

0:52When I went off to college in New York City, my friends and family came to visit me in the Big Apple. They said they were checking in on me, and they did. But it was also a chance for them to sightsee, to explore, and to pay a visit to Canal Street. Located in Lower Manhattan, Canal Street is famous for its blocks of restaurants, shopping, and cheap fashion wares. It's also a haven for knockoff luxury designer handbags. Now this isn't amateur hour. These handbags can fool you. I remember one bag. We held it up against the real thing at a store on Madison Avenue. We couldn't believe it. There are these extremely realistic fashion fakes all over Canal Street.

1:33But now, well, anything can be fake online, too, thanks to AI. AI experts warn us of a world where so much of what we see is fake, even if it looks so much like the real thing. Reality is increasingly being replicated through voice, video, images, and text messages. So verifying authenticity is a practice we need to prioritize.

2:02I'm Sherelle Dorsey, and this is TED Tech. Our speaker today is Sam Gregory, Executive Director of the global human rights organization, Witness. Sam is also a technologist and expert on smartphone witnessing, deep fakes, media authenticity, and generative AI. For this TED Talk, he takes to the stage and introduces us to a new wave of media literacy that will help consumers and technologists determine the real from the fake.

2:45Hi there, it's Adam Grant from Ted's Rethinking Podcast, and this episode is brought to you by ServiceNow. I get to spend my days studying how people think and what it actually takes to change our minds. It's work I find deeply meaningful. But even in meaningful work, there's still busy work. The admin, the repetitive processes, the invisible load that pulls attention away from what really matters. That's where ServiceNow's AI specialists come in. They don't just tell you what you should do about your busy work. They actually do it. Start to finish. Cases closed. Requests handled. No extra work for you.

3:18To learn how to put AI to work for people, visit servicenow.com.

3:25This episode is sponsored by Charles Schwab. Wouldn't it be great if life's little upgrades didn't feel like a splurge? Like getting the aisle seat with extra legroom for a one-hour flight, ordering extra guac with zero hesitation, or paying for assembly on that swing set because you'd rather spend your Saturday doing literally anything else. It's called living filthy comfortable. And whatever filthy comfortable looks like to you, Schwab can help you find it with investing, trading, education, and human help all in one place. Learn more at schwab.com. Investing involves risk, including loss of principle.

4:04This episode is brought to you by Planet Visionaries, a podcast in partnership with the Rolex Perpetual Planet Initiative. What connects a hidden laboratory in the Amazon, giant pandas in China's mountain forests, research relating to the ocean, and communities living alongside wildlife in India? That's what you'll hear on Season 6 of Planet Visionaries, stories from the explorers, scientists, and conservation leaders whose work addresses research, biodiversity, and conservation issues in specific locations. Planet Visionaries, hosted by environmental advocate and professional climber Alex Honnold brings you real stories of discovery, determination, and research and initiatives relating to environmental change.

4:45In partnership with the Rolex Perpetual Planet Initiative, this is Planet Visionaries. Listen or watch wherever you get your podcasts.

4:57Sam Gregory: It's getting harder, isn't it, to spot real from fake, AI generated from human generated. With generative AI, along with other advances in deepfakery, it doesn't take many seconds of your voice, many images of your face to fake you, and the realism keeps increasing. I first started working on deepfakes in 2017, when the threat to our trust in information was overhyped, and the big harm in reality was falsified sexual images. Now, that problem keeps growing, harming women and girls worldwide, But also, with advances in generative AI, we're now also approaching a world where it's broadly easier to make fake reality, but also to dismiss reality as possibly faked.

5:44Sam Gregory: Now, deceptive and malicious audiovisual AI is not the root of our societal problems, but it's likely to contribute to them. Audio clones are proliferating in a range of electoral contexts. Is it, isn't it claims? cloud human rights evidence from war zones, sexual deepfakes target women in public and in private, and synthetic avatars impersonate news anchors. I lead witness. We're a human rights group that helps people use video and technology to protect and defend their rights. And for the last five years, we've coordinated a global effort, Prepare Don't Panic, around these new ways to manipulate and synthesize reality and on how to fortify the truth of critical frontline journalists and human rights defenders.

6:30Now, one element in that is a deepfakes rapid response task force

6:36Sam Gregory: made up of media forensics experts and companies who donate their time and skills to debunk deepfakes and claims of deepfakes. The task force recently received three audio clips from Sudan, West Africa, and India. People were claiming that the clips were deepfaked, not real. In the Sudan case, experts used a machine learning algorithm trained on over a million examples of synthetic speech to prove, almost without a shadow of a doubt, that it was authentic. In the West Africa case, they couldn't reach a definitive conclusion because of the challenges of analyzing audio from Twitter and with background noise.

7:13Sam Gregory: The third clip was leaked audio of a politician from India. Nilesh Christopher of Rest of the World brought the case to the task force. The experts used almost an hour of samples to develop a personalized model of the politician's authentic voice. Despite his loud and fast claims that it was all falsified with AI, experts concluded that it at least was partially real, not AI. Even experts cannot rapidly and conclusively separate true from false. And the ease of calling that's deep faked on something real is increasing. The future is full of profound challenges both in protecting the real and detecting the fake.

7:55Sam Gregory: We're already seeing the warning signs of this challenge of discerning fact from fiction. Audio and video deepfakes have targeted politicians, major political leaders in the EU, Turkey and Mexico, and U.S. mayoral candidates. Political ads are incorporating footage of events that never happened, and people are sharing AI-generated imagery from crisis zones, claiming it to be real. Now again, this problem is not entirely new. The human rights defenders and journalists I work with are used to having their stories dismissed. And they're used to widespread deceptive shallow fakes. Videos and images taken from one context or time or place and claimed as if they're in another.

8:38Sam Gregory: Used to share confusion, spread disinformation. And of course we live in a world that is full of partisanship and plentiful confirmation bias. Given all that, the last thing we need is a diminishing baseline of the shared, trustworthy information upon which democracies thrive, where the specter of AI is used to plausibly believe things you want to believe and plausibly deny things you want to ignore. But I think there's a way we can prevent that future if we act now. That if we prepare, don't panic, will kind of make our way through this somehow. Panic won't serve us well. Plays into the hands of governments and corporations who will abuse our fears and into the hands of people who want a fog of confusion and will use AI as an excuse.

9:32Sam Gregory: How many people were taken in just for a minute by the Pope in his dripped-out puffer jacket? You can admit it. More seriously, How many of you know someone who's been scammed by an audio that sounds like their kid? And for those of you who are thinking, I wasn't taken in. I know how to spot a deepfake. Any tip you know now is already outdated. Deepfakes didn't blink. They do now. Six-fingered hands were more common in deepfake land than real life. Not so much. Technical advances erase those visible and audible clues that we so desperately want to hang on to as proof we can discern real from fake.

10:12Sam Gregory: But it also really shouldn't be on us to make that guess without any help. Between real deepfakes and claim deepfakes, we need big-picture structural solutions. We need robust foundations to enable us to discern authentic from simulated, tools to fortify the credibility of critical voices and images, and powerful detection technology that doesn't raise more doubts than it fixes. There are three steps we need to take. to get to that future. Step one is to ensure that detection skills and tools are in the hands of the people who need them. I've talked to hundreds of journalists, community leaders and human rights defenders, and they're in the same boat as you and me and us.

10:54Sam Gregory: They're listening really closely to the audio, trying to think, can I spot a glitch? Looking at the image saying, oh, does that look right or not? Or maybe they're going online to find a detector. And the detector they find, they don't know whether they're getting a false positive, a false negative, or a reliable result. Here's an example. I used a detector which got the Pope in the Puffer jacket right, but then when I put in the Easter Bunny image that I made for my kids, it said that it was human-generated. This is because of some big challenges in deepfake detection. Detection tools often only work on one single way to make a deepfake, so you need multiple tools.

11:31Sam Gregory: And they don't work well on low-quality social media content. Confidence score. How do you know whether that's reliable if you don't know if the underlying technology is reliable or whether it works on the manipulation that has been used? And tools to spot an AI manipulation don't spot a manual edit. These tools also won't be available to everyone. There's a trade-off between security and access, which means if we make them available to anyone, they become useless to everybody because the people designing the new deception techniques we'll test them on the publicly available detectors and evade them.

12:09Sam Gregory: But we do need to make sure these are available to the journalists, the community leaders, the election officials globally, who are our first line of defense, thought through with attention to real-world accessibility and use. Though, at the best circumstances, detection tools will be 85 % to 90 % effective, they have to be in the hands of that first line of defense. And they're not right now. So for step one, I've been talking about detection after the fact. Step two, AI is going to be everywhere in our communication, creating, changing, editing. It's not going to be a simple binary of, yes, it's AI, or phew, it's not.

12:48Sam Gregory: AI is part of all of our communication. So we need to better understand the recipe of what we're consuming. Some people call this content provenance and disclosure. Technologists have been building ways to add invisible watermarking to AI-generated media. They've also been designing ways, and I've been part of these efforts within a standard called the C2PA, to add cryptographically signed metadata to files. This means data that provides details about the content, cryptographically signed in a way that reinforces our trust in that information. It's an updating record of how AI was used to create or edit it, where humans and other technologies were involved, and how it was distributed.

13:33Sam Gregory: It's basically a recipe and serving instructions for the mix of AI and human that's in what you're seeing and hearing. And it's a critical part of a new AI-infused media literacy. And this actually shouldn't sound that crazy. Our communication is moving in this direction already. If you're like me, you can admit it, you browse your TikTok for you page, and you're used to seeing videos that have an audio source, an AI filter, a green screen, a background, a stitch with another edit. This, in some sense, is the alpha version of this transparency in some of the major platforms we use today. It's just that it does not yet travel across the internet, it's not reliable, it's not updatable, and it's not secure.

14:17Sam Gregory: Now, there are also big challenges in this type of infrastructure for authenticity. As we create these durable signs of how AI and human were mixed that carry across the trajectory of how media is made, we need to ensure they don't compromise privacy or backfire globally. We have to get this right. We can't oblige a citizen journalist filming in a repressive context or a satirical maker using novel Gen.AI tools to parody the powerful to have to disclose their identity or personally identifiable information in order to use their camera or chat GPT. Because it's important they be able to retain their ability to have anonymity at the same time as the tool to create is transparent.

15:05This needs to be about the how of AI human media making, not the who.

15:12Sam Gregory: This brings me to the final step. None of this works without a pipeline of responsibility that runs from the foundation models and the open source projects through to the way that is deployed into systems, APIs, and apps to the platforms where we consume media and communicate. I've spent much of the last 15 years fighting essentially a rearguard action, like so many of my colleagues in the human rights world, against the failures of social media. We can't make those mistakes again in this next generation of technology. What this means is that governments need to ensure that within this pipeline of responsibility for AI, there is transparency, accountability, and liability.

16:00Sam Gregory: Without these three steps, detection for the people who need it most, provenance that is rights-respecting, and that pipeline of responsibility, We're going to get stuck looking in vain for the six-fingered hand or the eyes that don't blink. We need to take these steps. Otherwise, we risk a world where it gets easier and easier to both fake reality and dismiss reality as potentially faked. And that is a world that the political philosopher Hannah Arendt described in these terms. A people that no longer can believe anything cannot make up its own mind. It is deprived not only of its capacity to act, but also of its capacity to think and to judge.

16:42Sam Gregory: And with such a people, you can then do what you please. That's a world I know none of us want and that I think we can prevent. Thanks. Thank you.

17:08and Fact Check by Hannah Matsudira. Special thanks to Maria Ladias, Faraday Grunge, Simone Ross, Daniela Villarezzo, and Michelle Quint. I'm Sherelle Dorsey. Let's keep digging into the future. Talk to you again next week.

18:06We'll see you next time. for work. Upgrade to Google Workspace with Gemini at go.gle slash workspace with Gemini. That's go.gle slash workspace with Gemini. Hi there, it's Adam Grant from Ted's Rethinking Podcast, and this episode is brought to you by ServiceNow. I get to spend my days studying how people think and what it actually takes to change our minds. It's work I find deeply meaningful. But even in meaningful work, there's still busy work. The admin, the repetitive processes, the invisible load that pulls attention away from what really matters. That's where ServiceNow's AI specialists come in.

18:41They don't just tell you what you should do about your busy work. They actually do it. Start to finish. Cases closed. Requests handled. No extra work for you. To learn how to put AI to work for people, visit servicenow.com. Investing with Schwab is like spending a Saturday at a great farmer's market. You can fill your reusable tote with a bit of everything. Maybe you go for some free-range, self-directed investing. Or perhaps you pick up a few farm-fresh trades while you peruse. You can even get help from a dedicated advisor. That's full-service wealth management. Mix, match, and change your mind whenever you want.

19:16Because at Schwab, you can invest your way. No matter your goals or appetite for investing, Schwab has everything you need, all in one place. Visit schwab.com to learn more.