


In this episode of The Times Tech Podcast, co-hosts Danny Fortson and Mark Sellman discuss the recent AI Impact Summit held in India, exploring the effectiveness of global summits in shaping AI development. The conversation also delves into the implications of new AI technologies, particularly focusing on the viral AI agent OpenClaw, and the key findings from the International AI Safety Report led by Karina Prunkl.
Written by AI. May contain mistakes.
Discussion on the significance of the AI Impact Summit and its participants.
“So we're asking, who gets to shape the future of AI?”
Exploration of OpenClaw's impact on AI development and the industry.
“So, yeah, I'm keen to know if this summit gives us clues into how AI is evolving, too.”
Insight into the potential and risks of agentic AI technologies.
“access as you want to your life, your email, your schedule, give it a WhatsApp number and you can chat with it.”
A historical perspective on AI safety summits and their relevance today.
“I've had as many notes from cybersecurity companies about it by AI companies pushing the whole agentic AI thing.”
Discussion about the democratization of AI and its global implications.
“And I think given this context of just how fast things are moving, I think it's worth talking about what these AI summits are, why they're necessary, and the challenges that they face.”
The discussion focuses on the economic implications of AI adoption and its potential to disrupt job markets.
“But if you're trying to address 4 million people who are going to be able to work in this country in the next eight years, that is not something the international cooperation is going to help you out.”
Discussion about the importance and purpose of the International AI Safety Report.
“Welcome back to the Times Tech Podcast, where we've been discussing India's AI Summit taking place this week.”
Exploration of the risks associated with AI and the safeguards that can mitigate these risks.
“We also had a feedback round with academics, with civil society organizations, but also with for-profit organizations such as the big AI labs.”
Discussion on the challenges faced when managing the fast-paced development of AI technologies.
“Yeah, I mean, Dario Amadei in his recent, you know, 19, 20 ,000 word blog post highlighted that as a big fear of his.”
Insights on the societal risks posed by AI advancements and their implications for the labor market.
“I love the way that you say it gave you hope.”
Discusses the risks associated with AI, focusing on labor market effects and societal implications.
“are capturing the societal aspect that you're mentioning.”
Examines the change in focus at recent AI summits, from safety concerns to global relevance.
“So when we look at the most recent studies from the United States and Denmark, both national level, we find no aggregate employment effects.”
Discusses the implications of the U.S. not participating in international AI safety agreements.
“So I remember being at the Bletchley Park Summit and it was the AI Safety Summit in 2023.”
Explores mixed feelings regarding the rapid development of AI technologies and their implications.
“If, you know, the biggest polluter does not take part in an international agreement, how good is that agreement and how impactful will it ultimately be?”
Covers the potential and risks of AI in healthcare, emphasizing evaluation challenges.
“So we already don't know exactly how to best evaluate these systems and how to ensure reliability of those systems.”
Discusses the difficulties in regulating AI technologies in light of their fast-paced evolution.
“So, you know, the systems might be passing medical exams and medical benchmarks.”
Highlights India's favorable conditions for embracing AI technology due to its population's willingness to learn.
“And, you know, the last bits they've included were from December.”

Get the gist, explore an idea or ask about something said.
On Times Tech, what are the key points of this episode?
Automatic transcript. May contain errors.
0:04Hello and welcome to the Times Tech Podcast where every week we unpack how technology is reshaping business culture and everyday life. I am Danny Fortson out here in Silicon Valley, and Katie is unfortunately not with us this week. She is off, but representing the great city of London. I am pleased to welcome back to the pod my very able colleague, Mark Selman, the technology correspondent for The Times. Thank you for having me back, Danny. Great to chat. Great to have you. So our big question this week is around AI summits, because as we are speaking, India is hosting the AI Impact Summit. Politicians, thinkers, tech CEOs are all gathered there to discuss the future of tech.
0:51So we're asking, who gets to shape the future of AI? Silicon Valley or the rest of the world? And more to the point, what is the purpose of AI Summits anyway? Well, Danny, this is the fourth AI Summit. Yeah, count them. One, two, three, four. And it's starting to feel like, what, G20, G7, ASEAN, COP, every kind of alphabet soup where leaders get together. They discuss geopolitics, lots of pictures and family photos. And we're wondering if we're ever the wiser or safer as a result of it. So, yeah, I'm keen to know if this summit gives us clues into how AI is evolving, too. That's right. And later, you're going to hear an interview that Katie and I did right before she left with one of the lead authors of the 2026 International AI Safety Report, Karina Brunkle, which is being presented at the summit.
1:46So that should give us some insight into the topics being discussed. But before we get into that, it is worth giving the broader context because not just these AI summits, which we'll get to shortly, but also what is happening out here in my neck of the woods, especially around the AI project that has taken the world by storm. And that is, of course, OpenClaw. Yeah, I can't stop reading about this or seeing videos about it. It's absolutely everywhere. This week, Peter Steinberger, who actually is based in London, he created this incredibly viral AI agent called ClaudeBot. And then it had to change to MaltBot.
2:30And now it's called OpenClaw. But essentially, the big news is it's been bought or poached by OpenAI. There was a bidding war between Sam Altman and Mark Zuckerberg for this technology, essentially. both billionaires wanted Steinberger and Altman won the day. Yeah, of course. And this is important, right? Because it's just been a few weeks since it went viral. And OpenClaus forced everyone out here certainly to take a breath and rethink how they're building AI when you're talking about hundreds of billions being put into kind of AI data centers and into these companies. And people are having to rethink, you know, what form the technology will take next because for those who have not been following along, OpenClaw is a personal agent that you can run on your own machine, on your own computer, and you can give it as much access as you want to your life, your email, your schedule, give it a WhatsApp number and you can chat with it.
3:27And it's effectively becomes your employee, your coworker, your digital butler. And it's really a glimpse of this agentic future we've all been hearing about for probably the last 18 months realized by this one guy and this open source project. And I'm guessing, not reporting here, but I'm guessing that Mr. Steinberger was handed, I'm guessing at least a nine figure pay deal to join OpenAI because of course, Zuckerberg has been throwing around insane amounts of money, including giving one guy from Thinking Machines Lab$1 billion to join meta. So if Sam Altman beat out Zuck, you know, there was some serious money being thrown around.
4:12Yeah. Now Altman does say that OpenClaw will live on as an open source project under a separate foundation that will be supported by OpenAI. But it's been a dizzying few weeks and OpenClaw going from nowhere to millions of users. And it has forced the AI labs to think hard about their own plans. I feel like I've been hearing about agentic AI for ages, and you've heard Mark Benioff from Salesforce talk about it, but I've never really seen it deployed in the wild like it has been by OpenClaw. And I think the other side of that is there are implications for security and, And, you know, jobs, obviously, because once you see these things go, they go and they work all day and all night.
5:05And all you got to do is pay for the tokens. That is an incredible and both frightening prospect at the same time. It reminds me a little bit of the ChatGPT moment three years ago when Google had this capability for years and years. And then they didn't release it because they're like, hmm, this is a tricky problem because it hallucinates. It's not always right. and it's also very powerful. But ChatGPT was the kind of upstart and had nothing to lose. So it puts it out there and then Google freaks out. They declare a code red and then we're off to the races with this kind of AI revolution. And here we are three years later, people have been talking about agents.
5:43But again, it's a really tricky thing because handing the keys to your life to an AI and then just letting it run is not something a lot of grown-up companies have figured out how to do in a safe way. But then you have this open source project by one guy and it shows the potential. And so now everybody's trying to rush to get on board. Yeah, I think it will be interesting to see whether this particular viral trend, I would call it a viral trend within Silicon Valley and the tech and coding community and essentially early adopters breaks out beyond that because it's still not incredibly user-friendly and the implications of what you're doing are absolutely huge because you do have to give these agents pretty full access to your computer.
6:32I've had as many notes from cybersecurity companies about it by AI companies pushing the whole agentic AI thing. But it does show that this thing is moving to deployment. And once you start to see that and people start saying, hey, I did it and it does the work of reading people. And then another company goes, well, if they're doing it, Maybe I should be doing it. And you get this rolling kind of snowball effect. Yeah. And I think one of the biggest questions beyond making it more user friendly is also just liability. And it reminds me of like having a dangerous dog. Like if my dog bites somebody, I'm liable, right?
7:13If my agent does something stupid or buys something on my behalf that I didn't want or install some malware, whatever it may be, am I liable? because it's not me, it's my agent. And so that's a big thorny question. I think that still has to be sorted. Yeah. And you know where the companies are going to be pushing this one. Exactly. Down to you and me. Certainly speaking to some people at the AI summit that's going on in India, the agents is top of their list that they are particularly worried about. I wanted to talk about that initially, because of course, if we step back, where we started, AI summits, right?
7:52And I think given this context of just how fast things are moving, I think it's worth talking about what these AI summits are, why they're necessary, and the challenges that they face. Yeah, I think it's probably worth going back into how it all started, really. And yeah, it did start in the UK. You know, ChatGPT came out, everyone was going, wow. And then suddenly we had this slew of researchers who quit, like Geoffrey Hinton from Google famously, who then got the ear of the British government and said, look, this is really worrying. You guys need to start talking about safety. And the then Prime Minister Rishi Sunak picked up on that and created this idea of an AI safety summit at Bletchley Park.
8:37There was a lot of buzz around it. I was there. And, you know, the British government was seen as doing something quite unique at the time. And then they came out this thing called the Bletchley Declaration. And all the governments there sort of signed up to these warm words of treating AI as a shared international risk area, global dialogue, you know, keep going with AI safety research. But the big thing that they trumpeted was the fact that the companies signed up to do this pre-release testing. So the AI Safety Institute, as it was in the UK, would be able to test their AI models. So that's kind of how it started.
9:18Then it rolled onto Seoul, which was like an interim summit. And then it went to Paris. And then it became the AI Action Summit. Oh, yeah. Yeah, got to rebrand these things. And now we're here in Delhi. Do we know what the theme is this year? So it's the first time that a country from the global south has hosted it. And Narendra Modi, who's the prime minister of India, he is really championing this as, you know, India wants to be the leader of the global south in AI. He wants to democratize AI. There are banners all around the summit saying democratizing AI for a billion plus Indians. So this is really spreading the technology beyond the wealthy nations, letting everyone have it, and just really making sure this doesn't become an American wealthy nation story.
10:14And a big part of that is obviously championing the open source movement, which develops the technology for everyone to use and adapt as opposed to those closed systems developed by OpenAI, Anthropic and others. Yeah, I'm out here and everybody's so kind of anthropic, open AI, Google focused, right? It's almost like a league where people are watching the standings as people kind of rise and fall against each other. but it feels to me that the open source aspect of this is going to be huge especially if you're talking about democratizing this for a billion plus indians or a billion plus whomever all over the world and there's models like kimmy k.25 which is this chinese model which if you talk to people in the industry they're like this is basically as good as the leading models and it's free so i'm out here on the west coast i'm going to put on my west coast techie hat and just be completely skeptical of all attempts to regulate the brave new world that's being built for us by our guys out here and it's mostly guys is there a point to these ai summits like at bletchley everybody committed you like yes we're gonna give you access to our models before we release them has any of that happened or are people just doing whatever they want to do the move fast and break things approach and just completely blowing past any soft commitments that they've given at these summits.
11:45There are two questions there. Is it important that the world talks about AI? I think it's crucial that these issues are being discussed at the highest level of governments, industry, civil society now obviously is it important to act well yes but as we've seen when governments or blocks like the eu do act and you sometimes act too fast then you end up with egg on your face so it is a difficult balancing act but what i find interesting is that a lot of those that follow this area, they always look at social media as a sort of template. And they go, okay, well, we had all this social media, we ignored it, and look, we had to retrofit it.
12:36And even in the area of social media, you are obviously starting now to see regulation appear. 20 years in. Yeah. But when you look at AI, it's arguably going to be more powerful, and it's developing much more quickly because unlike 25 years ago, 5 billion people have a supercomputer in their pocket and they can access it at any time. Hopefully it doesn't take a quarter century. And I do think it's worth just so listeners understand they've got all the big hitters here. So Sundar Pichai from Alphabet, Sam Altman, Bill Gates, Demis Asabas from Google DeepMind, Daria Amadei, friend of the pod, Mr.
13:20AI CEO, Arthur Mensch, all of these folks are here, as well as several national leaders from around the world. So, you know, people are at least showing up and taking this seriously. But again, it's a question of after everybody leaves and does the family photo, what happens? Yeah, I think also it depends what you're trying to address. Now, if you're trying to address a safety issue, do you basically regulate the company saying you can't release that product until you show us what it's like so they can test it? It's sort of a mandatory version of what we got already. But if you're trying to address 4 million people who are going to be able to work in this country in the next eight years, that is not something the international cooperation is going to help you out.
14:12You're on your own. You've got to work out what you're going to do for your people. And I think that also gets to a vital conversation around tax, because if even a small percentage of the predictions are true around the kind of reorienting of the entire economy and how much is going to be sucked up into agents and machines effectively, how do you redistribute the wealth that is generated from that? What does that look like? To your point around, what does society look like? Because if I'm a big CEO employing 100 ,000 people, if I can employ 80 ,000 and be more productive, I'll probably do that.
14:54Yeah. The value of this technology is going to accrue to capital, not labor. Let's put it simply. We've seen what happened after 2008, you know, that particular crisis. And I think, you know, we could see a huge societal backlash against the technology if the worst fears about jobs are done. Obviously, even Modi is talking about transformation more than displacement, because his people will be very worried. They have an incredibly skilled IT population, but they're all working for companies that could be disrupted by AI. They're SaaS companies, software as a service. So if you believe the current market disruption, they are on the front line to be disrupted by AI.
15:44He'll be worried for his people. For sure. And we just had Nikola Merkic on last week from Poly AI, and they're doing customer service agents. And if you combine that with coding, you know, like there's that whole universe, millions and millions of people in India who work for these kind of outsourcing companies that could be in the firing line for this. And also, again, just circling back to our friend Peter Steinberger in OpenClaw, it also just when you think about these summits, again, it's just comes back to the question of how quickly this stuff is changing and how do you regulate something that we're three years into this?
16:24And things have already changed so dramatically. I mean, if you go back to November 2022 and JetGPT was like telling you to put glue on pizza and saying bears walked on the moon. We're really far from that now when you have the top coders in the world being like, I don't write code anymore. The machine does it. So this sets us up for our upcoming guests. So let's take a quick break. And when we're back, we're going to hear from Karina Prunkle, the lead author of this big AI safety report that is being discussed at the summit.
17:06Welcome back to the Times Tech Podcast, where we've been discussing India's AI Summit taking place this week. So as world leaders and tech bosses gather in New Delhi, there's another group in the room that arguably matters just as much. And that's the researchers trying to answer a much harder question. What can these AI systems actually do and what could go wrong? So behind the scenes at the summit is the team responsible for the International AI Safety Report. It's led by Turing Award winner Joshua Bengio, and it brings together more than 100 AI experts. is backed by more than 30 countries and organizations such as the UN and the EU.
17:49And this is their second major report looking at what today's AI systems are capable of, the risks they pose and the safeguards that might keep them in check. And so we are very lucky to have one of the lead authors of the report on the podcast. Her name is Karina Prunkel. She's a researcher at France's National Institute for Research in Digital Science and Technology and a research affiliate at Oxford's Institute for Ethics in AI. Katie and I caught up with her last week just before she headed out to India. It's a 221-page report. Why do we need this? Is the idea that this will be used as a reference for policymakers, for government leaders, etc.?
18:34Like, if we just step back and look at the moment, you know, because week in, week out, We're talking about the power of this technology, the latest advances, people worried about jobs, worried about kind of AI slipping the leash, whatever it may be. From where you sit, why is a report like this necessary right now? Well, general purpose AI is now really deployed at scale. It's rapidly becoming more capable. But the evidence that we have on the risks and on potential mitigations to address them is still emerging. and much slower than systems advance. And it's also quite hard to assess. And so this creates a fundamental governance challenge for policymakers who have to make decisions on the basis of this limited emerging evidence.
19:26And so this is where the International AI Safety Report comes in. The idea is that it just synthesizes the best available scientific evidence we have on three questions. One, the capabilities, what general purpose AI systems can do, then what risks are emerging and what safeguards exist. So by having this shared international understanding, at least we have something that we can base our conversations on. We can cut through the hype, we can cut through the fear, we can just have this common minimal denominator. And then governments and policymakers can go away and base their decisions on the basis of this evidence.
20:11And what is the involvement and kind of attitudes of the Frontier Labs, the Googles, OpenAIs, Anthropics, etc.? So we had several feedback rounds. We also had a feedback round with academics, with civil society organizations, but also with for-profit organizations such as the big AI labs. And their attitude has been quite positive. I mean, they were very constructive. They gave good feedback. In the end, what we put into the report is under the discretion of the chair and the writing team. So we're really keen to emphasize that this is an independent report. But when it comes especially to technical safeguards and capabilities, then it is often useful to just have some input from people who work in the big AI labs.
21:02So they let you test their stuff, I guess is the question. What do you mean by testing? Well, like looking inside their models and seeing what they're up to. No. So the report is really a collection of scientific evidence. So we didn't go out and collect our own data and do our own tests, but we were synthesizing the scientific evidence that has been published officially. And also just to stress again, this independence, we do flag when papers have been written predominantly by people working in the tech sector or in private companies or when people are from an academic background. So what are the top lines in the report about risk and what emerged this year that's particularly changed?
21:49So we see that some risks have really manifested in a way. So the evidence now has become quite obvious. And thinking about cyber attacks, for example, now AI systems are regularly used in cyber attacks or deep fakes and synthetic media. So we also see harms where we now have really robust empirical evidence. But for other risks, we have much more mixed or incomplete evidence. So these risks rely on evidence from lab studies or modeling or theory. But for those risks, we also see development and movement. So one development we see on biological risks is that several deployers have released their models with additional safeguards because they could not rule out that those models would be able to assist novices in the creation of biological weapons.
22:47So this seems to be an indication that we should take these risks serious, even though there's a lot of uncertainty that remains about how does this translate into a real world risk? You know, is it just theoretical or is it actually feasible that we can create biological weapons on the basis of outputs from general purpose AI models? But it is something that we need to take serious at this point and also something that might be worth monitoring. Yeah, I mean, Dario Amadei in his recent, you know, 19, 20 ,000 word blog post highlighted that as a big fear of his. And I guess stepping back, so just thinking again about just the process here, how long were you guys working on this?
23:30Was this, I presume this is many months or like the whole last year before you published it? So we've started working on the report in summer. and just because it takes time and we have so many feedback rounds and you know there is a lot of back and forth also with writers and internally and there's just a lot of scrutiny so it does take time to to write such a long report which leads to my question of like how useful will these reports ultimately be because not to be like use a a trite silicon valley phrase but like is this moving at the speed of the technology. Like if you're taking whatever, six months to write this thing, bringing in people's ideas and analysis from all over the world.
24:15And in the meantime, you know, Claudebot happens or then the latest Anthropic model comes out that is leaps and bounds beyond, you know, maybe what your team was analyzing. How do you guys navigate that challenge? Because that feels like particularly what's been happening the past few years is Things have been developing so quickly that oftentimes people try to pass laws and by the time they pass them, they apply to something that is no longer relevant. Yeah, so this is certainly a challenge. We navigated it by really adding content up to the last minute. So the final, final deadline was in December.
24:55So I think we've got most of the things that happened in 2025. But more general, as an institution, we try to address this fast-moving landscape by publishing these interim reports. So we had a couple of key updates. The first one was on capabilities. So what has happened since the publication of the last report that was published in October and in order to keep up with this rapidly moving AI landscape. But in general, I completely agree that a yearly report is already pushing it. By the time it's published, there are so many new developments. But this is exactly why we had the key updates in order to counter this.
25:39You talked about some of the risks there. I'd love to hear what really jumped out for you while you were doing the research for this. Was there anything that particularly surprised you? Yes. So one thing that surprised me was that we do have a number of safeguards on our hand. And, you know, none of these safeguards works by its own. But when we layer them, and, you know, we call this in agreement with the rest of the field as a defense in depth approach. So once we layer these safeguards, then we can actually, you know, it gave me hope that we can manage the risks appropriately. I love the way that you say it gave you hope.
26:20I mean, do you think we are trying to? Are Are governments or policymakers listening to you when you talk about the safety risks of AI? Yeah, so I mean, it gave me hope. But I mean, I should, of course, also say that a lot of the safeguards and especially that the technical safeguards have their individual limitations. And I guess coming back to this question about whether governments will listen to us, it's not so much, you know, we're not, the report doesn't give any policy recommendations. The report really is just there to inform. And maybe, Danny, this goes back to your previous question, you know, who is going to read this?
27:00We've got really good feedback from various governments, some of which have established their own reading groups going through the report section by section. And this really indicates that it can be useful to inform decision-making processes on the governmental level. And I mean, I think one of the risks, you know, because I think this is a safety report. So it's about bioweapons and cyber attacks. But also, I think people that are thinking about AI much less deeply or just kind of your man on the street is like, am I going to have a job? What do I do? What do I tell my kids in a world where the ship has sailed in terms of any human being smarter than a machine ever again?
27:43theoretically do you guys get into that around like the kind of societal risk as these systems continue to advance and what that could mean for kind of societal cohesion and it's not a kind of a technological risk as much as a social one yes we do that we actually categorize our risks into misuse risks malfunction risks and what we call systemic risks and those systemic risks really are capturing the societal aspect that you're mentioning. So we do have a section on labor market and we also have a section on human autonomy, which also falls into this category that it might be this broader societal phenomenon that we see emerging in the wake of general purpose AI.
28:30What's the answer? Like, how bad is it going to be in terms of that kind of that societal upheaval? I mean, obviously you can't predict the future, but what did you find? Yeah. So what we found is that currently we don't see any aggregate labor market effects. So when we look at the most recent studies from the United States and Denmark, both national level, we find no aggregate employment effects. But what we do find are more targeted effects on on the job market. So for example, there is less demand for writing and translation, but at the same time, there's more demand for machine learning programming, for example.
29:14Another effect that is quite marked is that it seems that junior workers in AI exposed jobs are also seeing a decline in employment opportunities, but senior workers don't see that same decline. In fact, there it's stable or there's even an increase. So the labor market effects currently are quite targeted. But yeah, as you said, I can't predict the future. So we'll have to see how this continues. That's so interesting. It really tallies with a study that we looked at on the podcast last year called Canaries in the Coal Mine. Do you remember that? By Stanford University. Exactly. I wanted to ask about the vibe shift.
29:54So I remember being at the Bletchley Park Summit and it was the AI Safety Summit in 2023. and now we've got the India Impact Summit. Have you felt that vibe shift from the focus on, oh my goodness, AI is going to take over the world and we need to think about safety to actually, you know, there are other more pertinent or more pressing things to worry about? I wouldn't frame it in that way. I think there certainly have been different focal points in the two summits. So for example, you're right, The Bletchley Park Summit was much more safety and risks associated with emerging capabilities focused.
30:35And now the India Summit has this big theme of integrating the global south and topics that are relevant for the global south. I think that's absolutely fair enough. Different world regions have different focal points. We found that across the line, all of the summits were really interested in the work of the International AI Safety Report because the report addresses risks that are really border crossing. But it's right, is it that America hasn't signed up to this? Yes, that's right. Just like with the climate change protocols. Who needs it? You know, it's like, ugh. Yeah, but I mean, is that a concern?
31:17And if you think, you know, this tech is mainly being developed by a small handful of American companies, a problem that the US government doesn't sign up to it. So I'm afraid I can't comment on that question. So I would refer you to the secretariat. What do you think, Danny? He's your president. I do. I do think it's a problem. I mean, I think it's great that the frontier labs are taking part and being proactively involved and kind of being collaborative. But, you know, again, it's a little bit like climate change. If, you know, the biggest polluter does not take part in an international agreement, how good is that agreement and how impactful will it ultimately be?
32:00So that is worrying. But, you know, again, the other aspect is just how quick moving this all is. You know, if one guy can create this clawed bot or open claw thing that kind of takes the world by storm, it does feel like, as we talked so often on this podcast, just the autonomy, the empowerment that these things allow both good and bad. You know, somebody who is really determined may be able to make some kind of chemical or biological weapon with the aid of these things. It does feel like, I'm just wondering, as you have put it, pulling this all together, do you walk away feeling hopeful or filled with dread or both about just where things are and how quickly they're moving?
32:51I think both. I mean, I already expressed my hopefulness regarding at least the possibility of containing and mitigating certain risks. But I see there just like also a lot of shortcomings, and some of them are quite fundamental. So we emphasize something that we call the evaluation gap. So, you know, sometimes it's just almost, you know, AI systems have a specific benchmark performance, but this performance really doesn't really translate into the real world. Same with safety. So we already don't know exactly how to best evaluate these systems and how to ensure reliability of those systems. And I think this is a fundamental scientific challenge that we're facing.
33:38So I think the challenges are multifold and we talk about them extensively in the report as well. But some of the challenges are at a very basic level, like how do we evaluate all-purpose AI systems? And those seem quite fundamental. Fascinating. Yeah. I hadn't quite realized that was so impossible. Yeah, you can't. The first step is measuring something to then be able to kind of regulate it or whatever. Before you go, I think it's worth, this may end us on a positive note or not. I don't know. It depends on your answer. But one of the kind of areas that there is a lot of optimism around or a lot of curiosity around is around healthcare, whether that's the delivery of healthcare or also drug discovery, treating diseases that have been intractable, etc.
34:24etc. When you think about how these AIs can kind of step in, do critical thinking for humans, do this kind of, you know, analysis involved with some of that, are there examples that come to mind when you're looking at this aspect of this technology? Yeah, so especially in the last year, we've seen a lot of progress in scientific reasoning, in troubleshooting, you know, lab protocols and these sort of problem-solving skills that are in general required to advance science and medicine in particular. So I think there will be really big opportunities, but at the same time, very often the same capabilities that allow us to make progress in those fields are also capabilities that then can be dangerous or misused in other contexts.
35:15So going back to the biological weapon example, you don't want somebody who is trying to develop a biological weapon to use their general purpose AI to troubleshoot their virology lab protocol. So it's a bit of a double-edged sword when it comes to the scientific capabilities of AI systems. But maybe just to end is that, again, I think to have general purpose AI systems deployed in real world medical contexts, we still have a way to go. So, you know, the systems might be passing medical exams and medical benchmarks. But at the same time, you know, there was one study that showed that a system gave potentially harmful answers to 19 % of realistic medical questions asked.
36:10So, again, there is this gap between the pre-deployment evaluation and real-world performance of those systems. As you say, I think it's the jagged edge, right? It's excellent at some things and just really terrible at others. And it's kind of part of how that looks.
36:29So what do you think? Are you filled with hope? Are you filled with dread? Both. Like she was. It's always both in this job, isn't it? I think she was being very careful and trying to be balanced. But the fact that we've run out of evaluation tools, I mean, the system card for Anthropics, claude opus 4.6 just pull out that document if you really want to get scared have a look at that they too say that their system evaluations cannot evaluate their own product that the product knows when it's being assessed it's over eager it does things it's not supposed to i mean this is why people get worried about this stuff well that's what's so interesting she was like they spent six months on it.
37:16And, you know, the last bits they've included were from December. And then the whole open claw moment happens in three weeks, this last three weeks. And you're kind of like, oh, well, that's a completely new dynamic that is not contemplated just because it can't. And it does make you wonder, like, how do you regulate and how do you not throw out the baby with the bathwater and not be overly aggressive in terms of regulation, but also be like, There are some things to worry about here, but it's all happening so fast. I am increasingly of the belief that something like that, it's like cyber attacks, you know.
37:53It's like something bad happens and suddenly everyone wakes up and says, we've got to have more cybersecurity. So I kind of believe that that's unfortunately probably what's going to happen. But the jobs thing is really incumbent on, I mean, they don't have to wait for an international agreement to do that. These governments have just got to get their asses in gear about it. Which is where I think actually India is very well placed in the sense that their population really wants to learn and do and act. And actually, if you have a population that wants to do that, you will succeed at this technology because it's incredibly empowering.
38:30And that does act as a supercharger. But you need to have a population and a government that is fully on board to embrace it. So I think that's where they're in a good place. Well, that's a positive note to end on. More hope, less dread. That is it, I think, for this week's episode of the Times Tech Podcast. If you are enjoying the show, please do follow or subscribe and leave us a rating or review. It genuinely helps other people find us. And you can find more about all the stories we discussed today and tech news in general at thetimes.com. And you can email us with ideas or questions at techpod at thetimes.co.uk.
39:10Mark, thank you very much for stepping in to the fire this week. It was great having you on. Pleasure. Until next week. See you later. Bye-bye.
As world leaders and tech bosses gather for India’s AI Impact Summit, Danny Fortson and Mark Sellman ask if these global summits are shaping AI or struggling to keep up with it? They also hear from Carina Prunkl, lead author of the new International AI Safety Report, about risks, jobs, autonomy and whether safeguards are keeping pace with technology. Plus, OpenAI snaps up viral agent OpenClaw.
Image: Getty
Hosted on Acast. See acast.com/privacy for more information.