Apocalypse soon? AI could hasten bioweapons

0:00Business is booming, but you know what really helped? Zero. The accounting platform for small businesses. I used to think spreadsheets were just part of it. Ugh. But real-time cash flow? Wow. Invoices that chase themselves? Even better. Books that automate? That's a big one. And I can keep track from my phone while I get the job done. No spreadsheet in sight. What a life. Do right by yourself and your business and search XERO for your free trial. Conditions apply. Dell PCs, with Intel inside, are built for the moments that matter. For the moments you plan and the ones you don't. Built for the busy days that turn into all-night study sessions.

0:44The moment you're working from a cafe and realize every outlet's taken. The times you're deep in your flow and the absolute last thing you need is an auto-update throwing off your momentum. That's why Dell builds tech that adapts to the way you actually work. Built with long-lasting battery, so you're not scrambling for the closest outlet. And built-in intelligence that makes updates around your schedule, not in the middle of it. They don't build tech for tech's sake. They build it for you. Find technology built for the way you work at dell.com slash dellpcs. That's dell.com slash dellpcs. Built for you.

1:34Rosie Blau:Hello and welcome to The Intelligence from The Economist. I'm Rosie Bloor.

1:44Rosie Blau:Today on the show, are there any safe assets left to invest in and why German bread is on a roll?

1:59But first...

2:09Rosie Blau:In recent decades, the list of existential anxieties has only mounted. War, nuclear war, climate change. well, don't expect any reassurance from me. Now with the rise of artificial intelligence, another potentially civilization-ending threat is gaining momentum. For the past few decades, governments have worried that thanks to advances in synthetic biology, it is easier than ever to develop biological weapons. Arthur Holland Michel writes about emerging technologies. Now, AI is making it even easier. Arthur, you're predicting the end of humanity here. How might that happen? AI has become exceptionally good at doing biology.

3:03Leading language models have surpassed human virologists on things like bioinformatics and troubleshooting complex experiments. The worry is these same capabilities could enable novices to access a level of capability that previously only existed in the hands of a very small number of governments.

3:28Rosie Blau:So what role exactly is AI going to play? The essential role that many are worried about is that they will provide what's called uplift. They will essentially give people who don't know how to do science a boost. One expert who used AI in a study published last year to help guide him through the trickiest parts of assembling poliovirus described the model as being like an infinitely patient tutor who had read every scientific paper ever published. And so it was able to guide him with the idea being that someone who's never laid hands on a pipette could have an AI assistant at their side. And when they get something wrong, they can ask, do it again, and in theory, eventually get it right.

4:18The evidence shows both that it's unbelievably helpful to some people, but then there are other studies showing that it isn't.

4:25Rosie Blau:So who exactly are we worried about? I mean, could I become a bioterrorist? Well, I'm glad you asked. In fact, because the industry has looked into this and a recent study found that actually novices, I'm going to assume that you don't have experience with sophisticated virological tasks, but novices don't actually get that much help from AI in the lab. On the other hand, someone with, say, a PhD in molecular biology, that might be the person who's actually going to get the most boost out of an AI accomplice. If you have access to a tool that has read every scientific paper ever published, that is somewhat akin to having access to an infinite number of experts who can approach the question from different angles, who can troubleshoot, who can brainstorm in ways that might replicate or mimic the effect of having very large teams of experts, which is, of course, the principal bottleneck for bioterrorism.

5:29Rosie Blau:So how soon could some kind of deadly virus be produced with the help of AI? Governments have looked into this. Last year, there was a major study which found that in In terms of actually using AI to develop a totally new pathogen, something that doesn't have any characteristics that we know how to defend against, that would rely on access to some data sets that don't exist yet. What would be possible in expert hands now is some capability in terms of actually modifying existing viruses to perhaps exhibit certain capabilities that they do not currently have. How soon? Well, in theory, someone could just develop a respiratory virus that works, if they get lucky, and infect themselves, and then get on an airplane or sneeze in public places.

6:27And that could potentially do the trick. But of course, until someone tries that, and we certainly hope that no one does, it's a little hard to tell.

6:36Rosie Blau:But you could do this by mistake then. Biology compared to other ways of causing mass panic and harm is very hard. And the fact remains that there are all sorts of other ways of creating panic and creating harm that are perhaps easier for now. But of course, with the way that these capabilities, these AI capabilities are evolving, that balance could shift and it could shift very quickly, which is why there is so much interest in how to make models less likely to provide help. So that's what I wanted to come on to. It's not easy yet to destroy humanity. We should take some comfort from that. But what can be done to keep it that way?

7:23Rosie Blau:Whose job is it to regulate? And can you regulate for this kind of thing? It probably starts with the technology itself. The best option would be to have models that do not freely give out sensitive information about how to recover and propagate viruses, for example. That begins with models that will refuse dangerous requests. And in fact, models are getting a lot better at refusing requests related to sensitive biological information. But those refusal mechanisms can be very easily bypassed by a motivated actor. So then you have to look at ways of actually changing the capabilities of the model.

8:04Maybe you leave some of that sensitive information out of their training data sets so that they don't know about these capabilities. Other approaches might come down to something that is simpler, which is just to restrict who gets access to some of these models.

8:24Rosie Blau:And governments, can they regulate? Governments can get ahead of the release of models by looking at their capabilities before they've been released to the public. And on the basis of that, they could, in theory, establish guardrails or limitations on what the models can be used for and where they can be used and by whom. So it's not over yet, but it's pretty terrifying stuff. Yeah. Biology has always been terrifying. Humans have always sought to find ways to take advantage of the devastating potential. AI is multiplying that and there is so much uncertainty as to how it's multiplying the harm that can be created that I don't think anyone should rest easy about it.

9:14Even if the evidence right now suggests that AI is not putting bioweapons into the hands of novices as we speak, that uncertainty itself is cause for alarm because there isn't strong evidence that it won't do that at some point in the very, very near future, which speaks to the importance of proactive measures rather than a sort of wait and see approach that would be gambling with impossibly high stakes.

9:45Rosie Blau:Arthur, thank you very much. Thanks very much.

10:01business is booming but you know what really helped zero the accounting platform for small businesses i used to think spreadsheets were just part of it but real-time cash flow wow invoices that chase themselves even better books that automate that's a big one and i can keep track from my phone while i get the job done no spreadsheet in sight what a life do right by yourself and your business and search XERO for your free trial. Conditions apply. MIT Sloan Executive Education. Fueled by cutting-edge research and aided by the latest technology, open enrollment courses include over 90 in-person and online courses offered throughout the year.

10:42Executive.mit.edu.

10:51Josh Roberts:Looking at what's going on in the world, you might think investors would be flocking to their safe havens, but actually it's been a brilliant few weeks for stock markets.

11:01Rosie Blau:Josh Roberts is our Capital Markets correspondent.

11:05Josh Roberts:In a lot of the world, they're at all-time highs or close to it, and it's been a great time if you're invested in shares lately.

11:14Rosie Blau:Josh, that's despite the Iran war causing one of the biggest oil shocks in history. What's going on?

11:22Josh Roberts:Yeah, it really does seem quite surprising on the face of it because we've talked a lot about how bad this shock could be, how it's constricting the world's energy supply, how markets really aren't really prepared for it and how economies are going to take quite a bit of damage from the oil shock. And yet you've got all of this optimism in equity markets. Now, it's quite hard to second guess investors who have all the facts at their Finder tips and millions of dollars at stake, in some cases billions of dollars at stake. And journalists are often accused of having predicted nine out of the past for stock market crashes.

11:56Josh Roberts:So I don't want to lean too far in that direction. It could well be that right now investors are right and the benefits from, for example, economic growth, the artificial intelligence revolution are just going to outweigh this Iran shock. That's certainly how they're acting.

12:11Rosie Blau:And is that where the optimism of these investors comes from?

12:14Josh Roberts:I think that's where some of it comes from. And there are other events that have happened recently that kind of support that. The global economy and markets have proved to be a lot more resilient over the past few years than really anyone might have predicted before. We've had shock after shock, whether it's COVID or Russia, Ukraine, or the bank crisis we had in the US a few years ago. each time it seemed like they might send share prices over a precipice. But each time share prices have plunged, it's been very short term. They've recovered incredibly quickly. And investors who've sold out when things seemed really bad actually just ended up missing out on the rebound.

12:52Josh Roberts:So perhaps this time with the Iran war, we're seeing some of the muscle memory of that come back. Investors not wanting to make the mistakes that they've made over the past few years, be overly negative, and then miss out on future gains.

13:04Rosie Blau:And is that warranted? I mean, we've talked again and again about how big a crisis this is.

13:10Josh Roberts:I do worry that this one time, that muscle memory, as well as it would have served you for several previous shocks, doesn't seem to be the right response to this one, because we are looking at a permanent destruction of oil output. The oil that already has not left the Strait of Hormuz is not going to suddenly be replaced, even if it's reopened. There are going to be lots of knock-on effects even once the war is over and the end of that is not really in sight just yet. So it does seem like this time is different and could be a lot worse, but that's not how shareholders are thinking at the moment.

13:48Rosie Blau:And if possibly when investors do get spooked, where are the safe havens now?

13:53Josh Roberts:This is another really interesting feature of this moment, which is that investors' usual safe havens don't look so safe. So let's take the classic example. Gold is the oldest safe haven out there for literally thousands of years. Investors have flocked to gold as a store of wealth, as a hedge against inflation, as a hedge against all sorts of chaos. So you might think that people were flocking to gold now. And in a sense, they are. But actually, they've been flocking to gold for the past five years or so. Gold price has rocketed since the pandemic. There've been all sorts of buyers from central banks to average retail investors.

14:28Josh Roberts:The weird result that you've had from that is that gold's price has gone up so far already that at the onset of the war, it fell along with stocks. It started to behave a little bit like a speculative asset. It's very unusual for gold to behave in this way. And even though gold investors are sitting on years of gains now, it might make them feel less like it's a haven and more like a bet.

14:53Rosie Blau:What about something slightly more modern, the dollar?

14:56Josh Roberts:Yeah, so the dollar is the currency version of gold. It's the currency that investors around the world flock to when times are really bad. Recently, we had a severe test of that. And the test was the so-called Liberation Day tariffs that President Trump introduced last year. Around that time, there was a stock market panic. There was a panic in the bond market. But whereas in a time like that, you would usually expect the dollar to appreciate, actually the dollar fell along with everything else. investors started to judge not just that the chaos had come to America, but there was this kind of cocktail of factors that meant the dollar wouldn't be a safe haven.

15:30Josh Roberts:This meant that the dollar fell along with everything else. It didn't behave like a safe haven. The dollar has stabilised since then. It's not still falling in value. But now when you get crisis moments like the onset of this war, if it gains, it doesn't gain very much. And generally, it's just been a bit flat. So again, this seems like less of a safe haven than it used to.

15:51Rosie Blau:What about the supposed safest of safe havens, government bonds?

15:56Josh Roberts:Again, you would expect those to benefit at a time like this, just from this flight to safety effect. If everything else is threatened, where do you put your money? It can't be in dollars, it can't be in gold, there aren't infinite options. Government bonds is something you flock to. And the other thing that helps you with government bonds is that in very bad times, during a recession, interest rates tend to fall, government bond prices move inversely to interest rates. So when things get really bad, the bottom line is government bonds tend to shoot up while everything else falls. Again, there are some peculiar features of this crisis that make government bonds look less safe.

16:32Josh Roberts:The main one is that you would expect a rise in the oil price and a rise in all sorts of other energy costs to push up inflation. And inflation eats away at the value of government bonds. And we expect inflation to rise as a result of these events. The other thing that's kept government bonds down in value is that the war and protecting citizens from the knock-on effects is going to cost governments money. And governments are already borrowing vast sums each year across the rich world. So as well as the worries about inflation, there's a worry that rich world governments in particular fiscally are on an unsustainable path and that that will hurt the value of their government bonds in the future.