270. AI minister: How we build a trillion dollar AI company

15 Apr 2026 · 47 min · 17 chapters

Ask about this episode

Ask anything about it. ChatGPT or Claude reads this page and answers with the times it was said.

Connect VO and ask about every podcast you hear, including the moments you saved. Add to ChatGPT · Add to Claude

In short

UK government AI strategy and a new £500m “Sovereign AI” investment fund aimed at building UK-based, GDP-impacting AI companies; also covers education/curriculum changes, workforce impacts, and AI safety/governance.

Guests

Kanishka Narayan, UK Minister for Artificial Intelligence (also responsible for AI economics/work-of-the-future policy and AI security risk work). Background referenced: previously invested in tech in the US and the UK; appointed AI ambassadors/engaged with major employers; works within government to coordinate procurement, data, visas, and national security considerations.

Key claims

The UK is strong in reality but suffers from a “narrative” of being “nowhere in AI”; the fund will invest early (seed/Series A, £1–10m checks) and use government levers to help companies scale in the UK. Government should focus on adoption and augmenting humans, not only automation. He doubts a “world of plenty” with no human jobs, and emphasizes testing/mitigating catastrophic “P-doom”/loss-of-control risks.

Notable examples

David Silver/DeepMind and his UK-based startup “Ineffable Thinking”; AlphaFold/DeepMind; OpenAI’s London research center and “Stargate UK” data-center shelving; training 10 million people in AI skills; partnerships with NHS, Accenture, Cognizant; technical excellence colleges; campaign on chip design.

Written by AI. May contain mistakes. Listen to the episode to check what was said.

Chapters

Tap a time to open that second in VO

Interview with Kanishka Narayan: The AI Investment Fund

0:51 to 5:00

Robert interviews Kanishka Narayan about the UK government's new £500 million AI investment fund and its implications.

“Hello and welcome to The Rest is Money with me, Robert Peston.”

The Future of AI Companies in the UK

6:31 to 14:03

Discussion on the risks, challenges, and strategies of building AI companies in the UK, including investment criteria and global competition.

“All right, so let's actually get into some of the detail of this.”

AI Governance and Venture Culture

14:03 to 17:46

Learn about the balance between government oversight and venture capital culture in AI investments.

“So he feels like he can keep the company here and achieve the best success he can.”

Decision Making and Investment Speed

17:47 to 19:47

Discover how the AI fund intends to streamline decision-making and investment processes.

“And I want to sort of move the conversation onto another aspect of your responsibilities as Minister for AI in a minute or two.”

The Role of AI in Future Employment

22:34 to 24:48

Understand the impact of AI on jobs and how governments can prepare for future changes.

“I'm assuming you are the very, very, very first Minister for AI in the history of British government.”

Long-term Scenarios for AI Adoption

24:49 to 28:00

Examine the long-term implications of AI adoption and the potential societal changes it could bring.

“The short answer to that, Robert, is I am thinking about those risks.”

Exploring the Future of Work and AI

28:00 to 28:39

Discussion on the impact of AI and automation on jobs and the economy.

“the direction of it as much as we can as well.”

Risks of Artificial General Intelligence

28:39 to 29:38

Exploration of potential risks associated with advanced AI technologies.

“But the thing I'd say is, I personally don't believe in that scenario.”

Governance and AI Risk Management

29:38 to 31:04

Insights into how governments are preparing for risks from AI developments.

“We are very rare as a government globally in having access to models before they're deployed in the wild to be able to test them for a series of risks.”

Training for an AI Future

31:04 to 33:19

Plans for training millions in AI skills and the role of education.

“which is all about whether we'll be in a position to shut down a rogue AI.”
Show all 17 chapters

Adapting Schools for AI Literacy

33:19 to 36:25

Discussion on the need for schools to incorporate AI into their curriculums.

“Obviously, it's going to replace quite a lot of jobs.”

Job Market Adaptation to AI

36:25 to 38:39

Addressing the need for dynamic job matching and curriculum adaptation.

“And then think about, you know, therefore, what are the skills within schools that, you know, kids should focus on?”

OpenAI and the UK AI Landscape

38:39 to 40:04

Discussing the implications of OpenAI's investment decisions on the UK AI sector.

“but the system adapts itself and more quickly than when the economy moves.”

Building AI Infrastructure in the UK

40:04 to 42:00

Exploration of efforts to improve AI infrastructure and data capacity in the UK.

“The main thing I'd say on OpenAI is that when the commitment was made, since then, there has been no change to energy pricing and there has been no change to the regulatory environment.”

Reforms to Support AI Growth

42:00 to 42:44

Learn about recent reforms aimed at boosting AI growth and data center development in the UK.

“Well, the one thing I'd say is I think under the radar, we've made a series of reforms that have effectively ring-fenced AI growth zones and data centers from a lot of the micro-challenges you're describing.”

Challenges for British AI Companies

42:44 to 44:29

Explore the challenges faced by British AI companies in competing globally and the implications of the UK market size.

“become a global leader while remaining essentially a British business?”

Financing Future AI Leaders

44:29 to 45:48

Understand the financial infrastructure's role in supporting the growth of future AI companies in the UK.

“One, I don't think the question of rejoining the EU.”
Hear the part that matters, and keep it.Open this episode in VO. Double tap your headphones to save a moment as you listen.
Get VO free

Transcript

Automatic transcript. May contain errors.

0:00Do you think it is plausible if we ever have another deep mind that it could become a global leader while remaining essentially a British business? The narrative being that we're nowhere in AI. The narrative is we're nowhere in AI, we don't have particular strengths, that we are only focused on sort of catching up and adoption rather than being in the frontier. We can do both of those things and we can do them really better than pretty much most people in the world. Kids are using AI and they're using it in a way where they're finding increasingly it's hard to tell between fact and fiction. Is there blue sky thinking going on in government about that scenario?

0:51Hello and welcome to The Rest is Money with me, Robert Peston. Now, as you know, Steph and I have spent an enormous amount of time on this podcast querying whether this government is preparing the UK properly for this AI economic industrial social revolution. And we have been, let's be clear, doubtful that the government gets it. Now, believe it or not, there is a minister for artificial intelligence. His name is Kanishka Narayan. And I'm delighted to say that Kanishka is joining us today. He's here because he wants to tell the world about this£500 million investment fund that the government is creating, a fund for investing in AI.

1:45But it won't surprise you that I want to talk to him about a whole raft of other questions, such as, is the government changing the education curriculum appropriately for an AI world? Are they thinking about how they'll raise tax revenues when there are no humans in jobs? How will we pay for schools? How will we pay for welfare? So a ton of stuff to talk to Kanishka Narayan about the Minister for AI. Here's our interview. Kanishka, very good to see you. Now, I've got open on my phone sovereignai.gov.uk, which appears to be an advert for all the great British people who made all the breakthroughs that led us to this moment.

2:37So for years, underrated Ada Lovelace, Alan Turing, the great genius without whom we wouldn't have today's AI world. We've got, obviously, Tim Berners-Lee. We nod at Dennis Asabis and AlphaFold, which is his incredible breakthrough where, you know, he's able to sequence all proteins as a result of, you know, DeepMind's astonishing prowess. And this was a number of years ago in AI. But I'm struggling, if I'm completely honest with you, to understand from this website what it is, because this website is sort of advertising this up to£500 million fund that you're launching for AI. It doesn't really tell me what it's going to do.

3:24So this is your opportunity to fill in the gaps and tell us what is this£500 million fund for. Great. Well, thanks, Robert, and thanks for having me on. Let me justify the website and then I'll tell you about the fund. So the website is effectively driven by this sense that in Britain in particular, I used to spend some time investing in tech in the United States. In the US, the reality is pretty good in technology, but the narrative about technology is just way ahead of reality. And if in fact, it pulls the reality up and into the future. And in Britain, we have the opposite challenge, which is that the reality is pretty good.

3:56We have an amazing history and heritage of all the people you talked about. And even the present reality is very good. But the narrative just drags us down and again and again. And so the attempt here - Or the narrative being that we're nowhere in AI. The narrative is we're nowhere in AI. We don't have particular strengths that we are only focused on sort of catching up and adoption rather than being in the frontier. We can do both of those things and we can do them really better than pretty much most people in the world. And so the website was a teaser as we were thinking about launching to say, let's build up some excitement about the story of Britain when it comes to AI.

4:25And then the specifics of the fund are like the fund was driven by the sense that in the last wave of technology, we let too many companies start by fantastic entrepreneurs, but ultimately leave when they were thinking about scaling. And we want to avoid that with AI. And so the fund is focused on early stage getting indoors with the companies, one to 10 million pounds of investment in some of our best AI companies, but companies where we will then not just use the cash, but every other lever of government, public policy, procurement. data, visa support, all of that together to anchor those companies more and more in the UK.

5:00Kanishka, there's a ton of other stuff we need to talk about, but let's quickly go to a break.

5:07We're proud to say that The Rest Is Money is powered by Octopus Energy this year. Greg Jackson is back to answer another question. Now, this is something that we see a lot that I wanted to ask you about. When you start in something new, how do you think about risk and momentum? I think people think entrepreneurs love risk, but I'm not sure they do. I hate it. I never buy individual stocks and shares on the stock market. I don't gamble. I think the thing about an entrepreneur for me is I've got more control. When you're working for a company, every day you're at risk of what that company chooses to do with you.

5:42If you're an entrepreneur, actually you've got far more say in what happens tomorrow and next year than when you're at the mercy of your bosses. Nice one, Greg. Well, thanks to Octopus Energy for powering this episode of The Rest Is Money. K-pop Demon Hunter's Saja Boys breakfast meal and Huntrix meal have just dropped at McDonald's. They're calling this a battle for the fans. What do you say to that, Rumi? It's not a battle. So glad the Saja Boys could take breakfast and give our meal the rest of the day. It is an honour to share. No, it's our honour. It is our larger honour. No, really, stop.

6:18You can really feel the respect in this battle. Pick a meal to pick a side. A participant in McDonald's while supplies last.

6:31All right, so let's actually get into some of the detail of this. I mean, actually, you know, one of the proposals I actually made in a book that I published before the general election, it's called How to Run Britain, was indeed that the government, given that we don't have Silicon Valley, I mean, obviously we have venture capital funds in the UK, but we don't have either the risk, high risk taking early stage backers of the scale that they have in California. Perhaps the biggest deficiency of all is we don't have the capability to take small companies global. We don't have the scale up finance.

7:12So I was making a very strong recommendation in this book that the government is one of the, in a sense, few institutions that can take the kind of risks that are necessary for the kind of returns that you can generate and that government ought to do this. But I'm a bit unclear about how much risk your fund will actually take in practice. Yeah. Well, I think I think the diagnosis is exactly right. You know, I used to invest in Silicon Valley and in the UK. The UK ecosystem is about eight times smaller. Now, you could say when you scale GDP, that's not totally out of kilter. But broadly, we think we can do much better in this context.

7:53In terms of risk specifically, you know, I have to place it in the wider context of all the other parts of capital the government is putting up. So we have an earlier stage, the riskiest bets that we're taking and therefore very focused in terms of early innovation are through UKRI and Innovate UK. that I know my colleague Patrick Valance has spoken to you about. What this is focused on is saying, by the time the British Business Bank comes into play with 20 plus billion pounds of capital, and then the National Wealth Fund, sometimes we lose companies between the very early stage university context and the scale of capital context.

8:26So this fund is very dedicated. So this is like a round two or a round three funding. This is round two. We call it seed or series A in kind of venture language. So this is very early stage still, but you've commercially spun out of the university. You're very focused on the commercial context now. And so seed and series A, very early door still, get inside, play all the other levers of government well so that the companies have the best chance of scaling. And when they scale, because the government is involved early on, we can help them with scale of capital through our other institutions as well.

8:54Just to be clear, would the criteria that this fund would use for determining whether to invest, would it be, would they be the same criteria as, I don't know, a Sequoia, for example, one of the biggest firms in the world, you know, rooted in California? Or, you know, I guess we've had on this program, very successful UK venture capitalists, Saul Klein. Would you be using the same criteria as he would be using? Or will the government be, I don't know, looking for different standards and different returns? There are two aspects to the criteria here. One is we want this to be an exceptional performing fund because ultimately we're focused on companies that can move the needle for the GDP of this country.

9:42and so you have to make sure that you are taken seriously by the wider ecosystem. If I'm a top-tier founder, I think this is a valuable thing rather than just a sort of I can't get capital from Seoul, I can't get capital from Sequoia, so I come to this. So we have to hold very high standards when it comes to portfolio-level returns. But the second thing is that we also have to say what is different about taking money from government and for that reason, a criterion is going to be are you a company which is relevant to UK sovereignty? And we would define that very broadly. Are you relevant to national security?

10:14Are you relevant to ultimately a path which makes this a trillion dollar company and therefore has huge economic implications? Or are you relevant in particular to aspects of life sciences and science, which we think are core anchors in sovereign build out of the future as well? So there are some distinct areas. We are not looking at sort of primarily commercial applications, for example, will probably be less likely to meet the filter because we think there's a very active venture market there. So high quality returns, a great fund, but at the same time, really focus on this anchor, which is how can the UK build companies of GDP level impact in this country?

10:50Are you, which is something that government has historically done, simply filling a gap? So would you expect only to invest in a firm that comes to you and says, actually, we just can't raise the money? Or is the criterion something slightly different from that, which is we can raise the money. Actually, we would slightly prefer not to take it all from Singapore or America. and therefore, you know, can you replace them as it were? So what is the criterion? For this stage, which is still early on, where we think there's a lot of capital available, the role is the latter. So the role is I can probably go and raise this money from a bunch of other people, but the problem has been that every time we've tried to do that historically, we've had to go to the United States, we've had to go to Singapore, we've had to go to Canada.

11:45by having UK investors, including Sovereign AI around the table, the chances that this remains a great UK company and is supported to be anchored here in the UK, those chances go up. Now,£500 million seems like a lot of money, but I was quite struck. I don't know if you've been following the career of somebody who sort of started out with Demis Osarby's bloke called David Silva, who was with him at Cambridge, with him at DeepMind. And, you know, it's been really, you know, was the leader of the AlphaGo project, which is, again, one of those great AI breakthroughs where, you know, AI, you know, defeated a Go, you know, this incredibly complicated game, a Go world champion.

12:34Right. He is setting up a business. He launched it only in November. which is called ineffable thinking. And apparently it's already got a value of 4 billion in terms of the fundraising that it's doing, but it's raising hundreds and hundreds of millions of pounds. And all of it's frankly from America as far as I can see. I mean, the lead investor here is Sequoia. Now, you might argue that this is precisely the sort of business that we should be trying to keep British. But if he needs hundreds of millions of pounds, British government hasn't got hundreds of millions of pounds. So it is inevitably going to be backed by American venture capitalists.

13:17Shouldn't we worry about that? Well, I think the main thing I'd say is that there are going to be amazing businesses. And David has an exceptional background, is going to build, I think, an incredible company in the UK. There are going to be businesses which will raise from US venture capital investors, partly for scale, partly for expertise, actually. we still have some great investors elsewhere who I think are good targets for UK founders. So it doesn't really worry you that in this particular instance, it's not going to be financed by British money? I want David to create a generation-defining company, and I want him to do it in the UK.

13:53If that means that some of the capital comes from abroad, that's okay. What I do want to make sure is that the UK, both in the private sector and in the public sector, is being the best partner to him. So he feels like he can keep the company here and achieve the best success he can. That is why we've been very deeply engaged with David. I hope he'll say to you, if you speak to him, that he has the sort of support he needs from the UK government. And it's my job to make sure that continues. So he stays here. Now, the other thing on the website we were talking about is, the other thing on there is a job description and a way of applying for the job of being the managing partner of this fund.

14:33Have you had many applications? We have had a ton of applications. I can't wait to talk to you about the appointment. I think the whole country and the ecosystem is going to be surprised at the quality of applications and the quality of the final appointment. I'm very excited about it. And that's, I think, a latent thing, which is that more and more people realise not only is this one of the most defining questions for economy and security, the future of AI, but more and more the best place to have an impact. We've seen this in the AI Security Institute on security questions. The best place to have an impact can be the UK government.

15:03Will they feel, do you think, that they are running a government institution or that they're running a venture fund? I want the day-to-day experience to be that of a venture fund. I think this only succeeds if we are the best partners to founders and to the wider set of investors in the ecosystem. People take the government signal seriously rather than as a sign of poor selection. That said, I want the managing partner to feel that they have all the levers of government at their disposal. And so we want to make sure that from a procurement point of view, there are pots of money, which means that they can call on government as a customer playing a role as well.

15:40from an investment point of view, that they're able to engage where national security questions are concerned to understand what is needed in those contexts as well. There is a huge amount government can do on visas and talent support as well. All of that made available, but the decision making, the culture, the pace has to be top tier venture. And in terms therefore of the culture, would this individual and their team get a profit share? I think the one area where we haven't done that is in the profit context. And that's because, you know, of course, it's very competitive at the moment in venture, people are making lots and lots of money.

16:14But the thing I felt, you know, I quit venture capital to do politics, because I felt it would make a big difference. I think there are a number of people who are now willing to focus on purpose and impact, if they feel like they can genuinely have the discretion to have that impact. We have been able to find that. Somebody who is maybe already made quite a lot of money, but now wants to do public service. We've had exceptional applicants, really top tier, experienced investors in this country and abroad who want to do this job. I feel very convinced that the offer of purpose with discretion is the right offer.

16:45And did you think about, however, a slightly different approach, which would have been to essentially have a blended fund, get some private sector money in? Because that arguably might have created more of that risk-taking entrepreneurial culture if you had, as I say, private sector money blended with yours and then a team that could perhaps share in the profits. Yes, the big thing I'd say is this is not the only shot we're taking a goal. This is one shot. The British Business Bank invests in a number of UK venture capital firms, which is exactly doing what you're describing. The government being a limited partner, taking a stake in those funds, but the funds being private sector funds, the right culture, the right decision making.

17:33In this context, we felt it was important from an information access point of view and the ability to use all the other levers of government, procurement, visas, data, that it was a bit more internal to government whilst having the culture and the decision making of venture. That's what we're trying to do with this. But it's not a needle. It's yes and both of those. And I want to sort of move the conversation onto another aspect of your responsibilities as Minister for AI in a minute or two. But I suppose if I were applying for this job, probably the first question I would ask you if you're doing the job interview is, OK, I have identified this amazingly exciting AI business.

18:21You know, if we invest, I don't know, five million pounds, can't 100 % guarantee we'll make a fortune. But, you know, we've kicked the tires, we run the due diligence, looks fantastic. Do I then have to wait six months for the Treasury to sign it off? Yeah, the answer to that is exactly no. The whole point of doing this was to set up something that could work at the pace and with a risk culture or venture. And so in every single aspect of design, including, by the way, you know, it might sound like a small thing. The reason that website looks like it, it does, unlike any other government website, was because in every small aspect of design and detail, I want this to sound and feel like a venture firm, which is the top tier firm.

19:05And so in terms of pace of decision making, we have agreed governance context, which means that it can now move at the pace that you would expect in venture as well. And we want that to be true of every other aspect of working with sovereign AI. So, you know, if a firm comes to you and says, look, you know, we can raise this money within the next three weeks from, as I say, this Singapore fund or this California fund. So we need an answer from you within three weeks. You'll be able to do that. Yes. OK, well, you know, proof will be in the pudding. Well, I can't wait for the first set of deals to be announced.

19:44you'll have seen that this isn't just a kind of promise in theory. We've actually already done this. Kanishka, the rollout of artificial intelligence, the artificial intelligence revolution is such a big subject. So much more to talk to you about. And in particular, I want to drill down into how the education system needs to change, how what young people are taught in schools has to be transformed.

20:10This episode is sponsored by Starling, the bank that helps you organise your money, build great habits and stay in control of your spending. Now, I talk a lot about financial literacy and its importance in our economy, you know, giving people knowledge, but also confidence with money too. And Starling reckons anyone can be good with money and you can start simply by checking your balance daily. It gets easier every day and it takes the mystery out of it. And then the real value comes from digging into the details with tools like Starling Spending Intelligence. So this is an AI powered search bar within Starling Current Accounts where you can ask a question about your spending habits and get an instant answer in app.

20:54It helps deepen your knowledge and make more informed money decisions. It's a little like having a financial co-pilot in your pocket, mapping out exactly where your money goes. Search Starling Bank to find out more. Good with money starts here.

21:35slash podcast. Terms and conditions apply. I get so many headaches every month. It could be chronic migraine, 15 or more headache days a month, each lasting four hours or more. Botox, Autobotulinum Toxin A, prevents headaches in adults with chronic migraine. It's not for those who have 14 or fewer headache days a month. Prescription Botox is injected by your doctor. Effects of Botox may spread hours to weeks after injection, causing serious symptoms. Alert your doctor right away as difficulty swallowing, speaking, breathing, eye problems, or muscle weakness can be signs of a life-threatening condition.

22:07Patients with these conditions before injection are at highest risk. Side effects may include allergic reactions, neck and injection site pain, fatigue, and headache. Allergic reactions can include rash, welts, asthma symptoms, and dizziness. Don't receive Botox if there's a skin infection. Tell your doctor your medical history, muscle or nerve conditions, including ALS Lou Gehrig's disease, myasthenia gravis or Lambert-Eaton syndrome, and medications, including botulinum toxins, as these may increase the risk of serious side effects. Why wait? Ask your doctor. Visit BotoxChronicMigraine.com or call 1-800-44-BOTOX to learn more.

22:44So, you are the Minister for AI. I'm assuming you are the very, very, very first Minister for AI in the history of British government. I think the bundle that I've got of AI and online safety is unique, but we have actually had a couple of ministers before me. Have you? Oh, right. Who were your predecessors? I didn't notice. Immediate predecessor. So Farrell Clark did this job before me. I think Viscount Camrose did the job as well. Okay. Very good. Very good. Well, it's a shame you're not a Viscount, but maybe it's a matter of time. But anyway, there are so many big public policy issues around when it comes to AI.

23:21So I recently had a conversation for the podcast with Tom Blomfield, you may have come across who founded Monzo, now doing venture in California with Y Combinator. It was a very wide-ranging conversation. But one of the themes we discussed is the sheer pace now at which AI is reaching a level of competence, which means that in particular a whole astonishing numbers of white-collar jobs, just at this initial phase, look as though they are, for humans, going to disappear. And, you know, if you look at the pace of change in robotics as well, it is, you know, whether you think it will be absolutely transformative of the economy or just a big shift, you know, either way, we are living through a massive change in the nature of employment.

24:29Now, he is one of those people who takes the view that over the next five to 10 years, almost every job that you can think of will be replaced by AI. I think income tax will go away pretty soon, sort of five to six year time horizon. I don't think we will tax human labour. I think we will tax compute. The short answer to that, Robert, is I am thinking about those risks. I am thinking about both the employment context, the implications for a wider economy. We set up a future of work unit. It has now been expanded into a wider AI economics institute that the Chancellor set out in her Mays lecture as well.

25:04And I want Britain to be the best in the world at having the quickest understanding, both existing signals of what is happening in the labour market and within firms, but also thinking long term about exactly, as you say, transformative AI scenarios and where public policy can go. In terms of, this is another cultural question, we're talking a lot about culture today. To what extent, because one of the problems, and this has been the reason why we weren't prepared, one of the reasons we weren't prepared for COVID, ministers tend to focus on today's problems and at a push, what are the things we need to achieve before the general election?

Read the full transcript

25:42but ministers and government is incredibly bad at preparing for something where you can't put a precise date on when the shock is actually going to happen. So I suppose the question is, you're thinking about this stuff all the time, but is there any mechanism for making sure that all the relevant departments of state and their ministers are thinking about this stuff? Look, I think the first thing I'd say is that there is very clear commitment right from the top, the Prime Minister and the Chancellor, that they believe what I believe, which is that the future of AI is the single most important question for our economy right now in terms of capital investment, for jobs in the future, for our national security, both cyber as well as drone and counter-drone defence system, and even for our clean energy aspirations when you think about the fact that to bend the cost curve on new technologies, we need AI to play a big role.

26:32So right across the board, whatever your objectives are in this government, those objectives are only served if you take AI deeply seriously as well. There is a genuine question of what do you do now, given the uncertainty about the timing and the scale, to prepare for all contingencies? One of the best things that we can do now, the lesson from every industrial transition of the past, is that the countries that are moving fastest on adoption are able to capture the upside of that in the greatest possible way. So that's why we're focused very much on adoption. I'm happy to talk about that in a second.

27:00But the second lesson is that there is agency, both for firms, for individuals, for governments. in what type of AI adoption we're doing. There are some firms, and I've spoken to Tom about this. I actually appointed him one of our AI ambassadors very early on in my job. There are some firms that Tom Blomfield is investing in, which are looking at total automation and substitution, taking away the human aspect, doing just AI. There are other firms, I've spoken to the CEO of one of the largest tech consulting firms globally, who said it's the biggest graduate intake year in their history. There's a robotics listed firm in the UK, which has had the biggest headcount this year as a result of adopting AI in a way that supports human labor, grows top line relative to Chinese firms, and as a result is able to become a bigger labor force as well.

27:45And so the question for me is, how can we move fast in adoption? How can we move fast in augmenting human labor, not just automating it? And really at the heart of it, not just in our politics in Whitehall, but across the country, make this debate more nuanced about not pausing AI or speeding up AI, but actually shaping the direction of it as much as we can as well. If you think there is a realistic chance of the so-called world of plenty, you know, where the marginal cost of production is nil because it's all done by basically robots and there are no human employees and therefore we've got to find a way to fund the welfare state, fund schools, fund hospitals and provide, you know, basic income to people.

28:30Is there blue sky thinking going on in government? about that scenario? So we're in the future work unit now, the Economics Institute, we are thinking about long term scenarios very much. Including that. But the thing I'd say is, I personally don't believe in that scenario. And here's why I don't believe in it. Whenever you have significant industrial change of that sort, even if you think this is very unique in the scale combining with the speed, which is the rare thing that's happening here, people who make money want to consume things. And when people want to consume things in a overall economy, what ends up happening is that the wages of the things being consumed still in demand go up very materially.

29:07You get lots more jobs in those areas as well. So you have this... Well, if those jobs can't be done by robots. Yeah. So what I don't believe is that every single possible thing that a human could want could be done by robots forever. I think there is no sort of fundamental cap on the number of human jobs, even if you assume very significant advances in artificial intelligence. All right. So then there's the other, you know, you pay money, takes your choice. what probability it is, but it is definitely one of those absolutely catastrophic long-tail risks, which is also what work is being done in government on what's known as P-Doom, which is the idea that as and when we get to serious artificial general intelligence, the all-powerful godlike AI will attempt to wipe us out.

29:57We are very rare as a government globally in having access to models before they're deployed in the wild to be able to test them for a series of risks. And so... Including the extinction risk. Well, I think the extinction risk plays through a series of different things happening. One aspect of that, of the sort of pre-doomed scenario, is loss of control. This is models being able to effectively run off and do things without human understanding or human engagement. And we test models for a series of risks, cyber, biochemical, in some cases, loss of control. And we do that not just with a view on the catastrophic extinction stuff, but with a view on saying, what does this mean for the governance and risks embedded in our critical national infrastructure, private sector today?

30:42And so we are very unique in understanding those risks, understanding them before others, and therefore being able to act on them as well. It happens to be an input into the possible P2M scenario as well. So of course, it informs my view and keeps me worried about where things might go. But for now, the most critical aspect of that scenario is a scenario that also affects things today. And as it happens, I've just finished writing a new thriller called Kill Switch, which is all about whether we'll be in a position to shut down a rogue AI. So we talk about this through the lens of alignment. We have a whole fund focused on this.

31:18We're doing a lot of work to make sure that models are very much aligned with what we're trying to do as humans and as a society. So now let's sort of talk about the potential benefits to earlier adoption. So you've got a strategy, you say, to help roll out productive, useful AI in public sector and private sector? That's right. So on the private sector side, the adoption strategy is effectively all the horizontal things, all the things that apply to all kinds of sectors and firms. So skills, we're training up 10 million people across this country in AI skills by the end of the decade. What does that mean?

31:57I've seen that pledge, but what does it mean in practice? How are you training up 10 million people? So that specific program, rather than the broader skills aspect, that specific program is focused on two things. One, we're partnering with the largest employers in the private sector and public sector. So the NHS is a part of that. But we also have large firms. Accenture, for example, we have firms like Cognizant as well. We have a series of large firms that we're partnering with. And we're saying, can we together design training that will most quickly move the pace on adoption in your firms and with the talent that is coming into your firms in the future as well?

32:33And so we're working together with them to make sure that those companies are skilling up the workforces that they're engaged with. Separate to that, we have a program where we're effectively allowing everyone in the country to be able to come online and for free through a government funded program, be able to learn the starting building blocks of AI usage in their sectors as well. And so there are specific kind of basic level things there. There are slightly higher level courses as well. We're driving the uptake of that through a series of other partners as well. So both specific places that we think can move the needle, but also a general program.

33:06And what about schools? Because one of the I mean, we had Mark Warner, a faculty also on the on the podcast. And, you know, one of the things we got into a bit of a loving over the fact that it's completely mad, it seems to me, that we the current sort of rule in schools is you don't use AI. Right. I mean, literally, my head wants to explode when I think about it, given that even, you know, if you're right, that what we're really talking about is AI more in terms of certainly in the next few years, augmenting our productivity rather than replacing us. Obviously, it's going to replace quite a lot of jobs.

33:51Then obviously, young people have to be comfortable using it right from the word go. So have you talked to Bridget Phillips and the Education Secretary about this issue that broadly at the moment schools ban it? Well, we're speaking, Robert, on a day where actually I'm on my way later to launch a series of technical excellence colleges focused on digital technology and AI. And so we have spoken and we have also started to act very significantly on it. But does she get it? Yeah, I think she does, actually. I think Bridget is very focused on how we can equip our kids for the future. And the thing I obsess about the most is I think all of government and frankly, all of our society should be focused on one question, which is the question I obsess about.

34:32How can we spend every minute of our time making sure that kids growing up in this country have jobs in the future, which are fulfilling? And also the cognitive context, which allows them to operate in a world of AI. What I mean by that is the context I'm seeing loads and lots is whether schools are formally doing it or not. Kids are using AI and they're using it in a way where they're finding increasingly it hard to tell between fact and fiction. And so it's on us to make sure that we're using our curriculum, using our teaching context to equip kids with a much deeper understanding of what is true, what is not true.

35:09And that cognitive ability to be able to manage AI is ultimately a really core skill that we need to build. Yeah, but there seems to me to be two other aspects of all of this. I mean, so the example, which I literally couldn't believe from a particular school, was a bunch of kids were being taught coding. And as you know, whether it's Anthropics Cowork or whatever, broadly, vibe coding is now a thing. Natural language coding is replacing an enormous amount of the coding industry. And yet these kids were told they couldn't use AI in the classroom. And this is just literally insane. As you know, Robert, you know, Cloud Code, Codex, Cursor, all these tools allow you to automate a bunch of lower level coding.

36:03What is still really important is software engineers who understand fundamental architecture can then manage and oversee the coding agent. And so we need to build those skills. we can't build those skills if we're still telling our kids that they have to do everything manually we have to teach them how to use the calculator when they're doing maths rather than just do it entirely in their heads and then I suppose the other aspect of the schools challenge is we do have to think very radically now about what are the areas of the jobs market where we think for the foreseeable future, AI won't be as good as humans, or even if AI could possibly be a substitute, that actually, you know, consumers won't want AI.

36:54They will want real humans. And then think about, you know, therefore, what are the skills within schools that, you know, kids should focus on? And they probably aren't. Well, the curriculum is definitely not the curriculum that would be ideal for that kind of AI world. And again, you know, do you are you having these these curriculum conversations with the education department and Bridget Phillipson or are they doing it autonomously, as it were, without needing to be nudged? Yeah, I think there are two parts to this. One is the curriculum conversation. The second is how do you design a system where the education system and the job matching system moves dynamically as the economy changes?

37:34So on the first of those, we're looking at a series of specific sectors. I'm actually launching a campaign very soon focused on chip design. We have far two kids in this country who currently think about chips and semiconductors, a huge part of the economy in the future. and also a part which is very hard to automate given the extreme precision that you need in some parts of it and the understanding you need of different parts of engineering. And so there are some areas where we're making specific bets. And then the second question to me is as a country which has one of the most centralized information on who has come to a job center, I remember going to Cardiff Job Center and giving my CV at the age of 16.

38:13It's probably in a drawer somewhere. We have tons and tons of this text data, interview data from all of us who've gone to the job center and then an understanding of what has happened when someone gets into a job, there is no better place to support the dignity of people looking for a job and deploying frontier technology in the service of that dignity than in better matching jobs to where the economy is moving. And if we can do that radically better, that is another way in which we don't just have to get the bet right in terms of what's going to be the next job, but the system adapts itself and more quickly than when the economy moves.

38:44Finally, I just wanted to focus on some of the sort of more microeconomic short term challenges. So obviously, I've seen that OpenAI is launching a research centre in London, which I think potentially will create quite a few hundred important research jobs in London alongside DeepMind. You know, London is now, as you've been saying, very much, well, the UK is very much ahead of the rest of Europe when it comes to digital and AI development. And London in particular is looking pretty healthy. But OpenAI did announce a few months ago, big fanfare from the government, Stargate UK, which was this massive investment in a data center and compute and a shelled it.

39:43And they've shelled it because energy is too expensive and because they were also unhappy about the data regime and their access to British data. Tell me first of all, how much of a blow was that when OpenAI decided to shelve that? Look, I want companies to invest in compute and data centers. It's a pretty important part of infrastructure. The main thing I'd say on OpenAI is that when the commitment was made, since then, there has been no change to energy pricing and there has been no change to the regulatory environment. What has changed is as well publicized as OpenAI's internal financing context has become much more challenging.

40:20And they have made similar calls in the United States with their program there as well. So, you know, companies get in trouble. Companies have challenges in financing commitments they've made. I don't want to hold anyone to kind of ransom on that front. The thing I'd say broadly is… But everybody does say, let's be absolutely… well, I mean, not only do they say it, it's objectively true. It is objectively true that the cost of energy in the UK is higher than in almost any of our important competitors. I mean, that is a competitive disadvantage. Sure. I'm not at all disputing that our energy pricing can be radically more supportive of AI in the future.

40:56It is obviously more expensive. That is just a factual claim. What I would say is that at the moment, we already have a good market share in both Europe and globally in that. I want it to be even further. And so what we're doing across policy is a huge amount. So you think it matters to have sovereign data compute capacity? Because some would say we've just lost that race. I don't think it's a sort of either or. So the United States has 100 plus gigawatts of compute capacity, 75 % of global share. And, you know, Stargate in the US is apparently still going ahead and it's, you know, 500 billion dollars.

41:29Yeah, I think it's going ahead with a smaller scale. So that's fine. I don't think it's the right thing for the UK to aspire to anywhere near that level of development. I do think it's really critical for us to have core parts of compute in this country that are important for health, financial services, defense, areas where we need data here in the country. Protected. Protected and our ability to allocate that compute to ends that are strategically important is really critical. How long will it take to get the relevant capacity? Because it feels painfully slow. Well, the one thing I'd say is I think under the radar, we've made a series of reforms that have effectively ring-fenced AI growth zones and data centers from a lot of the micro-challenges you're describing.

42:09AI growth zones will now be first in the grid queue from an order point of view. We will put money into local authorities so that those local authorities accelerate planning. We will offer them a concierge service and a connections acceleration so that they're able to move fast in the grid context. If they build in areas like Scotland, the North East and Cumbria, where you have curtailment, excess generation, the savings from them building there will get shared back in part with the investors. So we've juiced up the economics of it. So right across the board from a planning point of view, a grid point of view and a grid economics point of view, we're making it as attractive as possible to make sure that companies are building the data centres that we need in this country.

42:43I suppose in your heart, do you think it is plausible that if we ever have another deep mind here, that it could become a global leader while remaining essentially a British business? Because the one thing that we don't have here, which is obviously an enormous advantage to any business that basically has what economists would call network qualities, is the UK market is just tiny compared to the American market. One of the reasons why America has been so unbelievably competitive as an economy and so unbelievably good at creating world leading businesses over the last century is just because the domestic market is huge.

43:39We're not in the European Union single market anymore. when we as a nation were the leading force in creating the single market, it was precisely because we understood the economic benefits of market scale. But we don't have access to that anymore. So I suppose, as I say, take us back to my question. You know, absent at some point in the future rejoining the European Union single market And, you know, we have a we have a prime minister who says he wants sort of little by little to have more single market access, but he's not talking about, you know, full access. Could you be confident that a deep mind would achieve what Hassabis has now achieved if it remained British?

44:28I think about this question all the time. And let me just say two things on it. One, I don't think the question of rejoining the EU. And by the way, I want us to have a very productive relationship with the EU and the Chancellor and Prime Minister have been very clear on that. I don't think that is the single most pivotal question in whether or not we get a future DeepMind. And the existence proof is that DeepMind existed prior to Brexit. And DeepMind obviously found an owner in Google who was better able to finance its aspirations. And so whether or not a trade relationship expands your market enough to keep your biggest shots on goal like that.

45:06Certainly the financing infrastructure in their case was incredibly important. Google invested something like five to seven billion pounds over a 10 year period. and Google was able to do that because it was a huge company with network effects and a return on investor capital of 25 % year on year. We don't have that here. You know, people like me, I've spent my entire professional life, you know, wishing for Britain to have that kind of world leader. And my single biggest aspiration in this job is for the UK to create a trillion dollar company with all those effects to create amazing jobs here so that never again in the future that we have entrepreneurs here who don't have the financing possibility from a national champion in the way that I hope the Sovereign AI Fund will help contribute to as well.

45:49All right. Well, look, on that optimistic note, I'm sure our listeners wish you luck. There are big challenges and it's an incredibly interesting time to be doing what you're doing. But Kanishka, as always, very good to see you. And that's it for this episode of The Rest is Money. Goodbye from me.

46:10Transcription by CastingWords

From the publisher

What’s the point of the government’s new £500m sovereign AI fund? How is the government planning to avert AI Armageddon? Isn’t it time for AI to be permanently in the classroom not banned from it?

Robert talks to AI Minister Kanishka Narayan to explore the government’s strategy for a trillion-dollar British AI ecosystem-and whether the UK can truly scale a sovereign challenger to rival the likes of OpenAI, Anthropic and Gemini.

The Rest is Money is brought to you by Octopus Energy, Britain’s smart energy pioneer.

Email: ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠the⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠restismoney@goalhanger.com⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠

X: ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠@TheRestIsMoney⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠

Instagram: ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠@TheRestIsMoney⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠

TikTok: ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠@RestIsMoney⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠

Advertise with us: ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Partnerships@goalhanger.com
Learn more about your ad choices. Visit podcastchoices.com/adchoices

More from The Rest Is Money

All 210 episodes
270. AI minister: How we build a trillion dollar AI companyThe Rest Is Money · 47 min
Listen in VO