In short
The episode covers AI autonomy and recursive self-improvement at Google DeepMind; a proposed industry self-regulatory AI safety standards body (SAFA) led by Google, OpenAI, and Anthropic; Anthropic co-founders’ IPO governance plan to retain voting control; DeepSeek’s rapid revenue growth and high margins; an op-ed arguing U.S. AI strategy lags China’s; and The Information’s AI Inflection Index themes.
Guests (backgrounds)
Corey Kovacilou, Google DeepMind chief AI architect; Stephanie Palazzolo, The Information AI reporter/host; Leo Schwartz, The Information reporter; Corey Weinberg, The Information senior reporter (Anthropic); Jing Yang, The Information Asia Bureau chief; Juro Osawa, reporter on DeepSeek; Christy Loke, MATS Research fellow; Eric Bellamo, Head of Research at The Information Pro.
Key claims & notable examples
DeepMind says RSI is staged: humans-in-the-loop now, agents trusted more to run supervised experiments during long (about six-month) training cycles. Palazzolo highlights open-source vs closed-source pricing shifts (Replit CEO: closed models cheaper after price cuts) and “Jev” (TypeSafe) confidence-score numeric outputs for classification. SAFA could test models, set incident-reporting standards, and possibly do capability/safety testing; critics warn of regulatory capture. Anthropic founders seek 50.1% voting control via a collective voting block (no extra economic rights; CEO ~2% ownership). DeepSeek: $1B ARR run rate (up from < $500M in July), >80% gross margin attributed to efficient inference/low chip costs; CEO says >70% compute for training and prioritizes Huawei domestic chips. Op-ed: U.S. is frontier-chasing and public backlash/AI fatigue; China uses a four-prong strategy including governance and livelihood. Inflection Index flags rising agentic commerce and custom inference chips; watches data-center/power buildout and bio/life sciences.
Written by AI. May contain mistakes. Listen to the episode to check what was said.
Chapters
Tap a time to open that second in VOCorey's Insights on Recursive Self-Improvement
1:05 to 4:18
Discussion on AI models and their training processes, focusing on recursive self-improvement.
“was our Editor-in-Chief Jessica Lesson's interview with Google DeepMind Chief Architect Corey Kovacilou.”
Highlights from AI Agenda Live Conference
4:18 to 5:46
Stephanie Palazzolo shares insights from the AI Agenda conference, focusing on AI models and market dynamics.
“I think one thing that came up a lot is the usage of open source versus closed source AI.”
Exploring the JEV Model
5:46 to 8:01
Discussion on the new JEV AI model and its unique approach to outputting results.
“And I mean, in the conversation that we had on the show with him, which was right after you interviewed him on stage, I mean, the part that I talked about with him was the fact that how sustainable can this be?”
Capability Overhang in AI Usage
8:01 to 12:06
Analysis of capability overhang and how AI tools are underutilized by users.
“And with JEV, it's trying to get around that by being very upfront, like, hey, I'm only 50 % confident in this answer.”
New AI Safety Standards Body
12:06 to 14:00
Discussion on the formation of an AI safety-focused standards body by major companies.
“Steph, stick around for a minute because I want to bring you back on and talk about a story that you and Leo published.”
Discussions on SAFA's Role in AI Regulation
14:00 to 19:35
Learn about ongoing discussions regarding the establishment and responsibilities of the new regulatory body SAFA for AI safety.
“Steph, what do we know about tactically what SAFA or this new body would actually do in terms of regulation?”
Anthropic's Governance Changes Before IPO
19:35 to 24:20
Explore Anthropic's co-founders' strategies for maintaining control as they approach their IPO.
“That is Stephanie Palazzolo, our AI reporter, and Leo Schwartz covering all things AI tech and politics here at The Information.”
DeepSeek's Rapid Revenue Growth
24:20 to 28:00
Discover how DeepSeek's revenue is rapidly increasing and its implications in the AI market.
“Corey, let me ask you one last question quickly before you go.”
DeepSeek's High Margins and Strategic Focus
28:00 to 33:11
Explore DeepSeek's impressive gross margins and their focus on model training over revenue generation amidst rising investments.
“So just orders of magnitude, much, much bigger.”
AI Ambitions: US vs. China
33:11 to 33:35
Introduction to the contrasting AI ambitions of the US and China, highlighting public skepticism and strategic differences.
“A new op-ed published in The Information suggests that America's AI ambitions in some ways aren't as well positioned for success as China's AI ambitions.”
Show all 15 chapters
Unpacking America's AI Strategy
33:35 to 39:59
Christy Loke discusses the US's current AI strategy, its focus on frontier technology, and implications of competition with China.
“I want to bring on Christy to share more about her perspective.”
China's Multifaceted Approach to AI
39:59 to 42:05
Examining China's AI ambitions, emphasizing a multidimensional strategy aimed at solving domestic challenges and ensuring governance.
“And also from a political perspective, disorder is no good, right?”
AI Strategies: US vs China
42:05 to 47:52
Explore the contrasting AI strategies and their implications for the US and China.
“And what does China's ambition or the way that they laid it out, what does it enable them to do better than what the U.S.”
Introduction of AI Inflection Index
47:52 to 48:38
Get an overview of the new AI Inflection Index launched by The Information.
“It is a new data product for pro subscribers that brings insights into key thematic opportunities in the AI area.”
Analyzing AI Trends and Themes
48:38 to 54:00
Delve into the trends and themes highlighted in the AI Inflection Index.
“So the inflection index aims to basically present quantified thematic insights based on our reporting and our corpus.”
Transcript
Automatic transcript. May contain errors.0:13Stephanie Palazzolo:Welcome everyone to the information's TI TV. My name is Akash Pasricha. It is Friday, September 25th. Today on the show, we have a busy show for you. We have some highlights for you from our AI Agenda live conference. we've got our conversation with Google DeepMind's chief AI architect. We're going to play a clip for you shortly. We also have some new reporting on a regulatory body that Google, OpenAI, and Anthropic are all working on. We have the latest on DeepSeek's funding round out of our Asia Bureau. And we're going to bring on the author of our latest op-ed who is arguing that America's AI ambitions are falling short of what they need to be to remain competitive.
0:54Stephanie Palazzolo:And we're going to wrap the show with a look at the information's new AI inflection index for pro subscribers. It's a busy Friday, so let's get right on into it. One of the standout conversations at our AI Agenda Live conference this week was our Editor-in-Chief Jessica Lesson's interview with Google DeepMind Chief Architect Corey Kovacilou. I want to play a clip for you of Corey giving us one of his closest looks yet on his view on recursive self-improvement. Here is that conversation. Are the models training themselves yet? Have we reached this recursive place? And if not, when? When we talk about RSI, when we talk about recursive self-improvement, I think the first thing that comes to everyone's mind is, oh, there is a system that just like end-to-end trains itself.
1:46And like without any human intervention, like there is something that is happening in that. Kind of in the name, but yes. Right. Right. But you can think that that setup is not necessarily right now end-to-end the whole system. We are not talking about that. There are sort of stages before you get to that. The first thing that already has happened is, of course, human in the loop, we are using our own models. We are coding with our own models. That gives us speed. That gives us the capability to research more, to explore more. That has happened. With that, we are partnering with AIs to do research better.
2:22The second stage from there is when you think about, as we talked, the training process, it's sort of like a six-month process. When you think about, okay, there's a model development going on, it's not like a two-week thing. We might release models every two to three weeks, but that means that you have a big overlapping windows of training that is going on. In that long training horizon, there are pockets of times where we will trust agents to actually do the training. and autonomously go and make experiments, look at the results from those results, figure out new experiments and new hypotheses and run those experiments and then come up with a solution that is all guided and supervised by humans.
3:07That is where we are right now. Of course, that is another level of partnership with the agents. And I think we are in the steps through that. But I wouldn't say when we say RSI, I think people imagine this whole big system. You press a button and you... Right, yeah, exactly. I don't like... So six months ago, were agents involved in the same way? I'm just trying to get a sense of what curve we might be on. No, but that's the progression that is happening. Six months ago, I think all of us were talking about, oh, we are using our own models to do coding. We are using our own models to do research.
3:43You have an idea, you would communicate with an agent. You would explore ideas. like bounce ideas off and those kinds of things. Now, you are trusting the agents more. That's the important bit. What we are trying to do is we are trying to build intelligence collaborators, coworkers that you can trust. The more you can trust that, the more you are going to be able to let that model, that agent run experiments. But it's again, in coordination, in communication and under that supervision.
4:17Stephanie Palazzolo:for more coverage of the conference i want to bring on stephanie palazzolo who hosted the event and many of the conversations on stage stephanie welcome back to the show it's great to have you here great to be back akash okay so let's talk about the highlights from this week's event for you what were some of the themes that really stood out to you from your conversations on stage Well, there are a couple. I think one thing that came up a lot is the usage of open source versus closed source AI. You know, surprisingly, open source has obviously been in the news a lot. There's lots of really great open source alternatives out there.
4:54But I was really surprised whenever I was on stage with Replit CEO Amjad Massad. And he actually said that he thinks that he uses less open source AI today compared to the beginning of the year. And when I asked him why, he said that basically OpenAI and also Anthropik to some extent more recently has just been so aggressive with cutting prices for some of their smaller or faster models that they actually have become cheaper than open source, which I think really goes against this narrative that open source is the cheapest type of model to use out there. And so that was really interesting and I think has led to a lot of questions, at least for me, around whether there's some sort of price war going on and I guess how sustainable this sort of price cutting is going to be, especially as OpenAI and Anthropic head towards the public markets.
5:46Stephanie Palazzolo:Yeah, no, that really stood out to me. And I mean, in the conversation that we had on the show with him, which was right after you interviewed him on stage, I mean, the part that I talked about with him was the fact that how sustainable can this be? Is this just a competitive strategy for the closed source model labs right now in terms of pricing? Or is it a token efficiency question? And so that was something that I thought that he made a good point on. tell me jev was the uh new model i guess that that everyone uh started talking about it's funny i didn't really know what jev was at all and i had to google it because it kept coming up in conversation what was the dialogue around it what is it by the way well you shouldn't feel bad about that because jev is like hot and and brand new to the market but yes you're right jev actually came up this this new type of model came up you know i think more than three times across panels just kind of unprompted so obviously a lot of ai leaders are thinking about it um essentially what the model is is this this new ai that was released by a company uh called type safe in recent weeks um and rather than you know kind of outputting these long paragraphs of texts that are in like written out english uh sentences like the ones that you and i are obviously saying now Now, Jeb basically outputs just like numbers and then like these confidence scores that indicate how confident it is in that answer.
7:18So one example that we gave is you might be asking Jeb, hey, can you classify this support ticket that we got as either like a billing issue or fraud or something? And Jeb would respond like, hey, okay, I think it's like 90 % chance that it's a billing issue and 10 % that it's fraud. So that's like a very like simple answer. But you kind of see how the way that the model is like producing answers is different than Chachapiti or Claude. It's very short, just like these kind of just, yeah, very short, like numerical focused answers. And kind of the point of that is that a one issue with LLMs today is that we don't always know how confident they are in their answers, right?
7:57Sometimes they very confidently make up information, which is like a big issue that people talked about. And with JEV, it's trying to get around that by being very upfront, like, hey, I'm only 50 % confident in this answer. So really, it's more like a coin toss versus like, I'm 99 % confident in this answer. And because of the architecture of JEV, it's much cheaper and much faster than a lot of today's frontier models. And so people have been really excited about that and have been using it for these kind of specialized use cases, things like classification, where the task is maybe more simple, but you also need it to be pretty cheap and fast to be able to be using a model to classify millions of emails or something, for instance.
8:38Stephanie Palazzolo:Were people drawing a parallel with the way that DeepSeq came in hot with its cheaper alternative to the closed source models? Was that kind of the vibe you were getting? So that's a very interesting question because I actually don't think it's quite the same as DeepSeek. So obviously, if we think about the kind of DeepSeek reaction, everybody was freaking out. Everybody was saying, you know, these frontier labs are over. Here's this, you know, Chinese lab that was able to make a model that's almost as good for just a fraction of the price. And yes, there are some similar kind of themes here around, you know, cheaper models and the fact that this one kind of really came out of nowhere.
9:18But a lot of developers are telling me that they're not using this model necessarily to replace LLMs, but kind of to complement their usage of LLMs. And so, yes, like there is some overlap in the use cases. And I'm sure people at the labs are noticing that and maybe like try to keep an eye on it. But you can imagine like you might want to use an LLM if you want, right, maybe you have a customer support bot. And you can kind of use them together, right? So let's say you have a customer support bot. Maybe Jev will read what the customer is asking and then classify it into, hey, is this a pricing issue?
9:55Is this like a refund issue? And then it'll feed it to an LLM, which will actually like talk to the customer, right? Because if I'm a customer, I don't want to see like random numbers popping up at my chatbot. I want to talk to like something that feels like a human. And so you kind of see how they can work together in a lot of cases and kind of be complementary rather than just like a full replacement of LLMs.
10:16Stephanie Palazzolo:Right, right. Let me ask you about one other term that kept coming up on stage. So capability overhang was something we kept hearing about. What is it and what was the discussion that kept coming up on stage? So capability overhang refers to this idea that people that use AI models today are not really utilizing them to their full potential. It's this idea that a lot of people use ChatBT or Cloud, for instance, as a Google search replacement. So you're just asking kind of basic questions like, you know, what were the results of this, like, baseball game yesterday? Or what's the weather like tomorrow?
10:53Things that you might use, like, Google search to do. But a lot of people haven't really fully taken advantage of all the things that these AI models can do for us when you do things like, you know, connect them to your email, connect them to your calendar, let them, you know, with codecs and things like that, you know, let them take over your computer to some extent and do things for you. and essentially the issue for uh you know some of the labs like open ai is that they have been saying you know a lot of our chat bt users are just really not using the app to its full extent and so now they're kind of facing this challenge of okay how do we get those users to actually like use chat bt in all the ways that we do within the company which is obviously much more advanced than the average person.
11:38Stephanie Palazzolo:Well, I mean, viewed another way, this could also just be the perpetual argument that every AI company makes saying there's so much more functionality that you're not using. And that is the reason that we're going to be able to charge more and that more people are going to adopt it. And then we get into all of the adjacent questions around trust and privacy and data and comfort and stuff like that. But I thought it was interesting that kept coming up on stage. Steph, stick around for a minute because I want to bring you back on and talk about a story that you and Leo published. That is Stephanie Palazzolo, our AI reporter here at The Information.
12:20Stephanie Palazzolo:The Information has exclusive reporting that Google, OpenAI, and Anthropic are pushing forward with a plan to create a new AI safety-focused standards body all by themselves Stephanie Palazzolo and Leo Schwartz reported that story. I want to bring on the two of them for more details on what they found. Welcome to the both of you. It's great to have you here. Leo, I want to start with you. So tell me a little bit about this standards body that you've reported on. Yeah, so we had reported before that there was discussions between OpenAI, Google, and Anthropic about creating a FINRA-like self-regulatory organization.
12:59The idea basically is it's a regulatory body run by industry with some government oversight. While there was interest in the White House, a potential executive order stalled, and the three companies have been continuing on the plan on their own. It seems a little more advanced than was previously thought. There's even a potential name, as we reported, the Standards Authority for Frontier AI, or SAFA.
13:22Stephanie Palazzolo:Another acronym. Another acronym. How lucky for us. I always try to come with a new acronym every time. Literally. It's like every time you come. We're going to make a glossary of them. And there's some optimism it could launch by the end of the year or early next year. So we'll see. Okay. And who do we know who might be leading Safa? Is there a short list of candidates on the table at all? We know there were names considered, including Sriram Krishnan, who used to serve as a top AI advisor in the White House, former Andreessen investor. uh condoleezza rice is considered to be the chair uh along with uh david friedberg of the all in podcast uh it's unclear who's being considered now but the plans do seem pretty advanced the first thing i thought when you said tree rom is i thought okay new acronyms but same people like it's it's it's the same people that are in the mix here for all these conversations maybe David Sachs will come back.
14:20Stephanie Palazzolo:Who knows? Maybe he'll get excited about it. Steph, what do we know about tactically what SAFA or this new body would actually do in terms of regulation? So to be fair, there is still a lot of discussion between the companies involved, Google Anthropic and OpenAI, about what exactly it would do. And we heard there is a decent amount of disagreement between those companies still. And it seems like the government is waiting for industry players to kind of agree on what exactly they want this new kind of regulatory body to do. But some things that we've heard is that they would support third-party groups that would conduct the testing of models.
15:01They would lay out some standards around how AI developers would report safety or security incidents that they have. They would also kind of define what these voluntary safety and security commitments the labs had previously made would actually look like in practice, among a number of other things. I think one interesting responsibility that they're still talking through is whether SAFA would actually do the safety and capability testing on models. So right now, the Center for AI Standards and Innovation is actually the group that's supposed to do testing of those models. But some members of SAFA think that KC doesn't have enough resources is to be able to really thoroughly test these new models.
15:46And they want to help out by also doing their own testing. And we've heard there's been some disagreement among the kind of working group around whether SOFA should actually do that or not.
15:57Stephanie Palazzolo:So Leo, Steph touched on this here, but KC is one group that there seems to be a little bit of overlap in terms of the main date here. Where are the other points of overlap with respect to the other groups that are currently doing some kind of regulatory work, groups that have been proposed. What are the differences here that this group is suggesting? Yeah, I mean, this is really one of the main obstacles facing the group, I think, which is just the fact that there are so many duplicative efforts happening already that do similar functions. So, of course, there's Casey, which is a small agency within the Commerce Department that was established under the Biden administration.
16:39Also, three years ago, this same group of companies alongside Microsoft came together to create another body called the Frontier Model Forum, which has many of the same general pillars of what it's supposed to be doing. I spoke with one person who had worked on the Frontier Model Forum and said that every time there's a new crisis, either politicians or organizations want to create a new organization and described it as performative. So I think this would really have to establish itself as doing something new and needing a reason to exist one explanation i heard for why it would be different is it would really be industry-led uh and because of that it could operate more efficiently maybe it would have more of a mandate and then of course it would at some point ideally come under government supervision or at least have a public private partnership so i think everybody is just waiting for that final regulatory body or organization that will finally be able to have the real mandate to do the type of safety testing or at least standards that a lot of the
17:41Stephanie Palazzolo:industry is waiting for so steph leo says everybody is was waiting as they are what is everyone's reaction right now to this idea that it would be open ai google and anthropic building this independent body either publicly or privately i wonder what people are telling you insofar as whether they would support this trio being the group? Well, I mean, as you can imagine, there has been some kind of pushback. I think a lot of people have been very public with this idea that, you know, having the three most powerful AI labs lead this push to kind of regulate themselves or do testing and standards for their own models is a little bit kind of counterintuitive.
18:27And I think many people are worried that they are, It's going to be kind of this regulatory capture issue where you have the leaders in this space, like, you know, setting up these very strict rules and standards that more up and coming players will not be able to reach. And that will make it hard for them to build models that are at the frontier. There's also been, you know, people very publicly that have kind of spoken out against this, people like Jensen. And there has been reporting that Mark at Meta as well has kind of spoken out against this sort of thing. So we'll have to see, I guess, whether SOFA expands beyond these initial three companies.
19:03I think you would think that if other companies kind of catch up and also start to reach the frontier, that they would also be included in this group. But again, things are very much still being worked out. So I think we'll have to see on that.
19:15Stephanie Palazzolo:Well, maybe, Leo, that was exactly the topic of conversation at the big dinner that happened last night with all of these leaders and President Xi, President Trump. We are going to talk a little bit more about that later on in the show, but I want to thank you both for coming on. That is Stephanie Palazzolo, our AI reporter, and Leo Schwartz covering all things AI tech and politics here at The Information. information. Anthropics co-founders want to make sure that they have voting control ahead of their IPO. This is a story that we have been reporting on for a few weeks, but my colleagues Corey Weinberg, Valida Pau, and Julia Hornstein reported new exclusive details on the arrangement that they are pushing for.
19:59Stephanie Palazzolo:I want to bring on Corey for more on that. Corey, welcome back to the show. great to have you here hey kosh what is the latest on what anthropics seven co-founders i think it is are seeking in terms of control here don't give us the latest so uh essentially a notice for a shareholder vote went out to anthropic shareholders last week and we finally got a better understanding of what's coming in terms of the big governance changes that Anthropic is trying to cement ahead of their IPO. Essentially, we talked about this and read about this last month, but we knew that the founders were seeking greater control over the company as it was going public.
20:50Once a company goes public, there's a much greater likelihood that it could face a takeover effort. It could face pushback from public shareholders. The founders want to have some sort of greater control over their ability to dictate Anthropics' future. And so they came up with a collective voting structure that gives them 50.1 % of the vote over a lot of corporate issues going forward, as long as three of them sort of maintain certain voting uh certain share threshold in the company so this is kind of interesting so so three of them
21:31Stephanie Palazzolo:so basically uh it wouldn't need to be that the founders all uh that they all have uh like a unanimous vote on certain affairs they would just need to be three of them that agree is that the idea no that's essentially three of them would have to maintain a certain voting threshold in order to remain in this sort of collective voting block that gives them 50 % of the vote. Corey, walk us through what you think Anthropics co-founders are afraid of here. What are the risks that we could see playing out post-IPO? I think we see it in the news cycles playing out every day, every week right now, where AI is an incredibly divisive technology.
22:19It's an incredibly world-changing technology and the anthropic co-founders believe that to their core um and when you're running a a corporate entity especially a publicly traded one that leaves open the door for other shareholders to come in and you know sort of try to wield their own influence in different ways. You see hostile takeovers, you see sort of different people being able to capture board direction. I think that's the fear.
22:58Stephanie Palazzolo:Right. Tell me, there were a couple of details in your story that I want to make sure we get to. So would these shares have, how much economic weight would they have in terms of, how rich this could make people? So the specific sort of mechanism by which the founders would be able to have this additional voting power, it doesn't have any extra economic interests. That just lies in the shares that they, the sort of normal, regular voting shares that they have. We know that the co-founders, both individually and collectively, own a fairly small percentage of the company relative to what you would normally see from a founder, CEO or co-founders group.
23:46And that's just because Anthropic has raised so much money, largely. So we know Dario Almede, the CEO, owns roughly 2 % of the company and the other co-founders own a roughly similar amount. And so they're going to get quite wealthy. They've fledged to give away 80 % of their wealth. And presumably having sort of these voting control shares would allow them to sell down at least parts of their stake in order to be able to live up to that commitment.
24:23Stephanie Palazzolo:Corey, let me ask you one last question quickly before you go. How do you think this voting control structure could affect investor reception to buying into this IPO? uh i think investors are pretty used to buying into companies that have strong founder controls you know we see it all the time with um dual class share structures that are quite common that give founders extra voting power what's different in this case are two things one this is a collective voting power for a group of founders and so investors are going to have to be comfortable with sort of what does this broader group think and how are they wielding power?
25:07It's not just how do I feel about the CEO, but how do I feel about this group? And then there's another group they have to think about, which is the Long-Term Benefit Trust, which is a group of non-shareholders that already exists at Anthropik and will continue to exist post-IPO. And they have the power to elect the majority of board members. That includes people like Fed Chair Ben Bernanke and other sort of independent sort of people in the business or public health or economic world. And so it's going to be a lot for I think investors to think through. I think at the end of the day, they're largely going to be trying to understand the business and governance in an IPO always ends up sort of not getting as much attention.
25:49But I think it's the kind of issue that becomes really, really important for companies in the future years. And we're going to see that, especially with AI. And that's why we're covering it so closely. Great.
26:00Stephanie Palazzolo:Well, Corey, I want to thank you for coming on. That is Corey Weinberg, our senior reporter covering Anthropic here at The Information. The Information published exclusive reporting that deep seeks annualized revenue more than doubled over the course of just a few months. Our Asia Bureau Chief Jing Yang spoke to Juro Osawa, who wrote the story alongside Channel You. Here is that conversation. Hi, Juro.
26:26Juro Osawa:You just reported some exclusive numbers on DeepSeek's revenue. What did you find out?
Read the full transcript
26:32Jing Yang:So we just reported that DeepSeek's annualized revenue run rate, ARR, just reached$1 billion. And this really shows revenue growth is accelerating because a few months ago in July, it was less than$500 million. So it has more than doubled.
26:54Juro Osawa:And that seems like a pretty impressive and fast growth rate. But how does this$1 billion ARR compare to revenues of ARR achieved by other Chinese AI labs? And also, how does it compare with the likes of OpenAI and Anthropic?
27:14Jing Yang:So this ARR, compared to other Chinese companies, especially the independent labs, it's kind of similar ballpark. it you know deep seek is kind of catching up and for example zai you know jupu so they said recently that their arr has reached 1.8 billion dollars so it's still bigger but minimax another listed company they said recently that arr is 800 million dollars so deep seek is current revenue is really catching up to some of those. But compared to US labs, it's still a tiny, tiny fraction because Anthropic OpenAI, their ARR numbers are in the tens of billions. So just orders of magnitude, much, much bigger.
28:06Jing Yang:So, yes.
28:08Juro Osawa:Yeah, I see. But what's very interesting in your story also is that you reported a couple of months ago that DeepSeek's gross margin from selling cloud-based access to its models were more than 80%, which sounds quite high and then even higher by OpenAI and Anthropik. So what is the reason behind DeepSeek's really high gross margin? Because we know that DeepSeek's token cost, its model still cost among the lowest, among the major language models.
28:47Jing Yang:That's right. Yeah. So DeepSeek's pricing is definitely, you know, it's one of the cheapest, you know, model providers. But what DeepSeek is very good at, according to, you know, all the people in the industry that we talk to is really their ability to keep the cost of running AI models very, very low so that, you know, the same amount of chips can run more or, you know, just to do the same inference. They require much fewer chips and including memory chips. You know, the cost of all these chips has really weighed on all of the major AI labs, but DeepSeq has kind of figured out how to do it, you know, very efficiently.
29:30Jing Yang:So that's what people cite, you know, including, you know, investors, their view of why DeepSeq has kept this margin very high. And 83 % margin is very, you know, indeed impressive considering, you know, their low prices. I see.
29:49Juro Osawa:That's very interesting. So these numbers were shared, you know, as you also reported, these numbers were shared by DeepSix CEO Liang Wenfeng in a recent closed-door meeting with investors as the company is, you know, looking to finalize its second funding round. What else did the CEO say to investors about Deep Seek's future strategy and its priorities?
30:15Jing Yang:So generating revenue, even though revenue is growing, you know, as we showed, but generating revenue is not the top priority. And the CEO, you know, kind of reiterated that their, you know, really priority is to train their new models, right? And I think they need more compute in order to, you know, train their new model. So DeepSeq is putting, still putting like the majority of their resources into the training of those models. And more than 70 % of their compute capacity goes into training. And then the rest goes into, you know, the running inference of the models. And one thing that, you know, we recently also reported from the same meeting, the CEO said, you know, their major priority is to, you know, train new models using Chinese domestic chips, you know, from Huawei.
31:13Jing Yang:And they've been working closely with Huawei, you know, in order to do more training with Huawei chips. And he said he expects Huawei to deliver those training chips, start delivering in the fourth quarter of this year. So this effort is going to accelerate. I see.
31:32Juro Osawa:I mean, isn't it quite refreshing to hear a company say that, you know, to hear a company whose revenue has been growing so quickly and at a very high margin to say that, well, revenue growth is not our focus.
31:47Jing Yang:It is interesting, especially for a company, who is in the middle of raising this second funding round. They're raising$7.5 billion, about$75 million US dollar valuation. And also they are preparing for an IPO down the line in Shanghai. So for a company like in that situation to say that, well, generating revenue is still not the priority. But I think people who know the founder, it has always been kind of his philosophy which you know he has talked about many times before that you know they their priorities still you know try to develop the models and deliver them you know make the model available to you know everybody and that's why the pricing is still low even after the price hike their pricing is still you know one of the lowest so that part But he seems to maintain that focus.
32:47Jing Yang:Of course, they do need to raise money and they want to go public. But that part seems to remain consistent.
32:56Juro Osawa:And we'll see how public investors in China would be responding to this kind of ethos when JPC goes public. This is a very interesting story that we will continue to report. Thank you, Jiu-Ru. Thank you.
33:15Stephanie Palazzolo:A new op-ed published in The Information suggests that America's AI ambitions in some ways aren't as well positioned for success as China's AI ambitions. The piece was written by Ryan Cunningham, founder of Edgerunner Ventures, and Christy Loke, an expert on all things AI in China and a MATS research fellow. I want to bring on Christy to share more about her perspective. Christy, welcome to the show. It's great to have you here. Thank you so much for having me. So I want to start with this line from your piece. You wrote, the country, the US, is financing an industrial revolution most citizens currently want no part of.
33:54Stephanie Palazzolo:Can you unpack a little bit of what you meant by that? Yeah. So currently there is increasing, we're seeing early signs of public backlash against AI, whether it's against the dangerous elements of AI, like the existential risk kind, or the fact that it seems like some of the AI data centers are being built in people's backyard and it's not officially appealing. So there is also, of course, this growing sense of AI fatigue that a lot of us feel. And that is not going to get solved easily, I would argue, unless if something changed in terms of the way that the U.S. government or the U.S. industry leaders go about articulating the vision that they have for global or inclusive success.
34:38Right.
34:39Stephanie Palazzolo:And I start with that because that is very much the context with which we are going into this conversation about what America's AI strategy is and what China's is. One of the things you do really well in your piece is you sort of break down what you view each of these strategies to be. And so let's start with the U.S. How would you define the U.S. ambition for AI right now in your words? Yes, I think a lot of it has to do with frontier AI maximizing and chasing. So the massive data center build out is a piece of this. And in the past, you know, a lot of the US strategy is about containing access to, you know, superior chips by the Chinese.
35:23So that's another kind of prong of that. The strategy is very much about accelerating at full speed, whilst making sure that the US continues to lead at the frontier.
35:34Stephanie Palazzolo:okay and but going back to what you were talking about i mean there is sort of another way of looking at this ambition which is that we just don't want to lose to china basically there's a lot of uh at least rhetorically there's a lot of the uh but china right like we want to do x y and z but china is uh um it's a looming threat you know if it gets there first then everything is ruined. I think to quote Basson very loosely, as was said recently. Right. And I mean, I want to ask you, I was at a dinner the other night and we were talking about this topic. And one of the comments that came up is, well, the US has not always talked about their technology ambitions in relation to what China is doing in the sense that the fear that China is developing things, we need to beat them.
36:31Stephanie Palazzolo:That narrative wasn't as strong or prevalent or driving the ambition 10 years ago than it is now. Do you agree with that? And what do you think has changed here? Yeah, I think for a long time, the US essentially was the technological hegemon, not just political hegemon. And so it's a very comfortable part of the identity as well. And China's rise technologically does challenge that. And I think a lot of folks in DC, a lot of folks in the tech world, but less so than let's say DC, still are a little bit delayed in their response to China's technological rise. So there's a lot of emphasis on distillation and a lot of doubt even post-deep seek that, oh, China can't innovate.
37:20You know, this can't be true, which is one way to stay comfortable. But it doesn't really chime with reality as we see it.
37:31Stephanie Palazzolo:Right. Okay. So what about China's ambition in AI? How do you view that and how is it distinct and different from the way that you think America is approaching us in a maximalist and sort of, in some cases, fear-based ambition? Yeah, so the way that China sees AI is, I would say, more multidimensional. And the reason for that is because of how they look at technology. I think the party state very much thinks, when they look at technology, they're trying to find solutions to existing problems, like essentially cures for existing problems. And for them for a long time, including now, the priority problem is how do they exit the middle income trap?
38:17How do they build an innovation ecosystem that allow them to produce some of these frontier or frontier adjacent productivity enhancing technologies? And so that's really their preoccupation. And the reason why I know this is because I actually found a document from 2006 called Short Medium Long Term Planning for S &T Innovation. And back then they were already talking about how to use like emerging technologies and different types of technologies to build a more robust foundation for development in the long term. And so when they found AI Soda in 2012 and Xi Jinping became very interested in the technology, It really very much is to solve the economic problems at home, which are, of course, linked to geopolitics and security and things like that.
39:07Stephanie Palazzolo:Do they care about pacing? What's interesting is that the strategic framework that they use when they think about S &T priorities and AI priorities has four prongs, right? And then, in fact, the fourth prong is all about governance. It draws the red line at, you know, if the technology that China's developing is no longer meeting, like making people's lives better, then the purpose of the technology ceases to exist. Which is really interesting. And because they draw that line there and because they have always been governance pilled, I think since 2018, when global discussions around AI focuses on both risk and opportunities.
39:55Yeah, I think very much they are incentivized to care. And also from a political perspective, disorder is no good, right? Domestic disorder is no good. Chinese open models wreaking havoc in the world is also very, very bad for PR. And so for all those reasons, they're very invested in essentially catching up to the U.S. safety frontier beyond just, you know, keeping up with the developmental frontier.
40:21Stephanie Palazzolo:Really quickly, you mentioned that that's the fourth prong. what are the first three prongs? Just lay that out very quickly for us. Yeah, of course. We talk about those three prongs in our piece as well. And so the first prong has to do with being close enough to the frontier. And the reason why that exists is because for a long time, China's really good at one to a hundred types of technology. So from tech to adoption, they're very good at that, but less good at basic technologies, right? And so adding that there is to incentivize like scientists to aim high, touch high is how they say it. The second component is actually about productivity gains from technology.
41:01And they often talk about it as the most important prong out of the four. Because if technology, according to them, can generate productivity gains, the productivity gains can in turn lead to more technological gains. And so it's a very positive loop. And the third component is really a sign of the times. Because when this strategy came out, when this four prongs came out. It was two years, two years-ish after the first export controls against like Huawei and CTE in China. And so they did a lot of soul searching and they figure out that in order to survive, you know, this sort of challenge, they really have to add technological security, supply chain security around core technologies to the third prong.
41:46And so that is the third prong. And the fourth one is about making sure that people are okay. You know, people's like livelihood, life and health are okay.
41:54Stephanie Palazzolo:So let me ask you this. And so if those are the way that China is approaching this, what do you think the U.S. can learn from that approach? And what does China's ambition or the way that they laid it out, what does it enable them to do better than what the U.S. has positioned itself to do right now? Yeah, by just having multi-prongs and having a diversified approach to AI development as early as 2020 when this came out, I think that set the Chinese political leaders, but also people that they then give signals to, you know, decide on how to implement and kind of, you know, actually implement, execute and get them to these goals.
42:45Um, so yeah, so that was very, very important. Um, and in terms of how the U S can learn from this, I think this really inspires in the sense of, oh, you can actually look beyond frontier AI chasing and you can also balance the governance goal, the risk management goals that you might have as risk emerge. Um, and you can also do this at the same time when you have to deal with security risk, Right. For example, over-earth is a part of this for the US side. And think about how to distribute the gains, how to make sure that people feel like they're on board with this fission for AI. They feel like they're actively benefiting from it.
43:28not because it's either damnation or you know like abundance but because maybe there's a middle path you know like in industrial revolution style but like a slow path where everyone can become more productive but also see you know incremental gains um and everyone can access the technology
43:49Stephanie Palazzolo:for example um through it's funny it's funny because you know i i think the researchers are all doing the same work on the ground um and it seems to me like this is all just a comms challenge really you know from the from the government's perspective it's like you know that's what we're talking about here is like how to really socialize uh the the work that your nation is doing and you know to what extent that incentivizes the uh positioning of these products and stuff like that last question before i let you go how much of the difference in these strategies bubbled up in this week's meetings between china and the u.s and the country's leaders i mean uh they were supposed to talk about ai i don't know that they really got anywhere materially but did we see the differences in strategies play out yeah so that's a really interesting.
44:48That's a really interesting question because the way I see it is although, you know, I was emphasizing how the way that the US talks about AI and the way that it prioritizes different parts of AI is very much like pro Silicon Valley, pro this AGI dream, pro American leadership. But at the same time, because of events of the past couple of months, you know, Trump is like legitimately freaked out, right? A lot of people in the administration are freaked out about the cybersecurity implications of a mythos-like model and the next iterations of it. And so I actually am on the more optimistic side where I feel like the two countries, because China is getting very close to the frontier, they're starting to see increasingly so, but not yet, similar-ish risks.
45:34And so the stakes of managing these risks are really high and are increasingly shared because of it, which is why, you know, Bessin and Halifong were able to have that meeting and come to a similar understanding of potentially the need to have an incident communication channel or mechanism. So that if, say, you know, a U.S. or Chinese model did something bad, you know, unintentionally, the other country's leaders and technical people will be able to say, OK, that was unintentional. So that level of the de-escalation is actually really important. And I see it at the summit as well. And in terms of what was kind of striking for me was actually C's subtle, not so subtle response to people who are advocating for pacing at the frontier or pacing the frontier.
46:23So the way that he framed it is because the US and China are major AI powers, they actually have the ability to, but also have the responsibility to manage these risks and make sure the technology goes well. So it's very much like a can-do spirit to the pacing question. And so what I do expect is that China's going to continue to invest in AI safety, going to look at the US very closely in terms of what the risk debates are, and try to get ready for worst case scenarios. And for Trump, because although he's very pro-leadership, he's also pretty scared of some of the less predictable AI security risks.
47:07And so they're going to continue to be able to work together in some narrow capacity. but that doesn't solve the domestic problems, right? The domestic problem for the U.S. is still how do you gain trust and have the public agree with this vision and feel like they can gain from it? And that is -
47:28Stephanie Palazzolo:Brings us right back to where we started the discussion, which was people don't have a lot of trust in it right now. So Christy, it was a great piece, a thoughtful piece. And I want to thank you for coming on and sharing with us more about your perspective That is Christy Loke, a research fellow of Matt's Research here on TITV. Earlier this week, The Information launched our brand new AI Inflection Index. It is a new data product for pro subscribers that brings insights into key thematic opportunities in the AI area. The project was published by Eric Bellamo, our head of research at The Information Pro.
48:10Stephanie Palazzolo:He joins us now to break it all down. Eric, welcome back to the show. It's great to have you here. Thanks for having me. I should say, welcome back. It's your first of many. We're going to have you on more and more, though. I mean, this is, you know, the Information Pro is, as a former Information Pro reporter myself, there is so much to dig into, and I'm excited to. So tell us about the AI inflection index. What does this thing actually show? Yeah. Well, again, thank you for having me. Indeed, the first of many. Happy Friday. Yes. So the inflection index aims to basically present quantified thematic insights based on our reporting and our corpus.
48:57So if you think about it, even over the last five years or so since the chat GPT moment, we've had about 10 ,000 documents, both articles and briefings that go in detail on a vast array of topics. So this index quantifies and maps over 80 themes on AI alone. And you could imagine as a subscriber or an investor that you might read one piece, go about your day, your job, make an investment, what have you, and then find yourself with a deluge of content, right? There's more content moving faster than ever. And this index aims to basically track those themes and track these developments over time.
49:42Stephanie Palazzolo:And give us a taste of some of the themes. Because one of the interesting parts here is you can see what themes are becoming more prevalent, which themes are sort of declining in terms of relevance to the moment. So give us a snapshot right now, what's trending up and what's trending down. Yeah, exactly. Again, this is a multifaceted development. There's a lot happening in real time. One that I actually like to highlight is agentic commerce. And I'm a former consumer analyst. So before joining the information, I covered consumer technology in general. And the idea of agentic commerce was one of the most visible kind of low-hanging fruits, if you will, in the world of AI.
50:27We could all imagine these personal assistants. But our index actually, I think, presents both a contrarian perspective and an accurate perspective. So we see the theme of agentic commerce emerging and gaining momentum in our coverage a little bit later than consensus, actually. But I think that's a more accurate read because we've had several checkpoints. We've had a wave of on-site shopping assistance. We've had the open claw moment transition to Muse. And even this week, we had headlines around Amazon and Meta and managing that traffic. And I think this is a more developed time to be talking about things like platform disintermediation, retail media networks, and so on.
51:10So that's one example.
51:12Stephanie Palazzolo:There's another one that really caught my attention. custom inference silicone? What are we seeing there? Yeah. So this is the idea of basically custom chip development. So OpenAI's jalapeno chip is a good example of this. And the idea being that large language models and generative AI becomes more specialized or more compute intensive, that we might need different chips developed for special purposes. And the idea that a frontier lab would be developing a chip in-house was a big deal and has significant downstream implications on the semiconductor trade. Also, I come from the world of private markets and the venture capital backing Challenger semiconductor startups, chips startups would have been hard to imagine not that long ago.
52:05And this year we've had significant financing going into some challenger startups. So, yeah, the overall idea being custom chip development beyond, you know, a typical offering, if you will, quote unquote, typical from NVIDIA.
52:21Stephanie Palazzolo:Another one for you that I saw, what's happening with data center build outs in terms of what you're seeing on the index? Yeah. So taking kind of one step back, right? Like the idea of data center and power for AI is a ubiquitous concept. Now we almost can't talk about it, can't not talk about it in a given day. But the idea part of behind this index is at one time, that was a percolating concept. That was at one time, just an idea people were getting their heads around before this became a macro trade, if you will. So we're seeing, number one, more momentum behind the coverage and the dialogue.
53:05But even taking a broader, a wider lens to this, it's interesting to think about. This is having significant implications on global treasury issuance, right? Long-dated treasury yields. these ideas were, this would have been hard to conceptualize not that long ago. And our index flags it as a watch list item, actually at the end of 2021. And by 2025, we have PJM, which is the largest grid operator in the US, estimating that 75 % of the region's increased capacity payments come from data center demand. So again, just to bring it back to the index, the idea is We flag an emerging concept early, and we see it incrementally priced by financial markets.
53:52And the idea is to give our readers a leg up on those developments. Right.
53:57Stephanie Palazzolo:And last question for you, Eric. Are there any terms that haven't yet peaked right now, but ones that are on your watch list, ones that we should be watching for? Yeah, we might need a whole other segment to talk about those. I am biased, as I mentioned earlier, in the direction of some of the consumer developments. We kind of talked about consumer developments and commerce. I think bio and life sciences is a big one. I think we all can sense that there's going to be some breakthrough. I think another way to think about it is we might have to have that breakthrough. The idea that to kind of get the public back on board in some respects with the benefits of the tech, you know, maybe the data center buildouts are worth it if it means curing diseases and stuff like that.
54:52Yeah, we might need to cure those diseases to build that trust. But the idea, again, it's relatively small, relatively nascent in our coverage. It is generating outsized attention relative to the share of coverage. But I think you're starting to see some of these developments in the market materialize too. So Isomorphic Labs becoming Dennis Sebastis' primary focus. Some of the DeepMind leadership focusing there. Anthropic has made some purchases, M &A deals in the space as well. So I think we're all looking for that, both as long-term opportunity and also kind of an area of urgent need as well.
55:36Right. Great.
55:37Stephanie Palazzolo:Well, Eric, I want to thank you for coming on. It's a great project. That is Eric Bellamo, Head of Research at The Information, and leading our Information Pro product here at The Information. Pleasure's gone. That does it for today's show. A reminder, we are on this stream Monday through Friday at 10 a.m. Pacific, 1 p.m. Eastern. If you can't make it then, episodes are available on theinformation.com, on our YouTube channel, or wherever you get your podcasts. Make sure to follow us on social media on X, Instagram, TikTok, and LinkedIn. I am already excited for our next show tomorrow. Have a great rest of your Friday.
56:12Stephanie Palazzolo:Bye-bye for now.
From the publisher
Google DeepMind Chief Architect Koray Kavukcuoglu talks with Jessica Lessin about recursive self-improvement and AI agent autonomy. Then: TITV Host Akash Pasricha talks with The Information's Stephanie Palazzolo and Leo Schwartz about SAFA, a proposed safety body from Google, OpenAI, and Anthropic; Cory Weinberg about Anthropic co-founders seeking voting control ahead of their IPO; Asia Bureau Chief Jing Yang and Asia Reporter Juro Osawa about DeepSeek's $1 billion ARR; Kristy Loke about why America's AI ambitions face headwinds compared to China. Finally, we get a peek at The Information Pro’s newest tool, which identifies emerging AI trends with Eric Bellomo, The Information’s Head of Research.
Articles discussed in today’s show:
https://www.theinformation.com/articles/google-openai-anthropic-ai-safety-group-takes-shape
https://www.theinformation.com/articles/americas-ai-dream-failing-launch
Subscribe:
The Information: https://www.theinformation.com/subscribe_h
Sign up for the AI Agenda newsletter: https://www.theinformation.com/features/ai-agenda
TITV airs weekdays on YouTube, X and LinkedIn at 10AM PT / 1PM ET. Or check us out wherever you get your podcasts.
Follow us:
X: https://x.com/theinformation
IG: https://www.instagram.com/theinformation/
TikTok: https://www.tiktok.com/@titv.theinformation
LinkedIn: https://www.linkedin.com/company/theinformation/
Chapters:00:00 - Introduction & DeepMind's Autonomous AI Agents02:18 - Inside AI Agenda Live: Open Source Price Wars & JEPA06:35 - SAFA: Google, OpenAI & Anthropic Form AI Safety Group11:10 - Anthropic Co-Founders Push for IPO Voting Control15:02 - DeepSeek Revenue Soars to $1B ARR at 83% Margin19:15 - Why America’s AI Ambitions Face Public Backlash24:05 - Introducing The Information’s AI Inflection Index
