AI in Education, The AI Chip War, and Meta Superintelligence Lab Restructuring | Aug 18, 2025

18 Aug 2025 · 37 min

Ask about this episode

Ask anything about it. ChatGPT or Claude reads this page and answers with the times it was said.

Connect VO and ask about every podcast you hear, including the moments you saved. Add to ChatGPT · Add to Claude

In short

Podcast Summary: The Information's TITV - AI in Education, The AI Chip War, and Meta Superintelligence Lab Restructuring | Aug 18, 2025

Episode Overview In this episode of The Information’s TITV, host Akash Pasricha discusses recent developments in AI within education, the chip industry, and major corporate shifts at Meta. Key guests include Grammarly's CEO Shishir Mehrotra, Chris Miller, author of *Chip War*, and The Information's own Anne Gehan and Kalley Huang.

Key Topics Discussed

  1. AI in Education
  2. Grammarly's New AI Agents:
  3. Shishir Mehrotra introduces new AI tools designed specifically for students, enhancing Grammarly's functionality beyond just grammar checking.
  4. New features include:
  5. AI Grader: Assesses and grades student writing.
  6. Citation Finder: Helps ensure proper citations.
  7. AI Detector: Predicts how AI detectors will evaluate student work.
  8. Paraphraser: Assists in rephrasing texts.
  • The Future of Education with AI:
  • Mehrotra discusses the evolving role of teachers and students:
  • Teachers are becoming more like digital assistants, offering real-time feedback.
  • Students will learn to write both with and without AI assistance, paralleling the use of calculators in math.
  1. Walmart's E-Commerce Strategy
  2. Competition with Amazon:
  3. Anne Gehan reports on Walmart's challenges as it scales its e-commerce platform to compete with Amazon.
  4. Key issues include:
  5. Balancing small merchants and big brands, which Amazon has been handling longer.
  6. Recent policy changes requiring more transparency from third-party sellers, especially in health and beauty categories.
  • Consumer Perspective:
  • There’s a trade-off between product diversity (from small sellers) and quality assurance (from big brands).
  • Walmart aims to emphasize product quality to attract customers away from Amazon.
  1. Meta's AI Team Restructuring
  2. Meta Super Intelligence Labs:
  3. Kalley Huang discusses the reorganization of Meta's AI team, now split into four groups to enhance focus and efficiency.
  4. New leadership under Alexander Wang and Nat Friedman follows several restructurings within a short time.
  5. Employees report feeling chaotic and uncertain due to frequent changes in management.
  1. The Ongoing AI Chip War
  2. Chris Miller's Insights:
  3. Chris Miller discusses the geopolitical and competitive landscape of the chip industry.
  4. Key points include:
  5. NVIDIA's strategic decisions regarding sales in China.
  6. The emergence of new AI chip startups and the challenges they face against established players like NVIDIA and AMD.
  7. The importance of TSMC as a semiconductor manufacturer that supports both startups and major companies.
  • Energy Efficiency:
  • A growing focus on making chips more energy-efficient, which is crucial for the sustainability of data centers.
  1. Conclusion and Future Outlook
  2. The episode concludes with a reminder of the rapid developments in technology and AI sectors, particularly how companies like Walmart and Meta are adjusting their strategies to remain competitive.
  3. Akash Pasricha emphasizes the ongoing nature of these discussions and invites listeners to stay tuned for future updates.

Key Takeaways

  • Innovation in Education: AI is reshaping the educational landscape, with tools designed to assist rather than replace traditional learning methods.
  • E-commerce Dynamics: Companies like Walmart are reevaluating their seller policies to improve product quality while scaling their services.
  • Meta's Adaptability: Meta's frequent restructuring reflects the fast-paced nature of the tech industry and the need for clear organizational frameworks.
  • Competitive Chip Landscape: The chip industry is competitive and complex, with multiple players vying for market share amidst geopolitical tensions and technological advancements.

Additional Resources

  • [Walmart's E-commerce Strategy](https://www.theinformation.com/articles/walmart-backing-away-trade-desk-amazon-ad-tech-rival)
  • [Amazon's Quest to Displace Google](https://www.theinformation.com/articles/amazons-quest-displace-google-internet-ad-powerbroker)
  • [Elon Musk's XAI Developments](https://www.theinformation.com/articles/elon-musks-xai-runs-ex-google-talent)

Tune in to TITV every weekday at 10 am PT / 1 pm ET for the latest in tech news and analysis.

Written by AI. May contain mistakes. Listen to the episode to check what was said.

Hear the part that matters, and keep it.Open this episode in VO. Double tap your headphones to save a moment as you listen.
Get VO free

Transcript

Automatic transcript. May contain errors.

0:13Welcome, everyone, to the Informations TI TV. My name is Akash Basriche. It is Monday, August 18th, and we have got loads of exciting news to get to today. We have got the CEO of Grammarly coming on the show to talk about the company's new AI agents. We've also got Chris Miller, author of Chip War, coming on the show to talk about, well, the chip war and where he sees this playing out. We're also going to get to Meta's fourth restructuring that its AI team is going through. That was a story that we published a few days ago, and we are going to get the latest on that from our meta reporter. But I want to start with a story that we just published this morning about Walmart.

0:51Walmart has been quickly growing its e-commerce business as it tries to compete with Amazon. And along the way, it has started to encounter some of the exact same problems that Amazon has long been grappling with. One of those problems has been balancing the number of small merchants and big brands on the platform. And my colleague Anne Guillen published a story this morning about how Walmart is dealing with all of that. I want to bring on Anne to tell us all about what she found. Anne, happy Monday. It's great to see you. Happy Monday, Akash. Good to see you. So let's talk about Walmart and e-commerce platforms, broadly speaking.

1:28I mean, when I go on Amazon or Walmart, I know that there are these big brands, and then there are also some of these smaller merchants. and what you started to tell us about in the story this morning is how these companies balance these two groups. Tell us about that. Yeah. So I think more and more consumers are starting to understand this in a bit more detail. And I'll just use Amazon as the example because they've been around longer. They've been dealing with this longer. But a lot of the products on any online marketplace, whether it's Amazon, Walmart, they're not directly sold by Amazon or even by the brand whose product it is.

2:12So, you know, Olay moisturizer, Coppertone sunscreen, those products aren't necessarily being sold by the brand directly. Oftentimes, a lot of those products are being sourced and listed and sold by what are known in the industry as third-party sellers, but they're typically small, independent sellers. A lot of times people do it as like a side hustle or as their full-time gig, just sourcing and selling different products. But that's where, you know, a bulk of the products on Amazon's marketplace come from these days are these independent sellers. And they're like resellers, essentially? Is that the idea?

2:55essentially yeah they're new they're new products um but they it's not being sold directly by the brand they're either the resellers are either purchasing the products from the brand or they're getting them from a wholesale distributor like beauty supply company sometimes they get them you know at off price or liquidation stores there are all kinds of ways that these resellers can get their hands on these products, which is part of the problem that Amazon and Walmart both want to have more information about where these products are coming from. Okay, so you've got these big brands and then you've got the resellers.

3:34These are the third-party vendors, I guess. Your reporting in the story this morning was about how Walmart is dealing with some of these smaller resellers. Tell us about what you found. Yeah, so in my story this morning, I reported that over the past couple of weeks, a lot of small resellers on Walmart's marketplace have seen their products be suddenly taken down, delisted. And what Walmart has told them so far is that they are changing a lot of their policies around who is allowed to sell certain products, particularly in the health and beauty and personal care categories. So any cosmetics, skincare products, sunscreen, lotion, anything like that, Walmart is taking another look at who is allowed to sell those products.

4:26So a lot of these third-party sellers, these resellers, they're kind of stuck in limbo right now because Walmart has taken their products down from sale, so they're not making any new sales. Walmart is asking them for more information about where these products are coming from. And Walmart has told them that, you know, that the new rule going forward is that only certain people will be allowed to sell these products, primarily the brands and then people who have explicit authorization to be a distributor or a seller of these products. And so Walmart is taking this perspective that they want less of these sort of smaller merchants, it sounds like, more of these bigger brands.

5:13Which one is better from the consumer's angle? You know, for me, is it better to have the smaller resellers or the bigger brands? It's a really interesting question. And it's what you mentioned, Amazon, at the beginning. And it's a question that Amazon and other online marketplaces have been trying to sort out basically since the beginning. You know, if you have these smaller sellers, You get more product selection, more pricing competition, a wider variety of stuff that you can promote to shoppers. But kind of the downside of that is that you don't necessarily have a clear window into where these products are coming from.

5:56You know, if you're the brand, you could get tired of all these small sellers undercutting your prices or selling things from last season. And so it's a really tough line for the marketplaces to walk. You know, do they keep the small sellers happy because they're buying advertising and they're paying for warehousing and fulfillment services? Or do they kind of forget the resellers and just go to work directly with the brands? So as a shopper, you don't necessarily see that going on behind the scenes. And what does this have to do with, you know, Walmart's goal to sort of catch up to Amazon? I mean, Walmart, obviously, it's a huge retail giant, right?

6:46It has this fast growing e-commerce business. I think you mentioned the e-commerce business right now is growing 11 times as fast as the overall business, if I have that number correctly. So it's trying to catch up to Amazon's e-commerce business. Is it doing a good job? Is it catching up? I mean, how does that competition look right now? Yeah, e-commerce is really important for Walmart right now. You know, obviously Walmart's a giant retailer, but e-commerce is still only about 20 % of their overall sales. So there's lots of room for them to grow that part of their business. And they've been trying to do that pretty aggressively over the last couple of years.

7:25And obviously Amazon is kind of their key rival in e-commerce. Um, but so the marketplace has been one way that Walmart has really been trying to grow its e-commerce sales and, you know, especially get shoppers where you might not be going to a Walmart store, uh, you know, find a new way to bring those shoppers in and get them shopping at Walmart. So Walmart has been doing a lot over the last couple of years to grow the number of products on their marketplace, get new sellers signed up. They've tried to be a little bit more friendly and welcoming to the sellers over the last couple of years compared to Amazon.

8:06But so for this move is really, I think they're trying to emphasize the quality of the products on their site. And, you know, this is something that Amazon has been dealing with for years. And so I think for Walmart, being able to say we're getting our products pretty much exclusively from brands, we know all our products that we're selling are legit, you know, I think that gives them a lot of kind of marketing firepower and potentially take a lot of shoppers from Amazon. Well, and it's a fascinating story. Thank you so much for coming on the show and telling us all about it. That is Ann Guillen, who covers e-commerce for the information.

8:45Now, we all know about how active meta has been in the AI talent war, spending hundreds of million dollars to poach star researchers. Of course, the next big challenge for the company is figuring out where to put all these people that they've hired, figuring out who will report to whom. Late last week, my colleague Callie Huang published some reporting about all the different variations that the company has been experimenting with to figure out what its AI org chart actually looks like. And I want to bring on Callie to tell us the current state of play. Callie, welcome to TITV. It's great to have you back.

9:18Thanks for having me. So tell us about what you found. What's going on in the land of org chart land for Meta's AI team? Yeah, so on Friday, I reported that Meta's new AI organization, Meta Super Intelligence Labs, is planning to split itself into four groups. The first is a lab called TBD Labs to be determined. Creative name. And then there's a group focused on products like it's MetAI Assistant. There's going to be a group focused on infrastructure. And then there is going to be FAIR, which is MetA's fundamental AI research lab. And that lab works on longer term AI research. So really, this is Meta's new AI leaders, Alexander Wang and Nat Friedman, starting to take some of their first big steps as the co-leads of Meta Superintelligence Labs.

10:22They come in after a particularly turbulent period for the company. And so Alexander Wang and Nat Friedman, they are sitting at the top of these four groups? Is that the way it is? Yeah, exactly. Okay. This is not the first time that Meta has reorganized itself in its AI team. No, it's not. It's actually the fourth restructuring in the last six months. Wow. Okay. So really, people are trying to figure out who their boss is. Yeah. I've talked to people who said, I have been here for three, four months. I've had the same number of bosses in that amount of time. And so how does this rearrangement now affect the company's overall AI strategy?

11:07How does it actually, sorry, backtrack. How did it sort of represent the new AI strategy? Yeah, so I mean, the company has had a pretty challenging last couple of months with AI. And in particular with its work on its flagship model, LAMA. And so Meta CEO Mark Zuckerberg has gone to great lengths to kind of turn that ship around. He, Meta agreed to spend$14.3 billion in June to invest in Scale.ai, which Alexander Wang previously led, and then struck a similar deal with Nat Friedman and Daniel Gross, the former CEO of Safe Superintelligence, to partially buy out their venture fund and bring them on board.

11:58um so this is really you know those new leaders kind of starting to figure out what they want um previously they brought in all the ai efforts under alexander wang right um and now they are sort of starting to sort out um where things might be duplicated etc so one of the questions i want to ask you is look you mentioned this is the fourth reorg and who knows it might reorg again two, three weeks from now? We don't know. However many variations it goes through. What I want to know from you is how employees are feeling on the ground on this team. Because in my mind, if you don't know who you're reporting to or you don't know what the structure looks like, how do you get any work done in the AI team?

12:45Yeah, it's really tumultuous. People say that it feels chaotic. I think the idea is that this reorg will hopefully be the last one for a while. You know, Meta is known for doing a lot of reorgs, but typically that is once every six months, not four in six months. They did one in February, where they moved out two engineering leaders and brought in a new product leader. They did another one in May. where they split up the group. And then they did one in June after Wang and Friedman came in. So that's a lot of change. It's super distracting. It's hard to focus. And so I think the idea is that hopefully this time around, things will settle down a little bit.

13:37And last question for you before we let you go. That new team, TBD Labs, what is to be determined? What is that team going to do? What's to be determined is its name. Oh, okay. Okay. What does the group do? The group is going to be working on Meta's new model, the newest generation of its model llama. So it strikes me as like, that's like the most important team. Yeah. I mean, this is where a lot of the new AI researchers who are coming in are working. And they've brought in people from around the company. Got it. Any bets on the name? I've heard some things, but probably to save for another story.

14:18Okay. All right. Well, when you figure out the name and when you figure out what else the team is, you know, what they're actually coming out with, then come back in the show and tell us all about it. That is Callie Huang, who covers Meta for the information. Well, it is officially getting close to back-to-school season, and Grammarly made news this morning, launching new AI agent tools for students. Part of the new product suite includes tools to make sure students are being responsible with their AI use, and Grammarly has also been trying to expand itself beyond just grammar-checking software with a series of acquisitions lately.

14:51Here to talk about all of that is CEO Shishir Mehrotra. Shishir, welcome to TITV. It's great to have you.

15:01Haha, that's a rookie mistake. Great to be here. We'll go with it. We'll go with it. Shashir, it's great to have you here. So look, it's back to school season. Tell us about the products that you launched today. Yeah, I think this is a great step forward in what we think is the agentification of Grammarly. We view Grammarly as the original, the OG AI agent, works everywhere you work, assists you in everything you do. But up till now, we've been using it only for grammar check for, I like to call it, having your high school grammar teacher available all the time. And we're working on taking that platform and broadening it much, much broader to cover many use cases beyond grammar.

15:42So we launched today, actually last Friday, a set of agents that are expanded in areas that are pretty close to what we were doing, but really stretch how you might think about Grammarly and especially focused on students that are writing. So there's an AI grader that can take whatever you're writing and give you a grade for it. There's a citation finder that can go and make sure that you're citing the right work. There's an AI detector that can help predetermine what the AI detectors at the schools are going to say about whether there's AI used in the writing or not. A paraphraser, so on. So it's a set of different agents that broaden.

16:22And then you'll see us go much, much further with other agents coming very soon. So what exactly is the agent part of this? Because I think I understand ground release. It kind of checks things as you work the way that I understand the product, at least. So what is the new agent part of this? Yeah, I mean, I think this is a little bit, as I think about the definition of agents, I think agents, people have classified them in a few different ways. I think of there as being sort of three classes of agents out there. There's agents that are really consultative. There's the agents you ask. Those are, I think, what we're used to with products like ChatGPT.

16:56They're agents that are primarily focused on taking action on your behalf. They're sort of asynchronous action performers. And then we think of there's a class of agents we think of as assistive agents. And their job is to work right next to where you work. And the least interrupted way possible, help you perform your task. And so from that perspective, we view Grammarly as one of those original agents. It works in about 500 ,000 different applications. Every web app, desktop app, mobile app you can think of, we sit right next to you. We read what you're doing. We annotate it in ways that don't disrupt you or the application.

17:31and then we make changes on your behalf. I'm just trying to understand the back end here. I mean, as somebody writes something, as it's checking, you know, assessing its plagiarism score, or I guess assessing ways in which you can improve it, is that agent then checking things in the background? Is it going and communicating with other data sets in the background? Yeah, that's right. I mean, we're one of the biggest users of LLMs out there. We make over a billion LLM calls a day. And so every time you're typing, as you're typing on every key press, we're going and running a set of agents that look at what you've done and try to come up with the best possible suggestions, mux them together into a common set of recommendations.

18:15Everything from did you get the grammar right to did you cite the right work? Did you, you know, how are people going to react to it? What's the tone? And so on. soon we'll add a set of agents that go much beyond that, connect all your different data sources, be able to do things like check it against facts in your CRM system or in your past emails or past writing, and then agents that can take that further and use that as an initiation point to take action on your behalf as well. And which models are you using to do all this? We use everything. We have a set of in-house models that we've built over time.

18:50We use a lot of every level of the LLAMA models. We use all of the publicly available models from OpenAI and Anthropic. But one thing to note about us is we have every use case of LLM. So we have cases that need to run in incredibly fast speed and very low latency. So as you type, we have others where we can take our time and we can come back with a grade for your writing or for a reaction for what people might think. And so I think we end up being kind of at the front of every, every LM you can find. I want to talk to you sort of about Grammarly's broader strategy in just a second. But last question on this point here, you know, the thing about combining AI with education for me, at least the way I think about it, if you take a step back is some of this is the work that the teacher would have probably done, you know, in terms of providing feedback for the student.

19:43And then on the other hand, some of this is the work that the student would have done insofar as doing some of the thinking with respect to what goes into the writing. And so I guess if you have a software like Grammarly that is doing some of the work of the teacher, some of the work of the student, where do you think education is going here three, four, five years from now? How is it going to change? Aren't you just doing their jobs? Yeah, I mean, I think maybe two different points there. So when we talk about the teacher side and the student side separately, On the teacher side, I do think the role of teachers has changed dramatically, not just in the last couple of years, but over the last decade.

20:19I mean, I was at Google running the YouTube team when the advent of taking all your lecture materials online became a real thing. And, you know, nowadays it's very typical that many of the classes at colleges are actually broadcast online for free. And it completely changed what, you know, what do you pay for in college? Are you paying for going to the lecture? Are you paying for something else? And I think that was a massive step forward for education, but it had to really change the definition of what a teacher does. The teacher's job is not the lecturer. The teacher's job is the assistance.

20:48It's the work with the student. I think in this case, we're seeing yet another step of that. And I think what we're going to see is professors act a little bit more like the term I use is digital twins. And we work with a lot of different universities. Most of the large ones are customers or partners of ours. And I think what we hear from them regularly is that while in some senses what's happening with the I is scary, it's also a huge opportunity to bring a teacher directly into your experience. So today you can think of Grammarly as your high school grammar teacher sitting right next to you.

21:25Right. And very effective. It really not only does it help you do your work, it helps you learn. You learn all the patterns as you go. Now, imagine instead of, you know, today you have a class, you get an assignment, three weeks later you submit the assignment, you get back feedback. What if that happened every minute? As you were working, it wasn't just your grammar teacher, your history teacher, your chemistry teacher, so on, working right alongside you. I think on the other side on students, I think that, you know, since technology started, even with calculators, we've always had a dynamic of there are tools that help students in a way that could be used to circumvent learning.

22:02And it's very important to take a balanced approach. Like, I think just because we have calculators doesn't mean we don't teach kids arithmetic. And some cases you'll take a test and say, you know, no calculators allowed. And other times you'll say, actually, in the real world, you have a calculator. And so it's pretty important for you to learn what it's like with a calculator, too. And I think it's the same thing we're seeing with AI for students is that there are cases where schools are adjusting to say, we want you to be able to learn and work without these tools. But also they're leaning into, you know, in the real world, you really need to be able to use these tools well.

22:34So these are cases where we want you to use them actually even more and learn how you can apply them in your work. So you kind of see this as the way that when I was going through high school and stuff, I get either open book tests, there are passage analysis tests, there are tests where you have a calculator, you don't have a calculator. So you see the future of education being, we will have a class for writing and creative writing, for example, but then we will have a class where it's, we're not actually focused on the writing, it's focused on the history, for example, or putting - I mean, even in the case of writing, I mean, learning how to write with AI is its own challenge.

23:11And I think the I think we'll have the same writing class will have a mode that is we want you to start from scratch. Please don't ask for any help. Let's see what you do. How well do you know your technique? How well can you handle grammar and so on? But the other case of you can use anything you like. Now, now it's really about the ideas. What are you really writing? And I think the, you know, the the like the calculator, it doesn't remove. it actually just up levels what you can accomplish now. And I think we're gonna see both patterns in the same class, I think. Right. Well, great, Shashir.

23:44We don't have time to get to the broader strategy, but that is all the more reason that you're gonna come back to the show and you're gonna talk to us about Grammarly's approach to really broaden the product suite because you just did the superhuman acquisition. I know you came from Coda as well. And so you're gonna come back on the show and we're gonna have a broader discussion about that because that is a very fascinating part of this story. That is Shashir Mirotra, the CEO of Grammarly. They introduced new AI agent tools for writing today. Okay, for our final guest, chips and semiconductors have been perhaps the biggest rollercoaster of the AI boom with supply chain crunches, geopolitical tensions, and now new entrants coming in to try to capture market share left, right, and center.

24:24Few people know this world better than our next guest who wrote a book on this exact subject even before the world started paying attention to any of this. Joining me now is Chris Miller, author of Chip Wars. Chris, it's great to have you here. Thanks for having me. So look, we're going to talk about chips, but very quickly, we just had the CEO of Grammarly on. He's saying the kids are going to start writing with AI agents and stuff like that. Are you for or against that? Very quickly. I'm for so long as we're not forgetting how to write in our own as well. I think the calculator analogy is a great one, and we're just beginning to apply it to writing.

24:58Right. Right. Have you used any AI tools with your own writing at all, with your book writing endeavors? I use it all the time for research, less for writing myself. Great, great. Okay. Well, let's put that aside. Let's go back to the fundamentals of the business. Let's talk about chips. One of the things that has really struck me about the news of the last couple of weeks with NVIDIA and their ability to sell chips in China or not is, look, this is It's less than, historically, it's been less than 15 % of their revenue coming from China. And yet, it seems like it's taking an outsized portion of Jensen Huang's attention right now.

25:35The chips that they've gotten the green light to sell are kind of this watered-down version of the chips. They've got this revenue share agreement with the U.S. government now. So my question for you is, I mean, why bother with any of this? Why even focus on it at all? I think it's a good question. I think for most tech companies, China is the world's second largest economy. for all hardware sellers, it is a big market. And so, you know, fair to note that most of NVIDIA sales go to North America or to U.S. companies with subsidiaries elsewhere in the world. But it's hard to ignore the world's second largest economy, especially since, as Jensen correctly often says, China is a center of AI innovation with lots of new open source models coming out of the region.

26:17So the company is afraid that if it does completely lose access to the Chinese market, it's also going to be cut off from future waves of innovation that might emerge from China. And what do you think about this idea that the threat of a company like Huawei, for example, getting more traction in China because of the absence of NVIDIA there, the threat that Huawei could then become the next big player? Do you think that's a legitimate concern? I think it's legitimate to be concerned about Huawei getting better and better at designing chips better and better with its partners at manufacturing them.

Read the full transcript

26:52But I think that's already baked in. My view, my read of the history is that since 2014, when President Xi declared chips a core technology, China's been spending tens of billions of dollars a year in government subsidies to build up its own chip industry to become self-sufficient, to wean itself off American technology. And that actually happened before the first Trump administration and the Biden administration started cutting China off from different chip technology. So I think 80 or 90 percent of what China's going to do in terms of self-sufficiency is already baked in. And U.S. policy decisions are really marginal in terms of shaping China's calculus at this point.

27:26And what do you make of these smaller AI chip startups that we've written a lot about them at the information companies like Grok? You know, we had the CEO of Samba Nova on the show. You've got we've actually got an AI chip database of about more than two dozen of these companies. Do you think any of these companies actually stand a chance to take market share away from company like nvidia well it's certainly a a hard market to compete in when you've got nvidia both so dominant and charging forward uh so rapidly but on the other hand it's a massive market blown up in size just the past couple years and so no surprise that you've got new startups i think the challenge for startups is that you know the competition to nvidia comes in three different buckets there's amd an established player producing chips that operate similarly to nvidia's there's all the hyperscalers doing their own in-house chip design with chips that are perfectly tailored to the specific workloads they're running.

28:18And then you have all the new startups that are trying to make substantially more efficient chips, but starting without the software ecosystem, without the market traction, without any of the benefits that incumbency provides. So it's not just NVIDIA versus the startups, it's the startups versus all the rest of these big established players. And that makes this such a tough business to break into and in those three buckets of competition which do you find yourself most interested in these days as you do your own research you know here's the reality they're all going to win um because the market's grown so rapidly there's space for nvidia to grow substantially and amd will be the second source of choice because none of these companies want to be reliant on a single provider.

29:03But also, if you're meta or Microsoft or AWS, you're running such vast and specific workloads, you're going to have an incentive to design your own silicon too, which is why they've all been doing it now for, in some cases, over a decade. So long as the AI market keeps growing so rapidly, it's going to be less of an either or than a mix of all three of these. And the upstream hope they can break in and become the fourth option. One of the angles of the story I wanted to get your take on is the TSMC angle to this story, which underneath so many of these companies, TSMC is the one making these chips.

29:39And maybe we'll put the hyperscalers aside for a minute because I think they've got some other arrangements. But a lot of these chip companies, the smaller chip startups that we cover, a lot of them are using TSMC. And so my question for you is from their perspective, does it matter to them if they're making chips for NVIDIA or for some of these upstart companies? What's your research telling you there? I think if you're TSMC, you've got an incentive not just to be reliant on one big designer of GPUs. Like NVIDIA, you want to spread your bets, both because you don't know exactly how the industry is going to develop.

30:14some of the startups could break out, but also because you're constantly in negotiations over price and quantity with your biggest customers. And so having a bit more of a diversified market is in your interest. You can negotiate more effectively. So there's no doubt that TSMC's got to be very responsive to NVIDIA, but it has an incentive as well to see some of these other players at least survive and potentially even win market share to create a more balanced negotiating field for themselves. And so does TSMC have any kind of programs in place where it sort of tries to help some of these smaller chip makers sort of accelerate their business at all?

30:52It does, and not specifically focused on GPUs, but across the board, there are a number of programs that TSMC uses to help smaller firms build up their capabilities because it is so hard to go from startup to producing chips at scale. But I think TSMC also has to balance the desire to help new firms with the reality that a small number of big tech firms, Apple, NVIDIA, constitute a really substantial portion of their revenue. And so that's naturally where their focus is going to lie. And so how does TSMC help some of those smaller customers grow? Well, if you're a small firm, you've got to manage all sorts of complex IP issues.

31:31You've got to learn how to convert your chip from essentially a software file to a real piece of silicon. There's a lot of really unique know-how that TSMC has cultivated over the past four decades now that can help young firms learn how to replicate. So this is literally like consulting-esque support. This is them sort of hand-holding some of these smaller firms to say, hey, let's show you how you can really get from zero to 10 quicker, essentially. Yeah, that's right. And designing a chip from start to finish can take several years. It can require dozens of engineers who've already done it before, tens of thousands of millions of dollars for the most complex chips.

32:14So this is a really serious endeavor. And you can understand looking at those numbers why you often need a bit of help from TSMC if you're just a startup getting its first chip out the door. Another side of the story is sort of you've got the hardware, the chips themselves, and then you've got the software that runs on top of these chips. And some of the discussions we've been having in the newsroom here at the information is around how some customers, they find it difficult to, you know, swapping out the chip is one thing, but swapping out the software is almost harder in some cases than just finding a new chip.

32:49How much are these customers thinking about the software that goes on top of these chips from the people that you've talked to? Yeah, it's hugely important. And as you say, the switching costs are about both hardware and software. And just as the chips are getting better themselves every year, the software ecosystem around them is getting filled out and enabling new capabilities. And that's one of NVIDIA's core advantages, that the bigger the AI ecosystem becomes, the more people you have essentially investing in NVIDIA's software ecosystem, building out all sorts of different libraries and capabilities that NVIDIA doesn't charge for, but it makes NVIDIA's moat even stronger.

33:26Because if you do use a different chip, you've got to deal with a different software ecosystem. I think this is a core advantage that NVIDIA has, both vis-a-vis competitors in the U.S., but also vis-a-vis Huawei in China, where we've heard a lot about Chinese firms using Huawei's chips, saying the specs look pretty good. But then once you actually try to implement something with these chips, the software ecosystem is so wonky that it's hard to actually get something to work, whereas NVIDIA has got the best in class in the industry. And that really is a source of deep competitive advantage. Last question before we let you go, You've been covering chips now for longer than most of us have, given that you've written a book on the topic.

34:08This topic is well covered from the regulation perspective, from the technology perspective. We just talked about stories about the software perspective. There's the international supply chain perspective. What part of the story do you think doesn't get enough attention that you think we should be more focused on in the chip conversation? I think one of the key areas of focus in the industry right now is on energy efficiency and what that implies for future data center growth. We've heard a lot over the last couple of years about companies building power plants, for example, to power their new data centers.

34:41But the more we can do on chip efficiency, the less intense these power demands become. And so we're seeing a lot of innovation coming down the pipe around ways to make chips more energy efficient, to increase the efficiency of different chips talking together. And it's going to be a real area of focus for the industry over the coming years. And on that point, very quickly, I just want to get your thoughts here. One of the things that I've struggled with, actually, is when I talk to people about these AI chip startups, right? A lot of these chip startups say, well, we consume a fraction of the power that NVIDIA's GPUs do, or our chip runs faster, it is cheaper.

35:16There's loads of different ways you can slice and dice it. But when you talk to people in industry, they say, well, yeah, but it's actually not an apples to apples comparison, right? Sometimes you're talking about one chip versus a stack of chips. There's sort of different ways of sort of slicing the competition here. So I guess my question is, how do you think about that? Are these AI chip startups actually doing a better job than NVIDIA at the end of the day? I think the way to think about this is to look at general purpose versus specialized computing. NVIDIA's GPUs are pretty generalizable.

35:49They can be used for lots of different workloads. A lot of the AI startups have much more specific applications. They're inference only or even transformer only. And if you specialize, you can become much more efficient, much faster, much more capable at that particular type of workload. But you sacrifice the general purpose, that nature. And so it's not always about who's best. It's about whether you prefer a more general versus specialized solution. And the challenge that startups face is convincing companies that they should sacrifice some of the generalizability and adopt a more efficient but more specific job.

36:24Great. Well, Chris, thank you so much for coming on the show. I appreciate it. We're going to have a lot more news breaking on this beat as we go along. And so each time we do it, we will bring you back on the show to help us understand and make sense of it. That is Chris Miller, the author of Chip War. Well, that does it for today's show. A reminder, we are live on this stream Monday through Friday at 10 a.m. Pacific, 1 p.m. Eastern. I want to thank Amazon Web Services, who is our presenting sponsor for this production. And I want to thank you for tuning in. We really do appreciate your viewership.

36:54I am already excited for our next show tomorrow. And so until then, bye-bye for now.

From the publisher

Grammarly CEO Shishir Mehrotra talks with TITV Host Akash Pasricha about new AI agents for students. We also talk with The Information's Anne Gehan about Walmart's e-commerce fight with Amazon and Kalley Huang about Meta's AI team restructuring. Finally, we get into the ongoing chip war with author Chris Miller.

Articles discussed on this episode:


TITV airs on YouTube, X and LinkedIn at 10AM PT / 1PM ET. Or check us out wherever you get your podcasts.


Subscribe to The Information

Sign up for the AI Agenda newsletter


More from The Information's TITV

All 304 episodes
AI in Education, The AI Chip War, and Meta Superintelligence Lab RestructuringThe Information's TITV · 37 min
Listen in VO