DeepSeek Rises, Stargate Drama, OpenAI’s Operator Debuts

24 Jan 2025 · 57 min

Ask about this episode

Ask anything about it. ChatGPT or Claude reads this page and answers with the times it was said.

Connect VO and ask about every podcast you hear, including the moments you saved. Add to ChatGPT · Add to Claude

In short

Big Technology Podcast - Episode Summary

Episode Title

DeepSeek Rises, Stargate Drama, OpenAI’s Operator Debuts Episode Description: Ranjan Roy from Margins returns for a weekly discussion on key tech news covering DeepSeek's new efficient reasoning model, the implications for U.S. and China AI rivalry, and the launch of OpenAI's Operator agent.

Key Points Discussed

  1. DeepSeek's R1 AI Model
  2. Overview:
  3. DeepSeek introduced an efficient reasoning model known as R1, developed by a Chinese startup.
  4. Designed to be cost-effective, utilizing only $6 million in raw computing power—significantly less than competitors like Meta.
  • Performance Insights:
  • R1 ranks among the top models, tying for third place on Chatbot Arena, alongside ChatGPT-4O.
  • Analysts speculate if DeepSeek's success challenges the billions spent on traditional foundational models.
  • Industry Impact:
  • DeepSeek's emergence may shift focus from building increasingly larger models to product-centric approaches that prioritize user experience.
  • Quotes from notable figures such as Mark Andreessen highlight its innovation as "one of the most amazing breakthroughs."
  1. U.S.-China AI Rivalry
  2. DeepSeek is viewed as altering the competitive landscape between the U.S. and China in AI development.
  3. The efficiency of DeepSeek raises questions about the sustainability of large investments in AI from U.S. tech giants.
  1. Stargate Initiative
  2. A partnership involving OpenAI, Oracle, and SoftBank aims to invest up to $500 billion in AI infrastructure.
  3. The program seeks to build data centers crucial for AI growth, although concerns about funding viability and actual capital availability were raised.
  4. Elon Musk criticized the initiative's funding claims, suggesting a lack of serious financial backing.
  1. OpenAI's Operator Launch
  2. OpenAI has debuted Operator, an AI agent capable of autonomously navigating websites to perform tasks like making reservations and shopping.
  3. While initial demos look promising, concerns are raised regarding consumer adoption and practical utility compared to existing models.
  1. Apple's AI Struggles
  2. Analysts downgraded Apple stock due to underperforming AI capabilities, particularly criticizing Siri for not competing effectively with emerging generative AI models.
  3. Predictions indicate potential challenges for Apple’s iPhone sales as exciting product innovations slow down.
  1. TikTok's Status
  2. Despite previous threats of a ban, TikTok remains operational amid political discussions and scrutiny over data privacy.
  3. Ongoing negotiations for its acquisition continue, highlighting unpredictability in the app's future.

Conclusion The episode encapsulates a dynamic week in tech, with significant developments regarding new AI models, strategic investments, and ongoing competition between major players in the space. The discussions reflect broader trends in innovation, funding, and the evolving landscape of consumer tech.

Key Takeaways

  • The rise of efficient AI models like DeepSeek may redefine industry standards and investment approaches.
  • The Stargate initiative represents a major financial commitment by key players, though skepticism about its execution remains.
  • OpenAI's Operator could represent a significant step in consumer AI, although practical application and user trust are yet to be fully established.
  • Apple faces critical challenges in AI integration and product innovation, which could impact its market performance.

---

For further analysis and updates, be sure to tune in to future episodes of the Big Technology Podcast.

Written by AI. May contain mistakes. Listen to the episode to check what was said.

Hear the part that matters, and keep it.Open this episode in VO. Double tap your headphones to save a moment as you listen.
Get VO free

Transcript

Automatic transcript. May contain errors.

0:00The AI world is buzzing as a cheap, effective, open source model rivals competitors built for billions. OpenAI, Oracle, and SoftBank put a half trillion dollars in Stargate. But is the money really there? Agents may finally be here, and TikTok is still alive. That's coming up on a Big Technology Podcast Friday edition right after this.

0:22You're used to hearing my voice on the world bringing you interviews from around the globe. And you hear me reporting environment and climate news. I'm Carolyn Buehler. And I'm Marco Werman. we're now with you hosting The World Together. More global journalism with a fresh new sound. Listen to The World on your local public radio station and wherever you find your podcasts.

0:50Welcome to Big Technology Podcast Friday edition where we break down the news in our traditional cool-headed and nuanced format. Wow, we have a big show for you today. We're going to cover everything from this new model called DeepSeek, an open-source cheap model from China that is totally reshuffling the AI world as we know it. We're also going to talk about the big project called Stargate, where OpenAI, Oracle, and SoftBank are putting maybe up to$500 billion into an AI infrastructure project that OpenAI is going to use. OpenAI has also released Operator, a new agentic model, and TikTok's still here.

1:25Joining us as always to discuss all this and more is Ranjan Roy of Margins. Ranjan, welcome to the show. Man, we got real news, some fake news, everything in between. I don't even know where TikTok falls in that, but I'm ready. I'm ready. This is definitely one of the weeks that I've been looking most forward to recording our Friday show because there is so much stuff to talk about and real important developments that have just come throughout the week. And on that note, I'm sure we have some new listeners here coming in from my Demis Asabas interview, whether you found us on Spotify or YouTube or elsewhere.

1:58Just to give you a rundown of how the show works, we do a big interview every Wednesday with someone like Demis. Next week is going to be Reid Hoffman. And then every Friday, Ranjan and I break down the news that's happened over the week. We cover a lot of AI, anything big tech. And so we're so glad that you're here. So first, let's talk about this DeepSeek story, which is a massive, massive story. Basically, what DeepSeek is, is a much more efficient reasoning model. They just released this model called R1. It's built by a Chinese startup. And the crazy thing is that what it's taken American companies billions of dollars to do, it's taken them just a few hundred million.

2:36And I think that this could completely upend the AI industry as we know it. We're just starting to see the beginnings of this. And everybody seems to think that it's legit technology. So, Ranjan, I'm curious what you think about DeepSeek. Do you think it's legit and what does it mean for the industry? I am incredibly excited by this. I think this is one of the biggest stories in a while, exactly for the reason you're saying, that being able to train and deliver a model that's relatively on par with the expensive ones, with the O ones, I think this is huge. And it's what I've been saying for a long time, that the power of the model, the amount of money that's being kind of like claimed, the big shows around massive compute structures was all a bit of a show.

3:25And for actually delivering on something that people want to use, this shows that it can be done in a completely different way. And have you been using DeepSeek much? Like everything I've tested is relatively, and Joe Wiesenthal had a good piece on, you know, how a lot of these, like chat GPT can effectively be commoditized. Like a normal chat interaction with one of these models, you can get similar results. And I already switched between chat GPT, perplexity, Claude on a pretty regular basis. And now DeepSeek has made it to my favorites tab and is up there as well. That's crazy because it just hit like a couple of days ago.

4:04So let me just give a couple of stats that just show the magnitude here. So this is from the New York Times. The Chinese engineers said they needed only about$6 million in raw computing power to build the system. That's about 10 times less than the tech giant Meta spent on building its latest AI technology. For further context, I mean, you could build this model for$6 million. We just saw OpenAI raised the largest venture capital round in history at$6 billion, right? So that level of magnitude is crazy. And then you have it. So how does it rank? How does its performance rank? So I was on Chatbot Arena earlier today, which ranks large language models.

4:42And DeepSeek is in a tie for third place. So here is what the rankings on Chatbot Arena look like right now. You have number one, Gemini. Number two, Gemini. Number three, tie for third place between ChatGPT4O, the latest model, and DeepSeek. And then everything else that we've been talking about, Grok and the clods of the world are below DeepSeek. So this is crazy. The thing I can't get out of my head is, does this sort of invalidate all the billions that these research houses have been spending on training their models if DeepSeek can do it for peanuts and rank this highly on Chaput Arena? Yes, yes, and yes.

5:22I think the fact that we're seeing clods on it ranked at 18, Deep Seek tied at number three. I think it completely shows that the way we're thinking about foundation models at the center of the business battle for all these AI companies has been wrong. And I think the products, and this is my favorite, we always get into this every week, that for me, it's not the models, it's the products that are built on top of them and how good they are. Maybe this means that finally, we're going to move to a world where people actually focus on the product side of things and not the idea that the models and just having to build bigger and bigger and more expensive models is the only way that anyone's going to win.

6:06But then what happens to all these billions of dollars that these companies have invested in building foundational models? Really? You think it's completely gone? I mean, isn't that like a destructive event for Silicon Valley in a way that we haven't seen before? I'm going to go constructive instead of destructive. I think it's going to force a reckoning. It's going to really make people try to figure out what's the future, the next two to five years, let's say. And the way the battle has been approached over the last one and a half to two years of constant big unveilings and constant attempts at trying to sell the idea of these more and more powerful and bigger foundation models, it's going to move away from that.

6:52And meta, and we're going to get more into what they're doing, moving into open source, I think, was a powerful move from Zuckerberg from the beginning. But now having actual genuine competition on the open source side is fascinating. But yeah, I think the things that are built are going to be able to have, and it's great for everyone else. It's great for everyone else. It's not great for open AI, but being able to readily build and have your choice of what you're going to build on top of and being able to do it fast and cheap. That's good. That's wonderful. Just not for Sam. Right. And that's the way that Silicon Valley has been reacting to this.

7:34So Mark Andreessen called R1 one of the most amazing and impressive breakthroughs I've ever seen. And as open source, a profound gift to the world. Andrzej Mitha, who's also at Andreessen Horowitz, said from Stanford to MIT, DeepSeek R1 has become the model of choice for America's top university researchers basically overnight, which is fascinating because, as we know, universities just do not have NVIDIA H100 chips. They cannot afford them. And Arvind Srinivas, he also said, DeepSeek is two orders of magnitude more efficient with capital allocation than OpenAI. By the way, so after Arvind tweeted that, I DM'd him and said, hey, let's talk about this.

8:13I'm going to write about this. And then he deleted the tweet and never responded to my messages. So this is obviously, it sort of goes to show that this is really going to stir up Silicon Valley and AI in a way that we're just starting to grasp this week. I think the fact that Andreessen Horowitz and Mark Andreessen is saying this, I think is a big deal. Because yeah, it's really pushing the idea. And again, you think about it from like a more pure venture capital standpoint. It is exciting because rather than only being stuck with having to get into the late inflated rounds of just a few companies, it really potentially opens up the door for way more startups doing interesting things that can actually explode in growth and solve problems.

9:00Yeah. And we should note that Andreessen did sit out the opening eye round. Yep. No, I was definitely thinking about that. I mean, did they see this coming? And then that's why they sat out? I remember at the time, it was definitely notable. In my mind, I was like, maybe they've already seen some pretty solid returns from their early round investments, but maybe they really are believing in open source as the future. And that's really going to hurt the open AIs of the world. Yeah, it's quite possible. And I think that's one thing that we really need to hammer home here, which is not that it just took so much less money to build the model, but it takes so much less money to run the model.

9:42The model, the way that it works, is super efficient, right? And that is going to allow startups to be able to build on top of this stuff without worrying about what we've been talking about for months, which is this subprime AI crisis, right? The only thing that could have made this idea of the subprime AI crisis, which is basically that these companies have spent so much money training the models that they're going to have to charge people eventually a lot more than they're paying right now to use them. The only thing that could threaten that is if a model showed up that was so much cheaper to run.

10:15And that might be this one. Yep. It's rare that I'm agreeing with Chamath, but he came out and said that AI model building is a money trap. What you're seeing here is a feature of modern AI models, there's no bounding laws like Moore's law where advances can be predictably expected, and that open source will be the clear winner. And I think it's, again, it's clear that we, and the most exciting part about this is, we've all been debating scaling laws and what it's going to look like. But to see these kind of like step changes in terms of cost and efficiency, just coming out of nowhere, coming from unexpected places, and we can get into, how this fits into the larger U.S.-China technological battle and overall relationship, that stuff, that's the exciting stuff.

11:05Rather than just another big fundraise from OpenAI, this is the stuff that makes me happy. Yeah, same here. I mean, I was just totally blown away. I was planning on writing this week about the drama between Elon Musk and Sam Altman about the Stargate, which we're going to get into. But as the news came out about DeepSeek, I said, there's no way. And I had to make this the main story of big technology this week. And I just have been unable to get out of this news because it is so interesting. And then you think about it from the hardware side. So NVIDIA, right? Like what's going to happen with them?

11:36Because so many of their chips were needed to run the current models. And so there's a senior researcher who's pretty outspoken from NVIDIA. His name is Jim Fan. And he's addressed this in two tweets, by the way. So the first one talked about how DeepSeek is like the real open AI because they're open source and because they're making it available to so many people. But the second tweet was so interesting because he gets into the finance side of things. And I had like DMed him earlier and I was like, what's going to happen to your business? And he just puts out this tweet. He says, first of all, he says, it's a humbling wake up call to us that open science has no boundary.

12:11We need to embrace it one way or another. Then he goes on to talk about the financial aspect. many tech folks are panicking about how much DeepSeek is able to show with so little compute budget. I see it differently with a huge smile on my face. Why are we not happy to see improvements in the scaling law? DeepSeek is unequivocal proof that one can produce unit intelligence gain at 10x less cost, which means we shall get 10x more powerful AI with the compute we have today and are building tomorrow. It's simple math. The AI timeline just got compressed. And this is the, obviously it's the most optimistic.

12:49It's the best case scenario. And I was thinking to myself when I read that, like, yeah, if everything goes right, maybe that's the case, but I think I'm starting to be swayed by his argument. What do you think about it? Well, Jim, I am happy to see improvements in the scale. So I think the, again, trying to actually like directly quantify 10X less the cost 10x more powerful. Obviously, those are nice round numbers. But to me, the most important thing is it completely changes the competitive framing for every company in the space. Suddenly, when you are thinking about it, and already, I think I saw OpenAI said that O3 Mini, one of the better models will now be part of the free chat GPT plan.

13:33It's going to put heavy competitive pressure on everyone. And we will move to a world where the expected cost for a developer is more in line with what DeepSeek's offering with R1 versus what OpenAI and other in Anthropic are offering with their models. And that's good. Yeah. By the way, you can use DeepSeek right now. So you could just go in, sign in with your Gmail account and get using it. And if you click the R1 thinking model, you can actually see its chain of thought be written out. And it's pretty remarkable the way that it thinks through problems. And let me let me put this to you because I'm curious what you think about this.

14:11Is this sort of the beginning or the end? Here's my argument for the end. The AI industry might have hit this wall with the scaling laws. Everyone's talking about how data, you know, there's a data wall, the models aren't getting better, they are starting to see diminishing returns. And then the only way to continue to advance them is with reasoning. And what Deep Seek might have done is just a speed run through reasoning, right, where it's gotten this uptake based because it's figured out reasoning before everybody else and made it much more efficient and put that on top of, you know, maybe it's built that on top of old open source models to get these amazing results.

14:49Is it possible that this is just kind of the terminus for generative AI, where it's like, okay, it's what we have now, but it's cheaper as opposed to a step towards something more. No, I think it's certainly the former, maybe the latter, but the former that this is just what we have now, but cheaper. But I actually think that's such a big deal. And you said it, what does that mean for NVIDIA? What does that mean for OpenAI? What does that mean for Anthropic and Google? And actually, Microsoft plays a very interesting role in all of this as well, especially the relationship with open AI, but it just fundamentally changes the entire competitive landscape.

15:28So whether that truly means, and I'm a bit still, I mean, what is AGI? What is actual true reasoning? Just showing chain of thought processing is a nice UI trick almost. And I like it and it's good. And you should go to deep seek and play around with it. I think every listener should, but, But what does that actually mean in terms of, is this something fundamentally different? I am not convinced of that yet. But the same and significantly cheaper is a much bigger deal to me, actually, than some new level of reasoning. So can we just take a moment before we move on to appreciate how DeepSeek came about?

16:13Because the story is actually unbelievable. So it was built out of a quantitative stock trading firm called High Flyer. This is according to The New York Times. By 2021, it had channeled its profits into acquiring thousands of NVIDIA chips, which it used to train its earlier models. There's some Alexander Wang says they may have 50 ,000 NVIDIA chips, but that this came out of a quant firm. Bronjan, I feel like you with some ties to the trading world and some ties to China are uniquely qualified to comment on. Is this like just a typical Chinese story or trader story or is it as remarkable as I'm seeing it?

16:48Well, actually, I think that's why it makes it even more exciting for me. It's the idea that the greatest innovations, especially something focused around cost and efficiency, it actually seems more likely that it would come from a quant trading firm than a really kind of traditional AI research house, which many of the other companies essentially are with the business attached to it. And that actually, it does make more sense to me that making things much faster and more efficient coming out of, again, unexpected places is actually kind of cooler. And it also, it changes like what could be next?

17:28Who's going to come out with something completely unexpected in terms of what's the next big wave in generative AI? I think it just opens up the door in a very cool way. So just game out what's going to happen because of this. I mean, I saw there were some interesting pieces on blind, for instance. I don't know if you can trust this stuff. I have a meta executive coming on in a couple of weeks that I'm going to ask him about it. But basically, like, meta's panicking that, you know, DeepSeek was able to train a state-of-the-art model for less than the salary of, like, one AI executive. But I'm curious, like, what do you think this does to the valuations and the funding in the space?

18:04And does it invigorate AI startups to be able to build in the way they couldn't because it was cost prohibitive? I mean, it's interesting to me how meta falls into this, because again, meta investing heavily, but still like on the side of open source within this. So what did actual monetization look like or how are they thinking about it is very different than pay me for tokens on an API. But I do think, obviously, taking a breath for a moment, it's definitely come in and really taken the entire industry by storm this week. And let's let it play out a bit. But it changes the overall economics in a good workable way if this is actually going to work and if this actually people are able to start building real things on top of it.

18:52And the economics of the way things have developed over the last two years for a lot of these companies never made any sense. Everyone in the industry is talking about it, especially OpenAI is the poster child of just burning money and having unworkable economics. This, in a weird way, makes things actually a lot more rational in terms of business. Right. And another thing that's interesting is it's open source. It has an MIT license. So people have been able to replicate it. So you can't just say that it's like, OK, China, I'm subsidizing this stuff, which is interesting. But on that note, I mean, it's interesting that Mark Andreessen is the one that's out there hyping this the most.

19:28It is a product of China. And it is, you know, if you think about there's this race between the U.S. and China to develop the best AI. And now it doesn't look like they have the best, but they certainly are factoring in the race in a way that they haven't before. And, of course, you know, Andreessen's sort of been working with Trump on the transition. And he's one of, like, the tech MAGA guys. and I'm curious what you think it means. Do you think that this is a problem for U.S. competitiveness? I mean, this is the one thing we haven't touched on before and then we're going to move on after this.

20:00But like they were able to do this even though there are constraints on China because they can't import the top level chips and they were able to be creative and work around it. So it's just a fascinating wrinkle in the story to me. Yeah, I think it's definitely going to change. It definitely factors into the overall U.S.-China dynamic in a big way, especially kind of showing the world and, you know, the companies and the executives who are, and we're going to get into Stargate in just a moment, that is the symbol of what the U.S.'s leadership on AI looks like. So to kind of just go out and show, oh, we can do it completely differently and everything you're putting up front like that is actually wrong.

20:44It's a big deal. I think that the scale of how cheap the actual development and training side of this model, there's definitely a lot of debate around what was built over existing things that America had already developed, whether it was LAMA or other models. And, you know, what kind of leg up and advantage from a cost perspective did that give DeepSeek in developing this? There's certainly plenty of conspiracy theories around, like, is this a psyop or a front for the Chinese government just to kind of shake up in the entire industry that American companies have a great deal of leadership on? But I think overall, it's a reminder that let's say they did build on Llama and kind of like use existing work that had been heavily expensive and done by other companies.

21:35In a way, that's kind of a good sign for innovation overall. It's like, thank you, Meta and others for really putting in the CapEx to get the entire industry to a place where smaller organizations can actually do something big. That's right. And this is from Jan LeCun, the chief AI scientist at Meta, who's the one that's going to be on the show in a couple of weeks. Everything goes according to plan. He says, to the people who see the performance of DeepSeek and think China is surpassing the US in AI, you're reading this wrong. The correct response is open source models are surpassing proprietary ones.

22:09DeepSeek profited from open source research. They came up with new ideas and built them on top of other people's work because their work is published in open source. Everyone can profit from it. That is the power of open source research and open sourced. So on one hand, you have this huge victory for open sourced and cheap models. On the other hand, you got Stargate. And Stargate, so this is from the AP, Trump Highlights Partnership, investing$500 billion in AI. On Tuesday, Trump talked up a joint venture investing up to$500 billion for infrastructure tied to artificial intelligence via a new partnership formed by OpenAI, Oracle, and SoftBank.

22:45The new entity Stargate will start building out data centers and the electricity generation needed for the further development of fast evolving AI in Texas. The initial investment is expected to be$100 billion and could reach five times that sum. And so basically, to me, there's two sides of this equation, right? Two sides of the story. The first side is open source, cheaper models are starting to really hold their own with the bigger models. And the other side is we still don't know what the limits are of the scaling properties in OpenAI. And you have to spend a lot of money to get to the outer limit.

23:20Ranjan, I'm curious what you make of this. Is this going to be a big like watershed week because we have both of these things? Or do you think that this is more PR than anything else? I think we said there's real news and fake news this week. And I think this is going to fall into the latter. One thing this kind of like triggered in me. So I went back and looked. But for people might remember in 2016, almost like identical, like I almost felt like I was having deja vu. So in 2016, Masayoshi-san went to the White House, pledged$50 billion to create 50 ,000 jobs, said the words, I couldn't have decided such a thing before this new president.

24:04And at the time, that's when the first vision fund of$100 billion was being kind of finished up. And my favorite part of that whole saga was that they actually invested over$50 billion into the United States to create jobs. majority of that was in we work a bunch of it was in uber which you know did did all right but but overall he took something that already existed was already under like the works for a number of years and then went to the white house and said i'm doing this because trump is president so this one it really felt like that because we talked about there is a time i think how much did Did Sam Altman say they wanted to raise$7 trillion?

24:51$7 trillion. $7 trillion. Yeah, so now$500 billion, actually. I think he joked, why not$8 trillion? But there must have been some truth to that. So basically, the FT has reported that this has been under the works. Actually, there's a Washington Post White House reporter as well saying that this idea of$100 billion was already being pitched for a number of months. And then the money is not there. And this is obviously one of the best, juiciest parts of this, is that Elon Musk came out and basically called out this announcement and said that they max have like$10 billion. And then there was plenty of back and forth between Sam Altman and Elon Musk on this.

25:31But even the FT reported that Stargate has not yet secured the funding it requires. It will receive no government financing and will only serve OpenAI once completed. The intent is not to become a data center provider for the world. They have not secured the funding. A lot of people have been throwing out what are the potential compositions of what$100 billion can look like, but the numbers don't even add up anyways. This was such an egregious PR thing that I'm glad it has given us Musk versus Altman on this because at least we got something out of it. Absolutely amazing comments from President Trump on this also.

Read the full transcript

26:15They asked him if they have the money. He says, well, I don't know if they do, but you know, they're putting up the money. The government's not putting up anything. They're putting up the money. They're very rich people. So I hope they do. It's like, OK, so they don't have the money. So Elon is right on that. And even if, I mean, let's say they do get there, right? The question here is going to be, is this the right way to train, given what we just learned about DeepSeek? bringing it back to DeepSeek. This is from venture capitalist Jeremy Liu. If training costs for the new DeepSeek model are even close to correct, it feels like Stargate might be getting ready to fight the last war, like bringing an M1 Abrams MBT to a drone fight.

26:57No, I loved that. Yeah. The timing was almost comical, but still impeccable that this is the moment. And obviously in the Trump context, you don't want to say we have a faster, cheaper, kind of like more low key way of doing things. It has to be big and audacious. And that number 500 billion, it really falls into the, tell me a big number. What's the big number, biggest number you want to think of? 500, let's call it that. But here's the thing, like we are going to see much more capital put toward a new model, right? Or new model development. Maybe it's not a hundred billion from OpenAI, but it's going to be billions, billions of dollars.

27:39Like even 10 billion is double their most recent fundraising round. Then you have Elon Musk, who's going to build this million GPU super cluster. And by the way, hot breaking news right off the press here. Mark Zuckerberg posted this morning. Meta is going to build a two gigawatt plus data center that is so large it would cover a significant part of Manhattan. We'll bring along about one gigawatt of compute in 2025 and will end the year with 1.3 million GPUs. We're planning to invest 60 billion to 65 billion in CapEx this year. We're also growing our AI team significantly and we'll have the capital to continue to invest in years ahead.

28:15This is a massive effort and over the coming years, it will drive our core products and business, unlock historic innovation and extend American technology leadership. Let's go build. I do love how everybody has a note to Trump in their press releases right now. Look, here's the bottom line for me. You have these three research houses, at least, that are building these massive, massive data centers to train the biggest models known to man. And we're going to find out the truth about this scaling hypothesis, whether you can build an AGI just by scaling up. And I don't know, you might be saying, like, let's go build the products.

28:51To me, it's exciting that this is actually something that they're testing? For me, the exciting part is the shade that's being thrown left and right, just as an observer. So my favorite part of the post was, and we have the capital to continue investing in the years ahead, and we have the capital. Definitely, you know, a nice little nudge to the Stargate project. Satya Nadella, in an amazing interview this week, was talking about how Microsoft is going to, you know, and he's like, okay, that's all nice. We're investing $80 billion in CapEx, in infrastructure build this year, and I'm good for my$80 billion.

29:30So, I mean, Satya and Mark going on strong. Why does everybody hate Sam? Even Dario Amode, Amode from Anthropic was taking shots at him this week, you know, kind of in a veiled way, calling him a hype man. I mean, because I think the secret of open AI success over the last few years has been delivering very good consumer products and moving fast, but also very, very, they are more heavily invested in the marketing and hype side of this. And that's how they raise money. And it's been a critical part of them maintaining some level of leadership in this. But the hype and the marketing are a core part of the OpenAI story.

30:13And in reality, like the anthropologists of the world get to ride the coattails of that a bit. So maybe they should be more thankful to Sam on this. But I mean, you figure the Zuckerbergs and Nadellas of the world are like, OK, I'm running my trillion dollar company here that's actually, you know, delivering scaled revenue at unimaginable lengths and profits. And they just look at it and they're like, all right, buddy, come on. I'm telling you, man, Anthropic is the one I'm most worried about this year. It has it seems like the least amount of money on hand of the big ones. It's not developing, as far as we know, one of these massive data centers.

30:50Claude is like you mentioned number 18 in chatbot arena getting surpassed by deep seek in a crazy way. And it doesn't even connect to the internet right now. But Claude is good. Claude is good. It's my favorite of all the products. So they can't discount. Claude is good. Other than their rate limits that sometimes I'll be deep into some kind of coding or other analytical project on Claude. And then I hit the rate limit and have to wait a number of hours even as a paying customer. But fix that one, Claude. Come on. But other than that, Claude's a good product. So I think it's obviously their marketing has actually been pretty bad.

31:26They had these kind of comically ridiculous billboards that they tried to push around. And actually, I guess it's a great product for people who know about it. But I would agree that in terms of being in trouble, ChatGPT is obviously the kind of household Kleenex Xerox brand name in the space. 300 million users. Most of my normie friends don't even know what Claude is. And are they going to be able to overcome that? I don't know. Yeah. All right. One more wrinkle in this Stargate project, and then we'll move on to OpenAI's operator. And that is, and, you know, if you're calling this fake news, maybe I'll take that, take the bone that you're throwing there and say, if it's fake news, why would it be fake news?

32:11Like, what would it be in service of? And maybe it is some marketing spin on OpenAI and Microsoft divorcing a little bit on the compute side. So the one thing that happened after this was that we found out that Microsoft and OpenAI, which have been linked together from the very beginning, well, maybe not the very beginning, but linked together very, very strongly for the past few years and something that's benefited both of them, they're changing the way that their compute arrangement is. So Microsoft and OpenAI announced Tuesday they've adjusted their partnership so that OpenAI can access competitors compute.

32:46This is from The Verge. The new agreement includes changes to the exclusivity on new capacity, moving to a model where Microsoft has the right of first refusal. And then to further support OpenAI, Microsoft has approved OpenAI's ability to build additional capacity, primarily for research and training of models. So Microsoft still has this proprietary ability to sell OpenAI as models through Azure, but OpenAI no longer has to go through Microsoft for compute. And that's what this new project is going to do. And this has been something that's been bothering OpenAI for a long time. It's part of the tension between them and Microsoft.

33:20And maybe you sort of dress it up as Project Stargate. And then all of a sudden, everybody's happy and you hope that people don't notice. What do you think about that hypothesis? Yeah, I think that's actually everything about Stargate were things that were already in the work. Even Oracle was building a massive data center. And I think it's like Abilene, Texas, that now OpenAI is going to have an exclusive relationship with as part of Stargate. But they were already working on that. Apparently, the information had reported that Elon Musk was offered access to it, but had turned it down. So now it was open.

33:56So Larry Ellison saw the opportunity to move in this direction. And then even there's reporting that within Microsoft, there's increasing skepticism around generative AI in general and specifically open AI based on the negative reactions and rollouts for co-pilot. So suddenly within Microsoft, they still see the long-term value, but the idea that open AI is so magical that that's going to be a critical part of the success. And maybe they realize the product's more important than the model, that they start to – I'm going to get a T-shirt with that – that they start to realize, like, okay, we don't need open AI, in fact, at all, that we've already been moving away from them.

34:36And financially, the potential of any kind of great return from them is dwindling. So why not let it go? Yeah. Okay. Product more important than the model. Well, here we go. We've been talking about agents and assistants and computer use for forever. And OpenAI just released what is probably the best computer use model that exists today. So this is, again, from The Verge. OpenAI unveils AI agent that can use website on its own. On Thursday, OpenAI unveiled a tool called Operator that can go out onto the internet and perform tasks autonomously, like shopping for groceries or booking a restaurant reservation.

35:16It can navigate websites and take actions on websites, much like you and I do, said OpenAI product and engineering lead Yash Kumar. Artificial intelligence researchers call this kind of technology the AI agents. And this is some examples that Kumar showed. booking a San Francisco restaurant reservation using OpenTable and then also buying a list of groceries through Instacart in the debut video they showed. They showed the thing going through, basically looking at a paper grocery list and then going out and buying the groceries. And then I also found this really fun one from this guy, Peter Willinder, who's from Sweden, and he says he likes saunas and he has operator go through TripAdvisor and then basically search through all the hotels in Stockholm and try to find the best hotel sauna.

36:10And you just see the thing going through the websites and, you know, searching the dates and searching the hotels and then searching for the sauna and the reviews and then coming to a conclusion. And this is usually something that would take a human a lot of time to do and maybe AI can do it for us. Real product news, Ranjan, your reaction. Real product news and I'm actually genuinely excited because when Claude or Anthropic had released their take over your computer product I think it was very limited in terms of ability to use and very buggy people found. OpenAI from at least the demos I've seen looks pretty slick, looks pretty interesting.

36:50But I actually think the problem with this rollout, they need to do, say, agents. They need to say agentic. That's just part of 2025. If you want to compete, you got to say agents. But the use cases in this, I just don't see what is going to actually achieve any consumer level scale with kind of computer takeover workflows and processes. Because again, everyone is showing, okay, I can find and maybe make an open table reservation or buy. I saw one demo where someone, you know, find me a leather jacket of my size that can arrive in two days. And it technically worked. I don't see anyone changing their behavior to actually allow an agent to do this for your own personal life.

37:40And I think like the companies that are actually what they need to be focusing on, again, this is something where I think agentic wins in the enterprise, not in consumer. Well, to further that point, first of all, I thought you'd be more excited. But true to your intellectual honesty, you're calling it as it is. And to further that point, Casey Newton of Platformer paid the 200 bucks to upgrade to Pro and played around with Operator. And he did two things. He tried to get it to create a list of walking tours in London for him, which had canvassed the web and found, and then also a curriculum teaching the Great Gatsby, which had been something that the professor Ethan Mollick from Worden, who's been on the show before, I guess both of those folks are friends of the show.

38:25He's done that before and used that as a benchmark. And it was able to do it sufficiently well. But then here's the crazy thing. Casey just asked ChatGPT the same questions that it had the operator do. And without having to do the fancy, like, go through the whole internet, it produced better answers faster. So is this a farce? Yeah, I think the interesting part of this should be that last mile of actually booking the walking tour. Like the research side of an agent is not that interesting. It's the can you actually enter my credit card data and actually click buy, which is pretty amazing. And it should be able to do that.

39:06But again, from a consumer standpoint, the average person is so far away from letting an autonomous agent to actually spend your money or do things or make decisions around your time. So I think that's one of the most important parts. I think like when Apple intelligence, we're going to be discussing like their view of agentic, at least as they presented it, is more real for regular people around find my flight time, book me an Uber to get me to the airport in time and make that all one action. If it actually worked, that would be amazing. But I think like computer takeover agentic AI for the average person is just so far, like thinking about what would I use it for, trusting it to use it for that and having it more necessary than, as you said, just a traditional LLM search or query.

39:59I think we're just so far away from that. But I do like, I'm glad And OpenAI makes great products that actually work pretty well. So I'm glad they're still pushing this forward. Yeah, I thought, should I pay? Because right now it's only available to these pro users. You pay$200 a month, you get OpenAI's ChatGPT Unlimited, and you could also get this operator. And I said, should I pay this$200? And maybe I should, you know, for the love of the game, since I am a reporter covering this stuff. But I just thought, nah, not right now. I mean, I do think, I will recognize, it is a big deal. Like if you start rolling out this ability, maybe we'll start to get the genuinely creative, potentially repeatable actions that really, and again, not research, where you actually take action on different websites and define those actions.

40:50I think it's going to start to get pretty interesting. But a lot of this, again, you could do with a script. Right. You could do it with a script and it's basically creating that script-like behavior for you, which is cool and which empowers people who cannot code scripts. And that's a good thing. And the people will ideally start coming up with creative use cases. But I think they should actually put it as part of ChatGPT +, guys. And I'll play with it. Maybe I'll be impressed. From the demos, it did not look that exciting. Maybe DeepSeek comes up with their own operator model, then OpenAlias.

41:28Would you let DeepSeek take over your computer? No, of course not. That's actually one thing. I mean, just on that, because there were some very, on DeepSeek, going back to DeepSeek, like very egregious demonstrations of censorship around sensitive topics in China that were very clearly baked into the model. And it is interesting because like on one hand, we are talking about how this could be completely revolutionary. But on the other, there's a lot of I think on the trust side, on the security side, there's still going to be some questions. No doubt. Again, taking over, letting even open AI take over your computer.

42:08I feel behaviorally, the average person is so far away from trusting this stuff. Yeah, I totally agree. and it's something that I've been talking about on the show with everybody who's come on, whether it's Demis this past week or Eugenia from Replica the week before, there's going to be a real reticence to let computers take over. And even still to trust AI. 60 % of people don't really trust AI. We're in a little bubble where we're like, okay, yeah, we trust this to a certain extent. But most people are like, screw that. I'm not touching that stuff. I guess you just did mention the CEO of Replica.

42:43You know what? Maybe people won't trust a computer to actually browse the web for them, but they will trust an AI to be their lifelong companion and love interest and romantic partner. So that's where people are right now. It's all fun and game until your AI lover asks for your credit card. Yeah. I'll have an AI lover, but I will not give them my credit card info. Yeah, that's what you say right now. But just wait until that relationship progresses. And next thing you know, you're buying a digital clothing and you're broke. That will happen. And the New York Times will do like a 6 ,000 word reflective deep piece with large photographs of someone walking along and looking forlorn.

43:26He fell in love with an AI. She took his money. But she spent his money on a shopping spree, in a Gentix shopping spree. Oh, my God. It's great business if you could run it. But OK, so so, you know, you hinted at Apple earlier and the current state of Apple intelligence is that, like, I don't know, I saw Genmoji ship, which is kind of interesting, where you can like prompt and get your own emoji or maybe it shipped just in the test version that I'm using. But but by and large, Apple intelligence, you know, speaking of AI product and AI product for consumer, it's not working. It's not working now.

44:04And who knows if it will work in the future? and it's nothing close to the presentation that the company showed at WWDC last year. And as a result, analysts are starting to say, hmm, we don't want to own this stock. So this is from Yahoo Finance. Apple stock hit with downgrades, two downgrades on weak iPhone sales and AI outlook. So Jeffrey's analyst, Edison Lee, downgraded the investment bank's rating on Apple stock to underperform and decreased his price target by 13 % to 275. On Monday, Loop Capital also downgraded Apple stock from buy to hold and revised its price target to 230, down from 275.

44:46They believe that iPhone sales in China are going to fall between 15 % and 20 % year over year in the fourth quarter. By the way, Apple earnings coming up next week. There's also been other downgrades. Moffitt Nathanson downgraded a couple of weeks ago. And then everybody believes that Apple intelligence is so underwhelming and has not driven a super cycle or any sort of cycle really around the iPhone 16 and are doubtful we'll do it over the next devices. And this is something we kind of previewed when we said, hey, we think Apple intelligence kind of sucks and it's going to lead to some bad sales numbers and here it is.

45:21So is it victory lap time, Ronjan? I'm going to take a moment here as I have to try to start to explain how bad Apple intelligence is. And for newer listeners, I've had a long time hate-hate relationship with Siri. And I say this as someone who has HomePods across their house, AirPods in my ears, an iPhone, a MacBook. So I'm still heavily locked into the ecosystem. But all I want is Apple to just deliver basic level generative AI in their products. Apple intelligence now, I've been using it. I mean, it's been on my phone for a number of weeks now. And it misses at every single level. The more I've been thinking about it, the notification summaries are so useless.

46:17like they the way they will group in different notifications if you get multiple ones from the same app and it will try to summarize it it actually it makes it more difficult than reading for notifications because there's the in terms of how they present the information even I was thinking about a Genmoji I played with it was kind of fun the UI side of it is very nice like actually probably the only thing that's cool is now when you ask for Siri your phone lights up around the borders of the entire screen in kind of a pretty way. But I was thinking about it. It's the most tone deaf thing because the whole value of emojis are that it's kind of like a shared language.

47:02It's kind of a common thing where the emoji connotes something specific and we all have that shared understanding. So from a language standpoint, no one wants to create new emoji. I'm very curious about the utilization of it, but that misses the point. Siri working and with ChatGPT is okay, but it's so much worse than ChatGPT voice or Gemini voice or any actual other voice mode assistant for any generative AI product. So it's genuinely shocking to me. Like a friend of mine was trying to pitch, you know, Apple should buy perplexity. And I genuinely don't, I hope they don't, because I think they would ruin it in integrating it into the overall product and ecosystem.

47:48I don't, what do you think is happening over there? I've always said it's a cultural thing and they just aren't set up for, to culturally build AI. They're too secretive. Their product groups don't work with each other. You need that and you need to be risk-taking a little bit. and Apple is none of those. And therefore, I don't think it's going to realize this AI vision until it really is kicked in the face and made to. And so we've seen these stock downgrades and obviously Apple cares a lot about its share price and now NVIDIA is the most valuable company in the world again and Apple is not. And maybe something will spark within the company, but I don't think Apple today is going to be able to build an AI product that people are going to believe in.

48:30But do you really think it's cultural how bad it is? And I say that we are both very early adopters of and test out every generative AI offering. Like Gemini voice is really good. Chachi PT voice mode is pretty good. I was actually like a Gemini voice. I've been incredibly impressed. I almost want to get an Android just so I can interact with it rather than Siri. I still am so locked into Apple that I have not yet. But the fact that I'm thinking about that is something that is very different than anything over the last decade. Like, do you think they can actually even let's say we see a bunch of downgrades, stock drops 15 percent.

49:15Do you think they shake things up and are able to actually deliver something just on par with what's already out there? No, I think they're more likely to just give up on AI. That's my perspective. Just no more. I mean, maybe you can use ChatGPT on an iPhone. So it's not it's going to be a problem for them. they're going to need the thing there here's the real issue is that so many iphones are just kind of the same like i have the iphone 15 um you could tell me today alex you actually have the iphone 14 or you have the iphone 16 and i would believe you or you got the iphone 13 i would be like all right yeah that sounds about right because there's not much difference and the phones you can hold on to for three four years so like those those upgrade cycles are going to get more spaced out and there's no real draw to bring people in.

50:06So I think that like, it's less of a, like people are going to switch to Android thing and more of a, like the upgrades are going to come in much slower. Now people are still going to be using iPhone. So they're going to be able to buy their services and they'll come in and they'll get the Mac books every now and again. But ultimately I don't think that they have what it takes to deliver AI and I could be wrong and I'll admit it if I'm wrong, but so far I've been right. You can read it. It's in, it's in my book. I've always wanted to say that. But really in the Apple chapter, I specify why they're going to have a hard time with AI and it's all playing out.

50:38Okay. I think, I guess I almost would bet that they will win smart glasses as a category if they launch a product or like that's the area I could actually see them having more success in building or like launching like a genuinely revolutionary new product. But yeah, I think I agree. You don't leave the Apple ecosystem. You just don't buy the new iPhone. I actually think that would be a power move though. If they just said, you know what? No more Apple intelligence. We're not baking in any AI like at the device level, use all the other apps. That's great, but we're over it. Yeah. They're going to make, I would almost, and we're going to, we're going to launch some good new devices.

51:20Yeah. Siri will suck and you will like it. I mean, that's going to be their new motto. Did you know your credit card points and miles can lose value to inflation? Credit card companies often reduce the redemption value of your points and miles. Now, imagine a credit card with rewards that can grow in value. With the Gemini credit card, you can earn Bitcoin or one of over 50 other cryptos instantly with no annual fee. Every swipe at the store or gas pump earns you instant rewards deposited straight to your account. Plus, sign up now for a$200 Bitcoin bonus to kickstart your rewards. Visit Gemini.com slash card today.

51:56Check out the link in the description for more information on rates. Again, if you're looking to invest in Bitcoin but don't know where to start, the Gemini credit card makes it easy. The Gemini credit card is issued by WebBank. In order to qualify for the$200 crypto intro bonus, you must spend$3 ,000 in your first 90 days. Some exclusions apply to instant rewards in which rewards are deposited when the transaction posts. This content is not investment advice and trading crypto involves risk. The Gemini credit card cannot be used to make gambling-related purchases.

52:31You're used to hearing my voice on the world bringing you interviews from around the globe. And you hear me reporting environment and climate news. I'm Carolyn Beeler. And I'm Marco Werman. We're now with you hosting The World Together. More global journalism with a fresh new sound. Listen to The World on your local public radio station and wherever you find your podcasts.

52:58okay we before we go we should really talk just for a couple minutes about what happened with tiktok because at last week's episode i said i would be stunned if we got to this week's episode and tiktok was gone and tiktok is indeed still standing uh however i don't think you can find it in the app store. And every company that has TikTok is supporting TikTok, the Oracles and the Akamai's of the world. They risk fines, daily fines, and could potentially really go into lots of money and millions or billions of dollars over time for keeping this thing running, despite the fact that Trump has, quote unquote, saved the app with an executive order.

53:38Just very quickly, what's your perspective on what happens to TikTok from here? You know what? It's Friday, January 24th. This has been such a heavy week of news that I almost forgot that whole TikTok ban thing happened on Sunday, I believe, late Saturday night, where everyone got a message saying TikTok is shut down and President Trump hopefully will save us. And then you got a message, I think, eight hours later, President Trump says save the app, which was just the wildest thing imaginable. Like I like that happened. That happened. Some girl lit a congressperson allegedly lit a congressperson's office on fire in that 12, 12 hours.

54:22She was mad about TikTok. I like it was interesting. I was asking a bunch of younger folks who are deep into TikTok. And it was interesting because a lot of people's reactions was genuinely like, do they really think we're this stupid? And yes, yes, I do think the executive leadership team at TikTok does. But yeah, in terms of what's going to happen going forward, this one is going to remain one of the most wildly unpredictable things and very excited to watch what happens. Because again, finding an American buyer and divesting TikTok from ByteDance was always the necessary request. Now we still have to find one.

55:10And it's always been questionable about who is going to buy at what valuation, because let's say we find people willing to buy still negotiating because it's still at a very, very high lofty valuation. People that negotiation is going to be interesting. And then obviously the twist that somehow 50 % of it has to go to the U.S. government, I don't think makes any sense or I just don't quite understand exactly what that part of it means. But this one, I have no idea what's going to happen, but I'm very excited to watch. Ranjan, can I just say that this week I expected us to be talking about the TikTok ban and all the big tech leaders standing behind or sitting behind Trump during the inauguration.

55:56Oh, wait, that was Monday, wasn't it? That was Monday. Whole script has flipped. There's been so much news. Even Stargate, which I thought was going to be the lead story, ended up being pushed down the list of stuff to talk about because of DeepSeek. And then, of course, we got Operator and the Apple downgrades. Fascinating week of news. I appreciate you all for sticking with us and coming back week after week. We break down the news here on Fridays. And Ranjan, thanks so much for coming on the show. Who knows where we'll be in seven days. I'll see you next week. I could deal with a little bit less unpredictability.

56:28But anyway, we will be here next Friday. By any means necessary, we will be here. All right, everybody. Thanks for listening. And we'll see you next time on Big Technology Podcast.

From the publisher

Ranjan Roy from Margins is back for our weekly discussion of the latest tech news. We cover 1) DeepSeek r1, an efficient, cheap reasoning model from China 2) How DeepSeek stacks up against the state of the art 3) Does DeepSeek invalidate the billions of dollars invested in current foundational models 4) DeepSeek's wild origin story 5) How DeepSeek changes U.S. and China's AI rivalry 6) OpenAI, Softbank, and Oracle team up to invest up to $500 billion in AI infrastructure in a program called Stargate 7) But do they have the money? 8) Will Stargate test the limits of the scaling hypothesis 9) OpenAI's Operator agent debuts 10) Will people want Operator? 11) Analysts downgrade Apple after Apple Intelligence disappoints 12) Wait, TikTok is still here?
---
Enjoying Big Technology Podcast? Please rate us five stars ⭐⭐⭐⭐⭐ in your podcast app of choice.
For weekly updates on the show, sign up for the pod newsletter on LinkedIn: https://www.linkedin.com/newsletters/6901970121829801984/
Want a discount for Big Technology on Substack? Here’s 40% off for the first year: https://tinyurl.com/bigtechnology
Questions? Feedback? Write to: bigtechnologypodcast@gmail.com

More from Big Technology Podcast

All 399 episodes
DeepSeek Rises, Stargate Drama, OpenAI’s Operator DebutsBig Technology Podcast · 57 min
Listen in VO