ChatGPT Nears 1B Active Users, Nvidia-Backed Reflection AI Looks to Become Open-Source Champ

29 Jul 2026 · 47 min · 21 chapters

Ask about this episode

Ask anything about it. ChatGPT or Claude reads this page and answers with the times it was said.

Connect VO and ask about every podcast you hear, including the moments you saved. Add to ChatGPT · Add to Claude

In short

ChatGPT’s user growth toward 1B weekly active users; OpenRouter’s potential $10B Stripe acquisition; Reflection AI’s push for an NVIDIA-backed open-source model; Cisco President Jitu Patel on AI security and the Open Secure AI Alliance.

Guests and backgrounds

Stephanie Palazzolo (author, The Information’s AI Agenda newsletter; reports on AI industry metrics and deals). Rocket Drew (AI and robotics reporter; profiled Reflection AI). Jitu Patel (Cisco President and Chief Product Officer; leads views on AI safety, open source, and government security oversight).

Key claims

ChatGPT is nearing 1B weekly active users; >50M paying users; growth slowed by competition (Google Gemini, Anthropic coding tools) and post-GPT-5 slowdown. Stripe would pay ~70x OpenRouter annualized sales ($140M), far above recent deal multiples; risks include OpenRouter “reselling” APIs and potential model-provider cutoffs. Reflection AI (cofounders Misha Laskin and Yanis Antonoglu, both DeepMind/AlphaGo/Gemini pedigree) aims to release a Western open-weight model, but hasn’t yet; NVIDIA compute backing and timing/compute constraints are central. Patel argues security should focus on adversaries; open-weights can reduce costs and help defenders, but requires nuance around intelligence, cost, and control.

Notable examples

AlphaGo dethroning world champion; Reflection’s planned open-source coding-first pivot; compute deals (SpaceX, Nebius); Cisco’s Antares vulnerability-finding model; Open Secure AI Alliance members (Cisco, Microsoft, NVIDIA, Uber, Salesforce, etc.).

Written by AI. May contain mistakes. Listen to the episode to check what was said.

Chapters

Tap a time to open that second in VO

ChatGPT's User Milestone Analysis

0:50 to 3:30

Discussion on ChatGPT nearing 1 billion active users and the implications.

“I want to bring on Stephanie Palazzolo, author of our AI Agenda newsletter, to walk us through what she found.”

Challenges and Competition for ChatGPT

3:30 to 8:08

Exploration of the competitive landscape and challenges faced by ChatGPT.

“I mean, nearly a billion in weekly active users.”

Monetization and Business Focus

8:08 to 11:16

Insight into ChatGPT's monetization strategies and enterprise focus.

“So all these things are definitely much more targeted at the enterprise, you know, side of the business.”

OpenRouter Acquisition Discussion

11:16 to 14:00

Analysis of Stripe's potential acquisition of OpenRouter and its implications.

“with M &A, I don't think anything, I don't think everything is very rational.”

Discussion on OpenRouter and Stripe

14:00 to 15:56

Explore the dynamics of routing AI models and the potential role of Stripe.

“So I do agree with you that I think Stripe will provide a lot of distribution benefits.”

Introduction to Reflection AI

15:56 to 16:49

Learn about Reflection AI's funding, partnerships, and its profile in the AI landscape.

“Why did you decide to laser in on Reflection specifically?”

Analyzing Reflection AI's Model Development

16:49 to 18:31

Insights into the expected performance of Reflection AI's models compared to competitors.

“giants, these heavyweights in AI, but Reflection is comparatively not well-known at all.”

Founders of Reflection AI: A Brief Overview

18:31 to 19:59

Discover the backgrounds of Reflection AI's founders and their experiences at DeepMind.

“So the co-founders, Misha Laskin and Yanis Antonoglu.”

Reflection AI's Strategic Pivot

19:59 to 21:05

Understand the pivotal moment when Reflection AI shifted its focus towards open-source.

“were working with them in the early days, they were trying a lot of things.”

Challenges in Model Release Timing

21:05 to 23:18

Explore the factors affecting Reflection AI's timeline for releasing its model.

“So Jensen floated the idea and then they made this big pivot essentially overnight and changed the strategy of the company.”
Show all 21 chapters

Internal Dynamics and Progress at Reflection AI

23:18 to 25:59

Discussion on the internal progress at Reflection AI and factors affecting model development.

“If Kimi K3 just came out, people are raving about it.”

Rocket Drew on Reflection AI's Future

25:59 to 26:54

Insights into potential outcomes and expert expectations for Reflection AI's upcoming model.

“There's a lot of experiments that have to be run to figure out how can we scale up a model and eventually train one in one big training run that is frontier quality.”

Jitu Patel on the Open Secure AI Alliance

27:31 to 28:03

Learn about Cisco's involvement in the Open Secure AI Alliance and its significance.

“So much has changed, and yet the game is still very much similar to when we last spoke.”

The Role of Open Source in AI Security

28:03 to 29:14

Learn about the advantages of open source models in enhancing AI security and collaboration.

“So it didn't take that much kind of calculus on our side to say, yeah, open source is a good thing.”

Nuanced Arguments Surrounding Open Source Models

29:14 to 30:57

Explore the complex arguments for and against open source AI models and their implications.

“He said, I don't agree with the letter's assertions that open-weights models necessarily make it easier to develop safeguards or that broad access capabilities necessarily helps defenders more than attackers.”

Government's Role in AI Model Regulation

30:57 to 35:32

Discuss the implications of government oversight on the development and safety of AI models.

“And in some cases, you don't care about control.”

Evaluating Chinese Open Source Models

35:32 to 38:15

Analyze the advancements and risks associated with Chinese open source AI models in the market.

“It's good for the citizens of the country.”

The Future of Closed Source AI Labs

38:15 to 41:28

Understand the potential shifts in business models for closed source AI labs in an open source landscape.

“actually happens to be Chinese open source models as a source that is someone who told me that stat.”

Monetization Strategies in AI Development

41:28 to 42:04

Investigate how AI companies may adjust their monetization strategies with the rise of open source.

“It was the Chinese models, I think that you said, but I mean, in a world where open I don't even know if that's correct.”

The Evolution of AI Business Models

42:04 to 45:36

Explore how AI companies might shift towards app and infrastructure monetization.

“And I wonder what you think the answer is.”

The Future of AI and Google's Comeback

45:36 to 46:19

Discuss the potential for Google's resurgence in AI and the importance of focusing on broader trends.

“And can we start working on that rather than just talking about the next benchmark?”
Hear the part that matters, and keep it.Open this episode in VO. Double tap your headphones to save a moment as you listen.
Get VO free

Transcript

Automatic transcript. May contain errors.

0:13Stephanie Palazzolo:Welcome, everyone, to The Information's TI TV. My name is Akash Pasricha. It is Wednesday, July 29th. Today on the show, we have a scoop on ChatGPT's latest user data. We're also going to unpack an in-depth profile that my colleague wrote on Reflexion. AI, an up-and-coming AI lab. And we're going to close out the show with Jitu Patel, the president of Cisco. The company has joined forces with dozens of others on the Open Secure AI Alliance. We'll talk about his views on AI safety and open source AI all together. It's going to be a great show, so let's get right on into it. The information has exclusive reporting on ChatGPT's latest user data.

0:55Stephanie Palazzolo:I want to bring on Stephanie Palazzolo, author of our AI Agenda newsletter, to walk us through what she found. Stephanie, welcome back to the show. It's great to have you here. Great to be on. Okay, how many active users does ChatGPT currently have? So as my colleague Erin and I reported last night, ChatGPT is right on the verge of hitting 1 billion weekly active users. So again, this is the number of users that are using the popular chatbot at least once a week. The reason why it's a little bit hazy is because, you know, typically whenever companies are keeping track of these numbers, they do have to do some kind of last minute counting for like bot accounts and things like that.

1:38But it does seem if they haven't hit it already, it's, you know, on track to hit that number in the next couple days.

1:45Stephanie Palazzolo:So when were they expecting to hit that initially? So, you know, obviously that's kind of the important point here. One billion is a super impressive number. That's a huge proportion of the world's population that is logging into ChatGPT and using it at least once a week. But the important thing is that the company originally was hoping to hit this milestone at the end of last year or by the end of last year. So, you know, it does come around seven months after the company was originally hoping to hit that usage number. And so what's been the issue? Do we know? So I think there's a couple things that are coming into play here.

2:23I think first, as Sam Altman told staff at the end of 2025, at this point, Google was really starting to do well. Gemini was really catching on with developers. Sam told staff, we're going to expect kind of rough vibes.

2:42Stephanie Palazzolo:Yeah, code red. I mean, you broke that story. Code red, things are not looking great for ChatGPT, and then what? Exactly. So, you know, lots of worries about Google. Then since then, Google maybe hasn't been as much of a threat, although definitely is obviously a very big competitor. People are using its AI tools more than ever through Google search AI mode. But since then, you know, Anthropic has really caught on. So its coding tools like Cloud Code are doing incredibly well. Lots of people are using, you know, Anthropic's Cloud Chatbot and its other AI tools. And so, you know, I think both of those, you know, just basically rising competition, as well as a kind of slowdown that we've previously written about that happened after OpenAI's GPT-5 launch last year.

3:29These are all contributing factors to why it's been maybe harder than expected for OpenAI to pass out last, you know, 100 million or so in users and why it took them, you know, much longer than expected to.

3:42Stephanie Palazzolo:What about paying users? I mean, nearly a billion in weekly active users. We know that you can log on for free and use it. What proportion of that are people that are paying for the platform right now? And how does that compare to the proportion of paying users for all these other platforms as well? So it's a little hard to say because obviously a lot of this data is kept very much under wraps by all these startups. But, you know, the last figure that we've written about is that ChatGPT, there's more than 50 million people that are paying to use the chat bot. So, you know, relatively like a small proportion of people are paying, which, you know, is maybe not great for OpenAI.

4:23I'm sure they'd love to increase that proportion. However, it's also important to point out that they have other ways to monetize non-paying users like ads, for instance, which is something that they have been trying to push more into in recent months. It does seem like, you know, from our reporting that this does seem to be kind of a higher proportion of paid users than some other AI tools, though.

4:47Stephanie Palazzolo:Yeah. So, I mean, look, ChatGBT is certainly one business vertical that the company has. We also know that Codex has been gaining steam. And so I wonder if you've heard of the company really shifting its priorities at all in terms of prioritizing growth in other areas where chat GPT growth might end up. And I don't want to say stalling. I mean, look, it's still growing fast. I mean, look, any platform to have, you know, one eighth of the world's population, I don't know how many people are they can expect. But have there been growth in other areas of the business to compensate? Yeah. Yeah, so this has been a really big theme for OpenAI in the last year or so.

5:31So, you know, as Chat2BT growth has kind of slowed and tapered off a bit, we have seen the company really double down more on selling AI to enterprises, as well as, you know, tools for coding and knowledge work, things like Codex and more recently Chat2BT work. So you can kind of see them trying their hand at the Anthropic playbook here and being much more focused these days on selling AI to enterprises because that's an area that maybe they haven't tapped into as much. And obviously enterprises are maybe much more willing to pay for AI tools than the average consumer is. So, so far, we have done some reporting on this.

6:13It seems to be going well. I have heard, I have talked to a decent number of developers who have switched over, for instance, from Cloud Code to Codex in recent months as OpenAI's models have gotten better, and especially as they have proven to be, you know, in many cases, a lot cheaper than Anthropix models. but at the same time it still is very much a super tight race and you know right now it is very much neck and neck and it's not clear if open ai is going to be able to you know match or surpass anthropic when it comes to kind of ai for enterprises and remind us i mean sarah

6:50Stephanie Palazzolo:fryer had some comments about this earlier this year where she sees the future of the business in terms of revenue breakdowns. She, of course, is the CFO of OpenAI. What did she say with her expectations there? So earlier this year in January, Sarah Fryer did say that around 40 % of the company's revenue was coming from businesses, and she expected that proportion to grow to 50 % by the end of the year. So that is obviously a very significant chunk of the business that is coming from enterprises, which I think even in January, that was somewhat surprising for people who had mostly seen OpenAI as this, you know, very consumer-focused business.

7:32But I think at the same time...

7:34Stephanie Palazzolo:And it kind of goes to the point that you were saying earlier, which is that, you know, although they've fallen short of this metric, which is very much, it's a consumer-focused metric, maybe inside OpenAI, I mean, you know, where they started with Code Red, maybe it doesn't actually matter to them as much because at the end of the day, I mean, it's businesses that that's going to help get them to profitability. And you shouldn't ignore it, but I'm just saying in terms of converting it to revenue, you know, if it's only 5 % of people who are paying for it, probably not the highest ROI to focus on that necessarily.

8:09Totally. I think that's super fair. And we do see, you know, OpenAI even now moving away from this kind of just like kind of simpler chatbot product where you're just going back and forth with a chatbot and more into things like chat GPT work and codecs, where you see their products, you know, basically completing actions on the user's behalf, which is very, you know, attractive to enterprises who want to like automate things like payroll or sending emails or scheduling, right? So all these things are definitely much more targeted at the enterprise, you know, side of the business.

8:46Stephanie Palazzolo:Right. Steph, before we let you go, I want to get into very quickly another story that you published with amira fradi our co-executive editor uh you did some analysis today on the uh the stripe open router acquisition that everyone is expecting to happen uh we of course have reported that 10 billion dollars is the price tag that they are considering you took a look at the valuation and what that means in terms of multiples uh what did you find there so yeah i think this is one of the most potentially expensive acquisitions that we've seen in quite a while. So as my colleague Amir and I reported earlier this morning, OpenRouter, which is a startup that basically helps developers choose between a bunch of different open and closed source models, was recently generating around$140 million in annualized sales.

9:43So, you know, obviously that's not nothing, but it's a far cry from, you know, the billions of dollars that we see other, you know, application and infrastructure companies making. I think what makes that really surprising though is comparing that$140 million number to the, you know, around, you know,$10 billion price tag that we've reported on. So comparing those two numbers, that means that if the deal goes through, Stripe is going to be paying more than 70 times open routers revenue, which is quite expensive, especially whenever you compare that to other recent deals like SpaceX and Cursor, where Cursor was not only making significantly more revenue, but when we compare to the price tag, that ended up being more around a 22 times revenue multiple, you know, a lot lower than what's like.

10:36Stephanie Palazzolo:Nearly three times as much as Cursor on a multiples basis, which is kind of crazy, especially when you consider that the Cursor deal was, that's, you know,$60 billion was a big check to begin with there. What do you think is accounting for the premium here? What does Stripe see in Open Router? So I think there's one element of this, which is just that, you know, Are you going to say FOMO? There's probably a bit of FOMO. I think, you know, as we reported, it does seem like there were a lot of buyers around the table. You know, Databricks is a name that we have written about. It does seem like there were at least a couple others.

11:13So definitely there can be a situation where, you know, with M &A, I don't think anything, I don't think everything is very rational. It's like, you know, we can attribute this part of the price to like this value that we're getting. I think companies and buyers are bidding each other up. So I think that could definitely be an element that was happening here. I think on the other hand, Stripe obviously is involved in payments. It has a good kind of insight into what its customers are paying for AI models. And I think OpenRouter could be a nice complement to that business where not only are they handling like payments and seeing, you know, that data on what businesses are spending on AI models.

11:55But now they can also get into the business of like helping those customers choose which AI models they want to use when. And I think it could be, you know, a nice way for Stripe to add this kind of AI flair to its narrative, which I think every company wants to have these days. And as some of my other colleagues have written about, it doesn't like they have a pretty hefty, you know, war chest of cash. And, you know, they need somewhere to kind of put that cash. And, you know, M &A is always a good place to do that.

12:25Stephanie Palazzolo:So can I just ask you one question, though? I mean, you wrote about the risks to OpenRouter's growth and the sustainability of the revenue in the story. And, you know, I want you to sort of share with us what those risks are. But more importantly, if Stripe buys OpenRouter, then it really becomes a game of pointing that technology to all of Stripe's customers. And so after explaining just the risks, I want you to then opine on whether or not you think the Stripe acquisitions could sort of nullify those risks or maybe mitigate them in sort of a joint union of sorts. Yeah. So I think in terms of the risks, I mean, there's a couple of things here.

13:02I think first, there's been a lot of skepticism around businesses like OpenRouter, which are essentially, you know, helping developers choose between existing open source models and, you know, existing open and closed source models and providing this kind of centralized hub that makes it easier for them to pick and choose and do that all in kind of one place. I think some people would argue, though, that, you know, how much value really is a company like Open Router adding to that process? And at the end of the day, some people might even describe them as just kind of reselling other companies' APIs.

13:39So I think initially it's kind of maybe not entirely clear what the value add is there. I think another issue too is that, you know, from our reporting, a lot of customers are using OpenRouter to access, for instance, closed source Anthropic models that are out there. And, you know, Anthropic has definitely not been shy about, you know, cutting off access to its models to companies that it feels like maybe are somehow using those models in an unfair way.

14:06Stephanie Palazzolo:um so or pointing them elsewhere basically saying hey like we're giving you access to this model but but open router is saying it's actually not the model you should use why would anthropic even allow access then in that case yeah and you know anthropic can also say hey why why don't these customers just come directly to us you know why are they going through this like weird third party that is reselling our models right like right like it's kind of just leaving money on the table here so in that case i do think like stripe is not going to be much help there because no not at all i mean these these are still like you know there's the business of routing is doesn't really matter how big and in fact i mean you could you can even argue the bigger the bigger the owner of the company and i'm just brainstorming here i mean stripe is in the payments category anthropic doesn't really have much in the payments layer but but to the extent that they ever start to compete on anything, the risk seems even more likely in that case.

15:05Yeah, I think that's definitely true. So I do agree with you that I think Stripe will provide a lot of distribution benefits. And obviously, Stripe has a huge base of customers, which I'm sure OpenRouter would love to have access to, but definitely has yet to be seen whether they're going to be able to help with any of those risks. It seems like maybe not with at least some of those issues.

15:26Stephanie Palazzolo:But the bankers love it. The bankers do love a good$10 billion deal. Yeah, I know. It was pretty crazy to see the kind of discourse after we first broke that news. And just because, again, the company was last valued at around a billion. And so that's the outcome for the company's founders, for its employees, and definitely for the VCs that backed it at a much lower price. So firms like Andreessen and Menlo Ventures that got in way earlier. Right. Great. Well, Stephanie, I want to thank you for coming on. That is Stephanie Palazzolo, author of our AI Agenda newsletter here on TITV. reflection ai is an up-and-coming ai lab with a lot of momentum it has raised billions of dollars from investors 800 million dollars from nvidia alone it is just one of eight ai companies assigned a deal with the defense department joining google microsoft and aws and yet it hasn't yet released a model to the public our ai and robotics reporter rocket drew profiled the company in a story out today i want to bring on rocket to share more with us about what he found Rocket, welcome back to the show.

16:32Stephanie Palazzolo:It's great to have you here. Thanks, Akash. Great to be here. Why did you decide to laser in on Reflection specifically? Yeah, I mean, it's exactly what you just said. There were all of these buzzy announcements that mentioned the company, including ones from the Department of Defense, where Reflection is standing shoulder to shoulder with these giants, these heavyweights in AI, but Reflection is comparatively not well-known at all. So that got us thinking, you know, what is it about this startup that's getting them so much traction? They're signing these big deals and they have these big ambitions for themselves.

17:03We wanted to know a little bit more about the company.

17:04Stephanie Palazzolo:And I want to get into the backstory of the company, but one of the most surprising things in your reporting that shocked me was you found that, I mean, the model that they're developing, it's expected to be quite good, right? Yeah, that's right. But good relative to the open weight models that are available in the US. So it is still the case that Chinese models are pretty far ahead of the open weight model that are available from developers in the US. At the time Reflection comes out with its first model, its model will likely be on par for Western models, but not for Chinese models. Of course, they hope to exceed Chinese models in the future.

17:45Western open source models, to be clear. That's right. That's right. Western open source models, to be clear. So not the models you're seeing from OpenAI and Anthropic, but instead from companies like Mistral, from Thinking Machines Labs, which got into the game recently with their pretty large model inkling and then also smaller models that have come out recently like one from poolside they have a model called laguna that's specialized for coding so the point is that while anthropic has these ambitions and they are tracking to be on the western frontier every day that goes by it feels like there's more competition there are more models out there that are available even from western open source companies so reflection has better come out with a model soon if that's, you know, they're still tracking to be on the frontier.

18:29Stephanie Palazzolo:Right. I want you to walk us through the history of this company. So the co-founders, Misha Laskin and Yanis Antonoglu. I think I pronounced that right, hopefully. Yanis, please correct me. Come on the show and correct me, if you will. Tell me about these founders and why they are so popular in the AI ecosystem right now. Yeah, absolutely. They definitely bring with them a certain AI pedigree, especially because they both worked at Google DeepMind and they got a lot of experience there. So Giannis was one of the people who worked on AlphaGo, which was the pioneering reinforcement learning system.

19:08They taught an AI to play Go, which was once thought to be a game too complex for any machine to ever play, let alone master. And then in 2016, it dethroned the reigning world champion. It was a coup really for AI progress. It blew people away. So that's what Giannis brings to the table. And that experience he has with reinforcement learning is really attractive for reflection, bringing in new talent. You know, understandably, people are excited to work with him. Misha also worked at DeepMind and cut his teeth working on the earliest versions of the Gemini models. So he brings in some more of that experience with large language models.

19:46So together, they have some star power on the founding team for sure. And what was the original ambition for the company when they started it? Well, I think at the very beginning, maybe they didn't really know. Talking to some people who were working with them in the early days, they were trying a lot of things. Smart people will do smart things. Let's give them money. Right. The classic Neolab proposition. And in fact, I think that's one of the things that's interesting about them is there's been kind of this moment for Neolabs lately, but in some ways, Reflection was early to this game, realizing that there's probably room to get in and compete against these larger players like OpenAI and Anthropic.

20:24But to begin with, Reflection saw its angle as coding. I mean, if you'll remember a couple years ago, Cursor was on the rise. Coding was such a hot topic already. Their first product that they ever released was an agent for understanding existing code. So not for writing code, but just for understanding code. But that was not a model that they trained themselves in-house soup to nuts, right? That's sort of an entirely different proposition. So what happened was the company then made a dramatic pivot and decided that they were going to train their own models from scratch and they were going to open source those models.

21:00And in fact, they were going to be the champion of open source in the US. And that pivot happened after Misha met with NVIDIA CEO Jensen Huang a year ago out here in California. So Jensen floated the idea and then they made this big pivot essentially overnight and changed the strategy of the company. A year later, the model still hasn't come out. So that's what we're waiting on now.

21:24Stephanie Palazzolo:Do we have any sense for what Jensen said in this meeting to convince Misha on what frankly is now, I mean, as of today at least, it's, you know, one of the most competitive battlegrounds for models is the open source model category. Do we know what Jensen said to convince him to change the whole strategy? It is very competitive. Now, we don't know for sure, but what you should remember is that it's absolutely in NVIDIA's interest to have more players in this category, right? The more companies that are out there using AI, the wider variety of companies, the more revenue they can bring in for their AI chips.

21:59And also, it helps diversify their revenue away from these large, concentrated players like OpenAI and Anthropic, AI companies that are increasingly developing their own chips as alternatives to NVIDIA's. So you can see why it would be in NVIDIA's interest to have a player-like reflection out there. You also have to remember that a year ago, the territory did seem more open. You know, like DeepSeek had happened, but there weren't a ton of players yet, even on the China side, that were competing at that level in open source AI. So it still seemed, I think, more like it was anyone's for the taking.

22:35Now, to be sure, there's still a lot of room for reflection to get in and compete in this market. Right. It's been working on the model for a year. It could release a frontier model. And, you know, models are, they're not all the same. It could find a niche that works for it very well. But I think the proposition was probably something along those lines, that there's a lot of room for an open source US champion. And if that company has our backing, has the compute that it needs from NVIDIA, they're basically going to be set.

23:02Stephanie Palazzolo:But, I mean, let's get to the heart of it. I mean, they've raised so much money. They haven't yet been able to release. And I should say, you know, I'm saying they haven't been able to. It might be likely as a decision, right? I mean, we've talked on this show about timing, too. It matters. If Kimi K3 just came out, people are raving about it. You better make sure that it's maybe not competitive with Kimi K3, but at least competitive with the Western open source model. So maybe it's a strategic decision to not release it yet. But, I mean, what do we know about what's happening inside the company?

Read the full transcript

23:37Stephanie Palazzolo:Have things, have they been making traction with their model? What are experts expecting? Because they have all these deals with the Defense Department, with Dell, et cetera, on the surface. What's going on underneath the hood? Yeah, that's right. There is definitely progress on the model that's going on inside. And from what I can gather, people inside are optimistic about the progress. But I should say, it's not always, sometimes there's this timing game where the longer you wait, the better a model you'll release. But I think often the considerations favor releasing a model basically as soon as it's good enough to release.

24:14One of the reasons for that is you'll start getting more traction with people, and especially in open source, one of the things you're really betting on is that you'll win the loyalty of developers and people who like to download the model and tinker with it. So earlier is better. And also compared to open source, there's another factor that heavily favors releasing the model as soon as possible. And that's that with a closed model, when you release the model, all of a sudden a lot your computing resources are going to serving that model and providing inference for your customers but with open source models you don't have to worry about that right you can just keep on training the next generation because your customers and and your users will basically run the model on their own computing infrastructure rather than so for open source it's actually better to to get

25:00Stephanie Palazzolo:it out there uh sooner even more than closer i think you basically want to release it as soon as possible now in reflections case you should remember they signed a couple large computing deals, but only recently. So they have this massive deal to rent compute from SpaceX. They've also signed a really large deal to get compute from Nebius. These deals are worth billions of dollars potentially over the next several years, but deals were announced recently. So I've heard that there's some jockeying for compute internally between different teams. At least there was before these deals were signed. That's standard.

25:33You know, that's par for the course with any like AI company these days and especially Neolabs. But you could hope that now that the compute is available, that makes it easier to sort of full steam ahead, work on the model.

25:46Stephanie Palazzolo:So then is it the compute jockeying that's the reason they haven't released it then? Or what is the core reason? It just takes time. I mean, you certainly need a lot of compute to train a front-year model, but it just takes time. There's a lot of experiments that have to be run to figure out how can we scale up a model and eventually train one in one big training run that is frontier quality. And there's a lot of infrastructure work and engineering that goes into that. And they're building it from scratch, right? Like at a company like OpenAI or Anthropic, they have all of this code, they have all of this software built up, and they have all of the results.

26:21Like they have experiments from how the training the models pans out. But in practice, there's a lot of art that goes into it, a lot of craft figuring out what works.

26:29Stephanie Palazzolo:Right, right. And I mean, look, we should say that the fact that you talk to third-party experts as well, not just people associated with the company, and they also are expecting big things from this model. So I'm excited to see where it all goes and what happens with it. Rocket, I want to thank you for coming on. It's a great story. That is Rocket Drew, our AI and robotics reporter here at The Information. Thanks, Kosh. You might remember earlier this week, we talked about a bunch of companies signing the Open Secure AI Alliance. This was dozens of companies coming together to say we are prioritizing cybersecurity and open source in AI.

27:12Stephanie Palazzolo:There were a bunch of companies on that list. Microsoft, Palantir, NVIDIA, Uber, ServiceNow, Salesforce, Cisco was another company that put their name to it. And I want to bring on Jitu Patel, President and Chief Product Officer of the company for his view on all this. Jitu, welcome to the show. It's great to have you back.

27:31Jeetu Patel:How are you, Coach? Good to see you, man. Good. How you been?

27:34Stephanie Palazzolo:I've been great. You know, there's never a dull moment. Never a dull moment, indeed. So much has changed, and yet the game is still very much similar to when we last spoke. I want to ask you about this alliance that Cisco signed on to. Tell me about the decision to attach your name to it.

27:51Jeetu Patel:well here's the way i've always thought about security the true enemy is not the competitor the true enemy is the adversary and so i think what we have to do is make sure that there's as much sharing of information and as much um you know kind of collaborating that happens within the industry so that we can make sure that we have a secure posture against the adversary now when the adversary is both humans as well as agents that can come in at machine scale, you need to make sure that you've got the right level of apparatus to go out and have defenses at machine scale as well. So it didn't take that much kind of calculus on our side to say, yeah, open source is a good thing.

28:32Jeetu Patel:In fact, we've been promoting open source now for the past, I don't know, a couple of years. We had the foundation security model that we had launched. I think 18 months ago or something. And so it just seems like it's a very natural progression as you move forward. And given the cost of these models and the token consumption getting so high, having smaller models that are purpose-built for specific domains, for specific tasks that can be available in the open source community is just good for everyone.

29:06Stephanie Palazzolo:So you talk about adversaries and security and how open source enables that. Dario at Anthropic, I'm going to read you a quote that he put in his letter that he put out. He said, I don't agree with the letter's assertions that open-weights models necessarily make it easier to develop safeguards or that broad access capabilities necessarily helps defenders more than attackers. He, of course, is referring to the letter that was released prior to the alliance that you signed on to. But, I mean, his point is basically that he doesn't agree necessarily that open source AI necessarily means more safety.

29:47Stephanie Palazzolo:What do you think of that?

29:49Jeetu Patel:You know, so I think this is an area that I wish the market had more tolerance for nuance. and i think what dario is coming up with is specific arguments that are actually very credible arguments they aren't worth throwing out of the window and i think there's very very credible counter arguments that are worth considering as well and what we end up doing and if you look right now at the social media sphere there is a very very polarized debate on this rather than one which is stemmed on intellectual curiosity right so what what are What are the new, I mean, walk us through the nuanced arguments for and against.

30:28Jeetu Patel:So nuances on having an open source model is firstly, you want to make sure that an open rates model specifically, rather than just open sources, there's three dimensions that you want to keep in mind is intelligence, cost and control. Okay. So the first one is intelligence. Is the model going to be, you know, effective enough to go out and do the tasks that you want it to do in the most economic way possible while providing you the most amount of control. And in some cases, you don't care about control. In other cases, you might really care about control. And so you want to make sure that in some cases, you want to just make sure that your model is running in your data center, not just, and I don't want to go out and support, you know, RSI and recursive self-improvement for another model and provide my data over there.

31:15Jeetu Patel:So it's not just for security models, for any model. Right. You might want to make sure that you have, there is a place for, you know, open source and open rates models. I, by the way, as a side note, actually believe that the United States should have a strong stance on open source. I think companies like NVIDIA and Nemo Tron are doing a great job. And we need more and more, you know, thinking machines. Mira Morati has done a good job on just coming out with one, you know, a couple of weeks ago. Yeah, with InkLink. Right. And full disclosure, we are investors in Miros company. But I think in general, it is a great thing to have low source models and open source models.

31:58Jeetu Patel:There's no downside to having open source models in America.

32:01Stephanie Palazzolo:Right. So go back to the nuances. So we were talking about arguments for and against the nuanced pieces.

32:07Jeetu Patel:Yeah. So the for and against on the nuance of open source models is like, if I have an open source model, I'm going to, one, be able to reduce my cost. Because, for example, we did Antares. We just launched Antares. We have two models, 350 million parameters and a billionth ram in a model, which is minuscule, tiny compared to frontier class models. In some particular domains, it's actually performing pretty well in benchmarks. And that domain that we have actually focused on is finding existing vulnerabilities in code that you have. Finding the vulnerabilities that currently exist. Not zero-day, but existing vulnerabilities in code that you have, which typically comprises for, you know, a non-trivial amount of exploits that happen.

32:57Jeetu Patel:We want to make sure that we provide a very, very efficient way to do it and find those vulnerabilities so you can patch them. Having that available in the open source community, there's no downside to it. There's zero downside to having that.

33:08Stephanie Palazzolo:What about the new arguments against open source Where does Dario have a point here with the credible argument?

33:14Jeetu Patel:Against open source, he's like, everyone's going to have it. I'm going to have guardrails in my models, and I'm going to make sure that those guardrails can actually be done in a way that bad actors can't go out and use that open source against us. That's the argument against it. It's not a terrible argument. Now, by the way, if you look at what happened with OpenAI and HuggingFace, HuggingFace actually used open source models because the guardrails weren't working to go out and kind of save that. So these are not like simple positions. And by the way, when you start thinking about policy positions that you apply to it, they get even more complicated and even more nuanced than what happens.

33:55Jeetu Patel:If you banned Chinese open source in the US, then what happens? Well, now the cost of tokens and the cost of going out performing intelligent tasks in the US goes up compared to the rest of the world. That then over the long period of time might actually put us at a disadvantage. If you keep it open, you could have a model that has actually been trained to go create some harm on US soil. So there's a bunch of these things that we have to just think about very carefully and have the assessment done with the level of nuance that's factored in. I just don't think that culturally we need to start, you know, vilifying one party or the other.

34:41Jeetu Patel:I have a ton of respect for Dario.

34:43Stephanie Palazzolo:No, and look, I think I'm actually more interested in the nuances of the argument. And so, you know, that's - I just gave you one of those, right? No, no, no. Yeah. And I think it's a good point. You know, one of the nuances that I've been asking folks about on this show is with respect to government regulation, specifically whether or not they think the government should have a role in reviewing the models, at least, you know, for these frontier closed source models, as we've seen happen in the past, should the government have a role in reviewing them before they get released? And, and, you know, I guess on one hand, you could say what it's, it's slowing the pace of development.

35:24Stephanie Palazzolo:On the other hand, you say it's, it's safer. So I wonder where do you fall on that issue? Should they have a role in reviewing the models?

35:32Jeetu Patel:So by the way, and this is a, the ability for the government to say, if this affects national security materially, I want to be able to intercept should always be something that the government has preserved as a right for them. I feel like it's good for the country. It's good for national security. It's good for the citizens of the country. Now, is their reviewing of the model going to have the level of efficacy to be able to find things that would have not been found otherwise is the thing that you have to think about. And is it better for the government to review the models? Is it better for a third-party agency that actually gets specialized in doing that, that reviews the models that the government makes sure that they require for some kind of check before they move forward?

36:19Jeetu Patel:Those are all aspects that need to be considered. But if you look back at the first principles and the core intent, the core intent is I want to be able to make sure as the government of the United States that I have a degree of control of what I put out in the open market if there is a national security risk that I want to be able to make sure that I can opine on. That is a perfectly normal thing to do in situations like this. And you can't just be a dogmatic free market player. On the other hand, you have to make sure that that actually provides the efficacy that's needed and doesn't slow down the market unnecessarily just for bureaucracy and those are the two things that you have to consider

36:58Stephanie Palazzolo:so you mentioned uh chinese open source models are are you using kimmy k3 at at cisco right now

37:05Jeetu Patel:with your products we are not right now we have a fair amount of um you know are you using any any chinese open source we're not cisco is not using chinese open source models today Right. Why not?

37:47Jeetu Patel:The Chinese models haven't gone and said, I'm going to provide you with more capability than what a frontier class model is. It's saying, I'm going to provide you with something that's going to be comparable and just as good as. And then the only thing is economics. I would rather take the risk on the economics rather than take the risk on safety of the country. And so we don't know what it is. That doesn't mean that we don't think that Chinese models should be used within the U.S. In fact, 60 % of the interest volume in the U.S. actually happens to be Chinese open source models as a source that is someone who told me that stat.

38:23Stephanie Palazzolo:I haven't verified that stat, but it's true.

38:25Jeetu Patel:I'd love to know the source of that.

38:28Stephanie Palazzolo:Yeah, that's staggering if that's true.

38:30Jeetu Patel:If it is true, it's a pretty staggering stat, right?

38:32Stephanie Palazzolo:Yeah.

38:32Jeetu Patel:And then the other thing that's a very interesting step is 60%, also a 60 % number, but it was completely coincidental and had nothing to do with each other, of the entire compute capacity now is actually shifted to inference, not to training. Right, right. Now, here's the nuanced area that I, Akash, really want to kind of make sure that we gain theory out fully. let's say that we go full-fledged and um use the uh you use the chinese models right um and if we do that i mean i i and you know yeah go ahead go ahead no no go ahead what were you saying sorry i thought you were are you asking me if i if i use them no no i'm just saying that if we as as a country and as the world everyone's starting to use a lot of chinese models which they are You're getting a tremendous amount of momentum from, by the way, they need to be commended on how quickly they've actually come up to speed, especially given that chip's disadvantage.

39:36Jeetu Patel:Right, right. And so assume that that actually ends up being the case. The one thing that you don't want to have happen is that we have to think through the economic model of open source. And I believe strongly, like I couldn't be more emphatic about this, the US has to have many, many open source alternatives or frontier class models, as well as SLMs and, you know, kind of further downstream for open source and open rates models. But if that were to happen, there is a risk that we should actually provide the calculus on, which is right now it costs about three to five billion dollars to train a frontier class model.

40:13Jeetu Patel:That cost continues to keep going up. Now, the only reason that they can justify putting that level of money to do the primary research to go out and train frontier class models is because it provides economic value on the other end of it. If that model gets disrupted, one, we have to think about what does that do for ongoing research? I actually believe that we are still in the very early days of model evolution. And I think we need to make sure that we continue to keep having greater and greater models that are built out to have the right levels of intelligence to be able to get done all the things that we want to get done with AI.

40:56Jeetu Patel:And so we do have to figure out, like, if open source disrupts closed source models, and if open source is largely has one of the vehicles that's used as distillation. then what happens to the closed source models that are actually pumping a lot of money into this to continue and i i'm i mean right now in the short term none of that changes but in the long term those economics could change and so we have to think carefully about what do we do over there as well to make sure that there's enough fuel in the fire for open source so that open source models can do that frontier class research well and i think you're you're hitting on the exact

41:32Stephanie Palazzolo:question that we've been trying to think about is what then happens to the closed source AI labs then in a world where, I mean, you said this, you know, the 60, well, the 60 % was the, it wasn't open source. It was the Chinese models, I think that you said, but I mean, in a world where open I don't even know if that's correct. Right, right. So maybe we'll put that stat aside for a second, But in a world where open source becomes a higher proportion of the model use, I mean, that's the question. And I wonder what you think the answer is. What happens to the closed source model labs as a business?

42:11Jeetu Patel:So I think the way that the business model will evolve is the monetization, in my mind, would then move towards the app layer as well as the infrastructure layer. right they would cut costs on the infrastructure side by going out and doing more efficient um you know kind of um um you know kind of build out over there like they're making their own chips and xpus and those actually really help with actually you know the turning down of margins and having the right capacity but on on the app side the value starts going in the app in the app layer and so So if you put$3 to$5 billion, and you can't explicitly just monetize the model, the app starts getting a lot of weight and value.

42:57Jeetu Patel:And if you actually make sure that you get the app effectively built out, that can be valuable. Right now, what AI is not good at is AI is not good at the last mile just yet. Yeah. Right? and in order like all these arguments that we have around jobs I actually find in the next in the short to midterm for sure and it might even be in the long term in the short to midterm for sure you're going to have more jobs because of AI not less because every single time there's a step function improvement in AI you actually have a human bottleneck that comes up so if you can add more value in the app layer then the model companies might be okay and then they just continue to keep moving up the stack, which is, by the way, what most kind of technology revolutions, that's what's happened is more and more companies, the profit eventually continues to keep accreting as you move up the stack.

43:50Jeetu Patel:And right now, there's also a tremendous amount of opportunity on the infrastructure side to get more efficient. So those are the two areas where you might see explicit monetization occur, and the monetization might not occur as much in the models if open source takes over. I think it's too early to tell. I think it's hard to know definitively that this is the way it's going to go. Also, every model, like if you think about the past three years, every single time we felt that, oh my goodness, this company no longer has any chance at success. They come up with something and all of a sudden they're back in the game.

44:23Jeetu Patel:You can't underestimate that.

44:26Stephanie Palazzolo:I mean, I have to tell you, people are down and out on Google's models right now. Just because at this moment in time they don't happen to be at the top of the leaderboards we know that gemini uh i think the next version of gemini you know they're being slower to release it i mean this is the thing that i i i think that there could be a comeback here and i i don't think that it's i don't think the story is is so store uh short here in terms of where their models uh not only there could be a comeback i can almost guarantee that that's what i'm yeah that's what i think so i mean like yeah

45:01Jeetu Patel:I mean, here's the thing. If companies like Google who have people like Demis aren't just sitting idle twiddling their thumbs, they're going to come up with something. By the way, three Gemini 3, everyone had given up on Google. Gemini 3 came up. All of a sudden, Google was a cat's meow, which I think it did an amazing job. Then some time goes by, and the next ball comes. What I would wish we did more of is start focusing more on the secular shift rather than the micro movements that are happening. Right, right. What is the game theory and what the secular shift is going to do? And what is that going to mean for certain workflows and certain business processes and certain automations and certain problems we want to solve?

45:43Jeetu Patel:And can we start working on that rather than just talking about the next benchmark? By the way, these evals, they don't mean much anyway because the evals only go out and assess one thing. Every company is going to need to have their own eval, and the model might perform differently for your company than what it does for a generic benchmark.

45:58Stephanie Palazzolo:And the models know that they're being evaluated sometimes too. Exactly, yeah. It's an interesting time. It is, it is. Jitu, it's a great conversation. I want to thank you for coming on and having it with us. That is Jitu Patel, President and Chief Product Officer at Cisco here on TITV. That does it for today's show. A reminder, we are on this stream Monday through Friday at 10 a.m. Pacific, 1 p.m. Eastern. If you can't make it then, episodes are available on theinformation.com, on our YouTube channel, or wherever you get your podcasts. Make sure to follow us on social media on X, Instagram, TikTok, and LinkedIn.

46:35Stephanie Palazzolo:I am already excited for our next show tomorrow. Have a great rest of your Wednesday. Bye-bye for now.

From the publisher

The Information's Stephanie Palazzolo talks with TITV Host Akash Pasricha about ChatGPT nearing 1 billion weekly active users and Stripe's $10 billion OpenRouter acquisition. We also talk with Rocket Drew about Reflection AI's secret race to build an open-source AI champ, and we get into open-source AI safety with Cisco President Jeetu Patel.


Articles discussed on this episode: 

https://www.theinformation.com/articles/openais-chatgpt-nears-1-billion-weekly-active-users-seven-months-target

https://www.theinformation.com/articles/nvidia-bet-reflection-open-source-ai-now-startup-playing-catch


Subscribe: 


Sign up for the AI Agenda newsletter: https://www.theinformation.com/features/ai-agenda


TITV airs weekdays on YouTube, X and LinkedIn at 10AM PT / 1PM ET. Or check us out wherever you get your podcasts.


Follow us:

X: https://x.com/theinformation

IG: https://www.instagram.com/theinformation/

TikTok: https://www.tiktok.com/@titv.theinformation

LinkedIn: https://www.linkedin.com/company/theinformation/


Chapters:

00:00 - Introduction

01:13 - OpenAI’s ChatGPT Nears 1 Billion Users

09:47 - Stripe’s $10 Billion OpenRouter Multiples

17:03 - Inside Nvidia-Backed Reflection AI

28:00 - Cisco President Jeetu Patel on AI Safety


More from The Information's TITV

All 304 episodes
ChatGPT Nears 1B Active Users, Nvidia-Backed Reflection AI Looks to Become Open-Source ChampThe Information's TITV · 47 min
Listen in VO