Trump Asks OpenAI to Stagger Release of New Model, Google Pressures Publishers on AI Licensing

26 Jun 2026 · 50 min · 27 chapters

Ask about this episode

Ask anything about it. ChatGPT or Claude reads this page and answers with the times it was said.

Connect VO and ask about every podcast you hear, including the moments you saved. Add to ChatGPT · Add to Claude

In short

The episode covers three AI business/security stories: (1) the Trump administration asked OpenAI to stagger release of GPT 5.6 for security reasons, including previewing it with approved “top partners” before wider release; (2) Google is pressuring news publishers with a new AI licensing pilot as it phases out Google News Showcase; and (3) some Anthropic/OpenAI customers are being overcharged for AI usage, according to a billing-audit report.

Guests (backgrounds)

Leo Schwartz (The Information tech and politics reporter; co-reporter on the OpenAI memo story). Amir Afradi (The Information co-executive editor; contributed to the story). Anne Guillen (The Information reporter covering digital media and e-commerce; reported on Google publisher negotiations). Allie K. Miller (AI creator/power user; advises Fortune 500 companies; runs an AI “agent workforce” via Cloud Code/Open Machine). Laura Bratton (The Information; author of Applied AI newsletter; reported on AI billing overcharges).

Key claims & examples

  • OpenAI worked with government for about a month to preview GPT 5.6; agencies reportedly want staggered access to customers, tied to national security concerns after White House export controls on Anthropic’s Fable/Mythos.
  • Executive order is described as “voluntary” but creating a de facto licensing regime without clear rules until August; possible litigation and “open weights” workarounds are expected.
  • Google’s pilot features AI article summaries in Google News and Gemini Responses plus an AI audio daily briefing; it seeks broad permissions including potential training rights and pushes publishers as Showcase is phased out (e.g., Washington Post, Guardian, Financial Times involved).
  • Billing audit: $34M AI bills (March–June) found ~$1.7M (about 5%) incorrectly billed; ~80% credited back. Examples include charging for a newer model than used or agents retrying tasks and generating extra token spend.

Written by AI. May contain mistakes. Listen to the episode to check what was said.

Chapters

Tap a time to open that second in VO

Government Requests for Staggered Model Release

1:06 to 3:00

Discussion on the government's request for OpenAI to stagger the release of GPT 5.6 due to security concerns.

“The information reported exclusively yesterday that the government has requested that OpenAI stagger the release of its new model, GPT 5.6.”

Reactions and Implications of the Memo

3:00 to 7:24

Exploration of the implications of the memo and reactions from journalists and experts.

“Sam Altman had been showing the model to top officials.”

OpenAI's Perspective on Government Involvement

7:24 to 10:42

Examination of OpenAI's response to the government's involvement in AI model releases.

“Some people are like, oh, we're China now.”

Concerns Over Regulatory Uncertainty

10:42 to 13:00

Discussion on regulatory uncertainty impacting AI companies and potential future conflicts.

“In this case, we're getting some degree of enforcement, at least against Anthropic, where the White House imposed these export controls.”

AI Companies' Strategies for Compliance

13:00 to 14:00

Insights into how AI companies are navigating government regulations and maintaining safety.

“these companies have been thinking about this moment for a long time.”

OpenAI's Approach to Cybersecurity

14:00 to 15:50

Learn about how OpenAI and Anthropic manage safety risks in AI development.

“And it's not like they don't have any influence, I guess, over government.”

Google's Negotiations with News Publishers

15:50 to 17:00

Explore Google's new AI features for news publishers and the challenges involved.

“Google is playing tough with news publishers as it continues to negotiate AI licensing deals.”

The Past and Future of Google News Showcase

17:00 to 18:30

Understand the implications of Google's decision to phase out its Showcase program.

“you know, that they, from either publications that they like or topics that they're interested in.”

Content Control and AI Generated Summaries

18:30 to 20:00

Learn about publishers' concerns over AI-generated summaries and their rights.

“What was the thing that's getting phased out?”

Publishers' Dilemmas in the AI Landscape

20:00 to 22:30

Delve into the challenges publishers face with Google and the evolving content landscape.

“Google News and don't bring people to their sites, a lot of them don't really feel like that's an effective solution.”
Show all 27 chapters

Rethinking Publisher Strategies

22:30 to 23:20

Discover how publishers are adapting their strategies amidst changing traffic dynamics.

“And I mean, you see other publishers that have kind of started to not turn their back on Google, but really kind of take Google out of their business model.”

Introducing Allie K. Miller

23:20 to 24:10

Meet Allie K. Miller and learn about her expertise in AI and content creation.

“Well, Anne, I want to thank you for coming on.”

Building an AI Workforce

24:10 to 26:20

Explore how Allie built her AI workforce and its operational structure.

“So I built the whole thing inside of Cloud Code, all with natural language and just saying, make me an agent that does X, Y, Z.”

Roles and Tasks of AI Agents

26:20 to 28:00

Learn about the specific roles and tasks assigned to Allie's AI agents.

“And we each have an interface, a mode to be able to speak with their workforce as well.”

Managing AI Assistants for Productivity

28:00 to 28:50

Learn how to effectively utilize AI agents to manage personal tasks and schedules.

“And do you have to prompt them to do it or do they just see the email come through and just do it?”

Trust Levels in AI Access

28:50 to 30:00

Discover the different levels of trust and access you can grant to AI agents.

“How much does it cost for you to run these 34 agents per month?”

Risk Management and AI Systems

30:00 to 32:10

Understand the importance of risk management when integrating AI into your workflow.

“So Ross, for example, can access my entire education folder, but maybe Joey doesn't have to do that because Joey's running product.”

Evaluating AI Model Performance

32:10 to 34:20

Learn how to assess the effectiveness of different AI models in your work.

“I mean, I think also the majority of people using these systems don't even realize they have to opt out of data sharing.”

Benchmarking AI Models and Their Applications

34:20 to 36:30

Explore how the latest AI models compare and their impact on various applications.

“but there are going to be companies that say bleeding edge or nothing.”

Effective AI Deployment Strategies

36:30 to 38:00

Identify strategies for deploying AI effectively in your business processes.

“Yeah, what I advocate for is to look at what AI can do at the 30 % or less level.”

AI Adoption Challenges in Enterprises

38:00 to 39:50

Discuss the common challenges faced by enterprises when adopting AI technologies.

“Let me ask you, you spend a lot of time talking to employees of big Fortune 500 companies, including employees of tech companies.”

Ethical Considerations Around AI Usage

39:50 to 41:40

Examine the ethical dilemmas surrounding AI use in the workplace and beyond.

“What's the most bizarre question that you've gotten from one of these discussions?”

Vulnerability in AI Interactions

41:40 to 42:00

Discover the balance between vulnerability and professionalism when using AI tools.

“Yeah, I still think, you know, corporate and work use cases in the workplace should still be number one.”

Emotional Support Through AI

42:00 to 43:35

Exploration of how people use AI for emotional support and personal tasks.

“People claim that they're using AI for emotional support at about 12%.”

AI Overcharging Issues

43:35 to 45:22

Discussion on the recent findings of overcharges in AI billing for companies.

“I want to bring on Laura to share with us what she found out.”

Customer Reactions to Overcharging

45:22 to 47:29

Analysis of customer responses to AI billing errors and suggestions for scrutiny.

“And a customer didn't realize that the AI agent kept trying over and over again, and they were getting charged for it.”

Developing Own AI Models

47:29 to 49:25

Considerations for companies developing their own AI models and associated costs.

“Have they taken any broader action against these companies?”
Hear the part that matters, and keep it.Open this episode in VO. Double tap your headphones to save a moment as you listen.
Get VO free

Transcript

Automatic transcript. May contain errors.

0:13Welcome, everyone, to The Information's TI TV. My name is Akash Pasricha. It is Friday, June 26. Today on the show, we are breaking down the information's exclusive reporting that the government has asked OpenAI to stagger the release of its new model over security concerns. We'll be joined by two of the reporters who broke that story. We also have some exclusive reporting about how Google is playing hardball in negotiations with news publishers over licensing deals. We've then got Allie K. Miller coming on the show. She is a very popular creator and AI power user. She also advises Fortune 500 companies on how they should be thinking about adopting AI.

0:53And finally, the information's Laura Bratton has new reporting on how some Anthropic and OpenAI customers are quietly getting overcharged. It's going to be a great show, so let's get right on into it. The information reported exclusively yesterday that the government has requested that OpenAI stagger the release of its new model, GPT 5.6. We spoke yesterday with Stephanie Palazzolo, author of AI Agenda, about the memo that she got a hold of revealing those details. But for a broader discussion on the implications of all this, I want to bring on Leo Schwartz, our tech and politics reporter and Amir Afradi, co-executive editor, who also contributed reporting to the story.

1:33Welcome to you both. It's great to have you here. So, Leo, I want to start with you here. I mean, let's recap. Stephanie gets a hold of this memo that Sam Altman put out to OpenAI. 5.6 is coming. We have to stagger it. That's what the government has asked. The government has also said that they would like to approve customers in the Stiger release, which is an interesting detail. Were you surprised by this memo that we got a hold of? We've been waiting for this other shoe to drop for weeks, ever since the White House imposed export controls on Anthropic and its powerful new model Fable and the private version Mythos.

2:11There was always this looming question of whether this was going to apply to other labs. it was only a matter of time before open ai or google or another company created a model that was this powerful and i don't think it's that much of a surprise that the government would treat it in a similar way uh and this all goes back to this this bigger question of what the licensing regime or the process looks like for companies who want to release new models and as we're finding out it's sort of being decided as we go along so i mean walk us through what happened in the run-up to this memo. Did it come out of nowhere or were there discussions happening in the month prior?

2:50As we reported, OpenAI has been working with the government to preview its new model for about a month. This is even before the export control decision by the White House. Sam Altman had been showing the model to top officials. But as we reported, agencies and different top officials in the Trump White House basically said that if they wanted to release it at all, they would have to do it in this very staggered way where it would only go to top partners before it could do a wider public release. Okay. Amir, zoom out for us a little bit, okay? You're out there in the sunny skies and the blue skies.

3:29You're looking at this from 30 ,000 feet above. What was your reaction to this? How crazy was this development? Well, the people who've been working in AI for the better part of a decade and taking it seriously from a safety perspective probably feel a lot of validation for some of their concerns. because now a good portion of government agencies, especially in the national security realm, agree with them that these are potential weapons or that these models are just something that you can't release willy-nilly. And so if you go back to when OpenAI started, these were the discussions they were having at the time.

4:19There were discussions around when will the government nationalize us and how was that going to look like? So as a result of these fears, as a result of these capabilities getting better and better. Now, obviously, we're nowhere near the singularity, if you will, but clearly the national security establishment in particular has been using these models to some effect or for some time. As Leo stated before, there's been a tremendous amount of discussion and coordination between OpenAI, Ananthropic, and government agencies for a long time. This is not a new thing. Even when OpenAI was developing their reasoning model, which was codenamed Strawberry at the time, this was back in like 2024 even, these discussions were happening.

5:13So I think it's been a slow moving thing. Maybe a lot of people didn't realize that this was going to come to a head. But here we are, and it's hard to see how this goes back. There's now going to be a persistent concern by the national security establishment in particular that these things can't just be released out there because there will be a significant consequence to a lot of companies and a lot of other governments if that happens. So that's why we are where we are. Okay, so that's the national security community's perspective on this. What about OpenAI's perspective today? How are they reacting to this new development?

5:56Yeah, I mean, nobody's happy about this inherently, right? You don't, you know, as a company or as an entity that's doing its thing and trying to release technology publicly so that everyone can use it, they're not going to be happy about this. It's just sort of a reality. And you have to decide, okay, am I going to go to war with my own federal government over these things? The answer is probably not. and so you just have to find a way to work with them. I think there has been some surprise around just how quickly, I mean, Leo was talking about, you know, this was the next shoe to drop, but it still comes as a surprise to some folks, just the level of, I suppose, disorganization, coordination.

6:42There are all these different agencies where, you know, we reported about the Commerce Department in particular that's trying to be a kind of central coordinating factor here, but in essence, there are just all these different forces within the federal government that all these companies are having to deal with, Google, Anthropic, OpenAI, and others. It's a very, very confusing time. I think Leo can probably break down this executive order that was just signed that is maybe going to start to create some order here in the chaos. And the reaction to the story yesterday was pretty fascinating. People have very, very strong views about what it means for the government to be this involved in deciding when technology is going to be released.

7:25Some people are like, oh, we're China now. Or other people are like, this is terrible for the open source community or for the startup community, which I think Leo actually has a lot more reporting that he can share about that. So Leo, chime in here then, because Amir is talking about this executive order. When we had you on last talking about the executive order, I mean, we talked about how voluntary was a word that was that was very important in that order. Amir is suggesting maybe that could provide clarity. But the last view I got from you is that it wasn't adding much clarity at all. Yeah, I think it's important to take a step back here and just frame how the Trump administration had talked about this in the past, which is when it came in, it said, we want to have industry first.

8:10We don't want to be imposing any regulation on industry that's going to stop, quote unquote, innovation. even when this executive order was being decided, which was basically a reflex to Anthropik's powerful model mythos, the Trump administration kept saying, anything we do will be voluntary. There is even language in the executive order. There was a whole clause that said, nothing in here can be construed to be mandatory or to be a licensing regime. I think a lot of the headache that you're seeing or consternation you're seeing with AI companies and people in the AI community is it seems like the opposite is happening here, which is we still have about another month until this framework that was laid out in the executive order is actually implemented.

8:53It's supposed to start around August. And in the meantime, what's happening is there's no queer framework for how the government's dealing with this. And instead, the government is imposing export controls on Anthropik. It's having a number of agencies basically decide how OpenAI should be releasing its model. There's a lot of uncertainty. And as we reported in this article, there was one feedback session a couple of weeks ago on June 9th, which was a few days before the White House imposed its export control on Anthropic, where it was starting to get feedback from industry about what this framework should look like.

9:28But it's very much uncertain how that's actually to be implemented. And in the meantime, we just have this new normal, which is essentially a de facto licensing regime with no rules. So what I put forth to Stephanie yesterday when we had her on is this felt a little bit similar to the regulation by enforcement mechanism of legislation, I guess, or action from the government that we saw during the crypto era. And Leah, I want to ask you if you agree with that, because you cover crypto for a long time. time in the crypto world there was a lot of regulatory uncertainty uh there were no rules that were actually made the SEC kind of came out after the companies tried stuff and said well we're not so happy about that um but there were really no rules that were set it feels like here maybe it could be similar in that the government never set any rules and drop it comes out with a model and then they put these expert controls out out now and nothing has really been set but everyone's scared to to do anything I mean I might make some enemies here but I would say it might it might even be worse because the having covered the trenches of the the crypto wars with the Biden administration what was happening then was there was no legislation coming out of Congress there is no real rulemaking coming out of the the financial regulatory agencies the SEC and the CFTC but instead they were doing lawsuits against the crypto industry and with a lawsuit at least you have you know, a 60-page complaint that lays out the agency's argument.

10:59In this case, we're getting some degree of enforcement, at least against Anthropic, where the White House imposed these export controls. But rather than having a 60-page complaint where the government lays out its argument for why it's doing it, it was a three-page letter that came from Howard Lutnick, the Commerce Secretary, with a novel legal theory and no real explanation as to how it would work or or why it was doing it. So I think there's some hope that when this framework does come into place in about a month, it will create rules of the road for how a company like OpenAI or Anthropic is supposed to release new models.

11:33But in the meantime, we basically have this shadowy system where a company like OpenAI has to comply with what the government and all of these different competing agencies want. And if they don't, ostensibly what would happen is they would have exporting controls imposed on them where no foreign employees at their company would even be able to use the model anymore. Akash, we should definitely say that inevitably there's going to be some type of litigation, not right now, not necessarily about this, but inevitably there will be some moment where something is going to have to give between the government's desire to slow down a release or a set of releases and these companies, you know, desire to actually get, you know, get their material out.

12:23And you have, like we talked about before, I mean, you have like, you know, Chinese models, open source models that are getting out there. If, you know, if the proprietary models built here in the U.S. are being slowed down in any way, I think there's going to be concern that more people are going to shift to these Chinese models. And then what do you do about that? These are open source models. These open weights exist. How do you regulate that? That seems like an even bigger nightmare that Leo's done some reporting on meetings around that as well. So I think there is going to be inevitably some amount of conflict.

12:58But at the end of the day, these companies have been thinking about this moment for a long time. They release pages upon pages upon pages about the safety risks of these models, including specifically around cybersecurity. So none of this is new. It's just, you know, a lot of people in this Republican administration maybe are thinking about it for the first time. And like Leo was saying before, they came in saying, like, hands off. But actually, they are being informed that actually these models are quite effective or can be quite effective if you play this out to the logical extreme. So we have to deal with this sooner than later.

13:37Yeah, I mean, I was trying to sort of think in my mind yesterday about what bargaining power, who has the leverage here and the bargaining power that the AI companies have. And Amir, maybe this is the point that you're getting at, but it feels like although they can't do anything without the government's green light, I mean, we've seen, it's not like, I mean, Silicon Valley wants to Silicon Valley, right? And it's not like they don't have any influence, I guess, over government. So, I mean, I feel like in my mind, and I'm asking, Amir, I feel like in the long run, maybe there's a scenario here where people do make the message clear that we have to continue to compete.

14:22What do you think? Yeah, I mean, they are, though, just to be very clear, like, OpenAI and Anthropik, they're not the same company, but they do think very similarly about safety risks. And so, both of them have moved forward with their latest model with an idea to blunt the cybersecurity capabilities of the model when it's released to the public, at least for some period of time. So this is a voluntary thing that they are wanting to do, which I think they would think would mollify the various government agencies, mainly the NSA, around who can and who cannot have access to these types of cybersecurity capabilities.

15:15But yeah, at the end of the day, there is going to be an inevitable conflict about where this line is going to be and what the rules are. And I think they're going to continue to talk and they're going to continue to try to refine the executive order, the terms of it. And then there's going to be a whole host of other companies that come later. Inevitably, somebody is going to challenge some of this, and it will go up to the Supreme Court one way or the other. And it's always going to be around security, national security. Is this taking a risk necessarily or not? Great. Well, Leo and Amir, I want to thank you for coming on.

15:49That is Leo Schwartz and Amir Afradi from our newsroom here at The Information. Google is playing tough with news publishers as it continues to negotiate AI licensing deals. My colleague Anne Guillen, who covers the intersection of digital media and e-commerce, caught wind of exclusive details of those negotiations. I want to bring her on to share with us what she learned. Anne, welcome back to the show. It's great to have you here. Hi, Akash. So what did you learn about this new program that Google is pitching to news publishers? Yeah, so Google has been pitching publishers over the past several months on a new pilot of AI features that are kind of designed to be woven into all of Google's products and how they feature content from news sites.

16:37So the three kind of key features that Google has been pitching publishers on recently are these AI-powered article summaries that appear in Google News and also in Gemini Responses, as well as an AI-generated audio briefing that summarizes various news articles as kind of like a daily recap or something that can surface new articles for people. you know, that they, from either publications that they like or topics that they're interested in. And this is just the latest program that Google has had for news publishers. They have tried all kinds of variations of different programs and relationships and pilots over the years, including something called Google News Showcase, which it's been rolling out in several different countries, including the U.S.

17:31over the past few years. This was kind of their COVID era, news program. And so Showcase gives publishers basically a flat fee each year in exchange for the publishers sharing their content with Google so that Google can kind of weave that into their various products, whether it's Android phones or the Google app, things like that. And so over the past couple of months, Google has told some publishers that eventually it's going to phase out Showcase. So it's really been pushing as many publishers as it possibly can to sign on to this new AI pilot. But so far, it's mostly been big names like the Washington Post, the Guardian, and the Financial Times.

18:17And some of the smaller or kind of more mid-sized publishers, you know, maybe have some reservations about entering into a deal like this with Google. And so remind me, so what was Showcase? What was the thing that's getting phased out? So Showcase, Google pays the publishers a flat annual fee in exchange for being able to use their content kind of across all of Google's different products. Got it. So trying to de-emphasize that and emphasize this new AI overview audio briefing feature, which, I mean, look, maybe I shouldn't say this as a journalist, but I think it's a pretty good feature. I mean, I use Google News all the time, especially the Google News tab, and I would love a summary that is correct and cited based on actual news reports that I know is verified.

19:10How do the news publishers feel about this? it's kind of a double-edged sword for the publishers i mean for a lot of them this is kind of just the latest thing that google is trying um you know there's always been a pretty contentious relationship between a lot of publishers and google just because in the past they've been so dependent on google as a major source of traffic and as people are using more AI tools like Gemini, like ChatTBT, like Claude, they're not searching on Google and clicking on links that come up in Google search results as much. So a lot of publishers have seen their traffic basically just fall off a cliff over the past couple of months.

19:53And a lot of publishers don't necessarily feel that AI generated summaries of their content that live on Google's app or in Google News and don't bring people to their sites, a lot of them don't really feel like that's an effective solution. Okay. And there's another catch here, right, with this deal, which is that's not the only way that Google is trying to take the upper hand in these negotiations. Yeah. So under the terms of this pilot, Google is asking for pretty broad permissions from the publishers to use their content, you know, kind of however it sees fit. And so some publishers have had reservations because these agreements do technically give Google the right to use their content for training AI models.

20:42And so a lot of publishers feel that, you know, who have reservations feel that just this kind of flat fee lump sum structure isn't necessarily appropriate compensation for the broad permissions that Google is asking for. The flat fee structure, I think, was something that wasn't always super popular. There are other news or tech companies that have news initiatives like Apple News that pay based on usage or the traffic that they drive to the articles. So I think the flat fee structure paired with these broad permissions has really given a lot of publishers pause about whether or not this is something that they want to sign on to.

21:29It's given them pause, but I wonder what you think ultimately happens here because if they're not seeing the traffic benefit of being included in Google News, for example, and they are seeing that a lot of people are using these platforms, do you think they have a choice ultimately? Yeah, I mean, it's causing a lot of publishers to really reconsider how Google fits into their business model and where they can reach their audience. I mean, for some really small local publishers, they really depend on this funding. You know, the funding pays salaries for their employees. It allows them to continue to exist.

22:11But also, I mean, their content many times is pretty valuable because it's very unique, It's very focused. And that publisher is kind of the only place that that information exists. So should they agree to a flat fee and let Google use their content however they want? I think a lot of them are really thinking very hard about that right now. And I mean, you see other publishers that have kind of started to not turn their back on Google, but really kind of take Google out of their business model. And double down on subscriptions, for example. Exactly. Yeah. Subscriptions, newsletters, anything they can do to reach their audience more directly versus relying on traffic from Google and ad revenue.

22:56You've seen a lot of publishers, especially ones that do have a bigger audience, move more in that direction. So I think Google is still certainly the giant in the room. And I think a lot of publishers feel a lot of pressure to work with them. But there are definitely some publishers out there who are using this moment as a way to rethink their relationship with Google more generally. Great. Well, Anne, I want to thank you for coming on. That is Anne Guillen, our e-commerce reporter here at The Information. Our next guest is an AI-powered user. Allie K. Miller has spoken to a wide array of Fortune 500 companies about how to use AI effectively.

23:37She's also a very popular content creator on the topic with 2 million followers across her channels. She also invests in AI companies and helps with strategy with her company Open Machine. I want to bring on Allie to unpack some of the hot button topics in AI right now. Allie, welcome to the show. It's great to have you here.

23:55Allie K. Miller:Yeah, thanks for having me. I'm excited. Okay, so I was watching some of your stuff this week and I saw that you said that you have an AI agent workforce of 34 different agents Can you walk me through how you built this workforce, what it even does for you? What is it? So I built the whole thing inside of Cloud Code, all with natural language and just saying, make me an agent that does X, Y, Z. And I basically iterated on this for a couple months to figure out what this structure is. I speak directly to Simon, my AI chief of staff. Simon has six direct reports, all named after the friends characters.

24:33Allie K. Miller:They all have sub-agents. And at any given point, they might also spin up hundreds of temporary agents to be able to get something done. Importantly, Simon also has a little assistant, Toby, who manages memory, who is looking across kind of as a project manager to make it more efficient. And actually, I think that's a massive opportunity. Everyone's very excited about multi-agents and AI workforce. We're kind of missing the boring, ugly side of it, which is, how do you maintain context across an entire company? How do you make sure that this AI workforce doesn't even drift? And so I actually like handling the boring stuff now, which is keeping it updated.

25:11Allie K. Miller:And one very exciting use case that we've been working on as a team is that every single person on our team has one Slack channel dedicated to them and their AI workforce, which means I can jump in to Suzy's channel, for instance, and ask Suzy to do something, and I'm talking to her AI chief of staff. So we've already... Suzy, is Suzy a real person or Suzy an agent? Yeah, Susie in this case would be a human. So I'm sure... Okay, Susie's a real person, okay. Yeah, I think, like, basically an AI-first org should be AI-first across people, process, product. Every single person forgets about process.

25:49Allie K. Miller:How do you just maintain things between teams, between people? If I ask someone to send an email or whether they sent an email, why am I waiting seven hours to get that response? And so for low-risk things, we're able to throw it in that channel and that person's AI workforce is going to respond back to us. So that person's AI chief of staff, which again, maybe she has her own Simon, is qualifying and classifying that ask, figuring out the risk and coming back to us. So essentially, I'm not just talking to one human. I am talking to one human plus their AI workforce. So every single IC is multiplied.

26:24Allie K. Miller:And we each have an interface, a mode to be able to speak with their workforce as well. Okay, so 34 different agents. You've got, what is it, Ross, Rachel, Joey, Chandler. Dawn, yep, yep, yep. PB, who am I? Monica, sorry, okay. So like, what do they actually do for you? What are the tasks that you give it? Is it filing your taxes or what? So my accountant, this is amazing, so I never do that. But for now, at least, the way that I break them down might actually change. So I think by default, a lot of the way that we work with multi-agent systems is taking what we know about humans and just applying it into the AI agent space.

27:07Allie K. Miller:That's why it looks like an org. That's why it looks like Monica runs operations. Rachel runs client work. Ross runs education. What I think is interesting is figuring out net new roles that we didn't have before. So Simon having that Toby, that's a role that we wouldn't have had. This like AI watchdog just looking over things going, that can be more efficient, that can be more efficient. And Phoebe, I actually started without Phoebe and added her because I was telling myself that I'm not being creative enough. I'm not being ambitious enough with how I'm using AI agents. So I added in a Phoebe.

27:39Allie K. Miller:Phoebe's entire job is just to be the weirdo that dreams, the weirdo that looks at output. So it's kind of like they're sort of acting more so as advisors than as doers right now, sort of. No, they're doing task completion. So if there's, for example, a client proposal that would fall under the client work, Rachel and her sub-agents would draft that first thing, would review over it compared to previous ones. And do you have to prompt them to do it or do they just see the email come through and just do it? Every 30 minutes, I have my AI workforce on a loop with the prompt that literally just says, do smart things.

28:13Allie K. Miller:So I have woken up. I have had things show up in my calendar that I didn't even realize that I'd put in. Simon wanted me to do more physical therapy. And so he put in two 10-minute blocks every single day. I now have him cite whether the meeting was from him or from a human agent, human assistant. And so they're completing tasks proactively. I think that's one of the bigger shifts that has come from the open claw era, which is that we're moving into a world that is much more proactive, much more asynchronous. And I am really not always gonna be the one that's saying, hey, please do this. How much does it cost for you to run these 34 agents per month?

Read the full transcript

28:54Allie K. Miller:I'm doing it within my subscription. So I have not yet hit my$200 a month limit. If I did, I also have the$200 a month. Within Claude. Within Claude, there'll be some proactive things from me that I put into Codex. So I'm using both Claude Code and Codex and I have$200 accounts in both and I have not hit that max to force myself to have to use APIs. We do have some products that is API driven, but anything that is personal productivity or personal growth, all of that is within subscription amounts. And then how do you think about like what you give? I mean, I assume these 34 agents have access to your email, your files, your computer.

29:38Like do you give it access to literally everything in your online footprint or are there things that you don't?

29:48Allie K. Miller:Yeah, so I'm going to be higher risk than the average enterprise. So I'll give you my answer, but then I'll also kind of share what Fortune 500 companies are doing. So in my workspace, different agents have different access points. So Ross, for example, can access my entire education folder, but maybe Joey doesn't have to do that because Joey's running product. Joey can deploy code, the other ones cannot. So there's definitely different rules and restrictions between them. Again, exactly how we think about humans. We have IAM. We have the ability to say this executive can access these 500 things that intern should not be able to.

30:29Allie K. Miller:And so your agent should have stratified sets of access, different permissions. That's definitely one layer. And then the second is progressive trust overall. So I did not give any of these agents the ability to put anything out into the external world. They could not post on social media. I have a large following that can get messy very quickly. That's where I'm at. I don't know if I trust these agents to do everything. Yeah, but you do trust them to do some things. And so I trust them to draft emails. I might not trust them to send emails, because this is a Fortune 500 CEO that could receive it.

31:07Allie K. Miller:And so there'll be a spectrum of trust. Enterprises are going to start, obviously, a lot lower trust. IT departments are going to be a lot more strict. But a solopreneur, a small, medium business, they're going to be a bit more flexible with what they give their agents access to. One thing that I have not given any of my agents access to is money. There are a lot of people who are higher risk than I am, more risk tolerant than I am, who have set up completely different email accounts, completely different calendars, completely different credit cards to give to their agents. We saw this with OpenClaw.

31:39Allie K. Miller:I do not want my agentic systems yet to have purchasing capabilities. So all of that still comes to me. I'm not coming home with a robot randomly showing up at my front door yet. Yet. Okay. So, I mean, I was going to ask you about privacy, but as you said, I guess you're sort of on the, you're a power user, so you are willing to take some of those risks. Look, I don't know if any risks are real or not. We talk about cybersecurity a lot on this show, and so it's something that I think a lot about. I mean, I think also the majority of people using these systems don't even realize they have to opt out of data sharing.

32:18Allie K. Miller:So there's a lot of, you know, important security concerns. One of the ones that I share with my team is we should always be using these state-of-the-art models because then the quality of the work that we might put out is going to be lower risk. So the posture that I'm looking at risk is not just whether things are locked down. It's also making sure that we are using frontier models and not something that was released two years ago. Okay, so that's actually an interesting point because we've been talking on this show now about, and we're talking about enterprise AI adoption largely, so it's a slightly different scale of use.

32:56But you talked about the frontier models. I mean, open source models have become a lot more popular, certainly based on the cost profile of them and them not being as expensive. and we know that Anthropic is changing the way that they are going to start charging people as well. Have you started using some of these open source models more heavily based on the cost profile?

33:18Allie K. Miller:So because I'm not reaching my subscription limit, I'm not motivated or incentivized to do that. I work with a ton of Fortune 500 companies across their org structure, across org upskilling, and tokenomics. What are they spending? And I'm seeing there are a lot of clients that are now worried about that cost. So a thing that we might look at might be, again, stratifying who has access to what systems, maybe setting spend caps, maybe having people have to fill out a form if they want higher limits and have to explain why they want that higher limit, setting up sandboxes with open source models.

33:54Allie K. Miller:But I think the important thing and what it comes down to in the enterprise space is how far behind are you willing to be? That is the big question. There are going to be companies that make$100 million bets because they're not willing to be two weeks to six months behind everyone else. So maybe years ago, open source would have been a year behind, and then it became months. Now it might be weeks behind, right? So yes, there is a little bit of that compaction happening, but there are going to be companies that say bleeding edge or nothing. So they're going to take that bet. they're going to say, hey, engineering team or R &D or Frontier Unit, go nuts.

34:33Allie K. Miller:We have to keep experimenting. And there are going to be some that are going to be fast followers. They're going to have a lot of different ideas about how to spend tokens. But it kind of leads to this question that we've been talking about on the show, which is, do the models actually matter anymore? It's a bit of a horse race, right? Anthropik comes out with one. OpenAI comes out with one. You've got the benchmarks. I don't know how much you pay attention to the benchmarks as far as what models. So you pay attention a lot. Then there's a question around it matters, you know, what the applications can do, what the user experience is like.

35:08So do you, it sounds like you do believe that the model strength actually does matter, does matter. Can't speak, it's a Friday. So model strength does matter in your opinion.

35:21Allie K. Miller:Look, the model used to be a much larger piece of the pie. And I think now people are really evaluating the full harness. They're evaluating what surfaces it might be able to show up in. Is it a desktop app or is that really clunky? So the model, anyone that has used Fable 5 when it was open for three days or if they had early access like I did, anyone that used that model, they know that that work feels different. You cannot just say it is only harness when everyone was depressed 12 hours after that model went offline. So there is absolutely a model component to this open source. Again, maybe we'll catch up in weeks or months, but the evaluation is going to be, yes, on the use case.

36:04Allie K. Miller:It's one of the reasons why it is so important, whether you're a small business, whether you're a large business, have that set of 10 tests that the second the model comes out, you are ready to test. Because I sent an email to every single one of my clients within 24 hours of Fable 5 coming out. There are going to be some clients that jumped on that, tested it within those 48 hours, and there are going to be some that have no idea what it could do for their business. What are those 10 tests? Tell me about 10. What are the 10 tests that you run when a new model comes out? Yeah, what I advocate for is to look at what AI can do at the 30 % or less level.

36:38Allie K. Miller:So my kind of fake rule of thumb that has so far been true, but it's kind of just based on anecdotes, is that models tend to be about 30 % on a task. The next generation tends to be about 70 % to 80 % on a task. And then generation after that tends to be about low 90s to mid 90s. For whatever reason, that still seems to hold. At the 30 % level, you're not really going to delegate something off to an AI system. At 70 % to 80%, you are going to start that delegation process and to have humans instead in the loop on verification. At 94%, you might fully delegate something to AI and have a secondary AI be the judge.

37:14Allie K. Miller:So I keep a set of tasks at that 30%. Right now, for example, models are really poor at illustrations. Models are pretty poor at spatial reasoning and 3D. Models have extreme memory caps of video management or video generation. So there are gonna be some tasks like that that are maybe more complex. You might also give long horizon tasks to AI systems. You might also break a task down less, right? So maybe three years ago, we were giving that list of eight perfect steps that an AI agent should take on. Guess what? The way that we are now prompting is goal-oriented. I'm not giving steps to really any of these agentic systems.

37:53Allie K. Miller:I am starting every single prompt with five characters slash G-O-A-L. And then I'm writing some sort of eval, some sort of rubric of what good looks like and what the overall goal is. And I'm giving it. Let me ask you, you spend a lot of time talking to employees of big Fortune 500 companies, including employees of tech companies. What's the most common question that you get from these employees? You'd be surprised. I think people think that I'm getting questions about how to build your whole AI workforce and automate all your job. Listen, the adoption inside these companies, even though they might be 80%, a lot of the adoption is still resting in traditional chatbot land, traditional single threaded land.

38:40Allie K. Miller:It's still in chat GPT. It's still in Claude. And so the questions that I'm getting asked right now, even at some of these amazing tech companies are just how to use Claude Code, how to use Codex, how do you get started? There's an open stack. Even at the tech companies? Absolutely. And even when I thought they were, I thought, you know, we hear about these, these token maxing contests, right? Although, you know, now they've done away with them because they figured out that you can't actually spend your entire budget in three weeks, but they literally still need to know how to use Cloud Code? Look, if you go into an AI lab, yes, every single person's using it there.

39:17Allie K. Miller:It is part of their hiring process. If you go into a digital native business, think Uber, think Pinterest, think Airbnb, Netflix, those people have extremely busy jobs. I think we overestimate, you know, how much time people have that they're just twiddling their thumbs, wondering what AI think to learn next. People have lives, people have jobs. So these are folks who they already had their bandwidth full. Now, all of a sudden, AI is changing every single week. It's really hard to stay on top of it. So if you go into one of these, you know, high scalers and you go into the finance department, the sales department, the legal department, they are not going to be at the bleeding edge.

39:52Allie K. Miller:They're using AI every single day, but there is going to be that lag in general enterprise lags two to three years behind startups i was the head of ai for ai for startups and venture capital at aws i saw that something would launch in startup land and then only two to three years later would it happen in enterprise world so if we imagine that the open claw revolution was end of 2025 we should expect to really only see these autonomous teammates at a decent scale in the enterprise space end of 2027 earliest. What's the most bizarre question that you've gotten from one of these discussions? Oh, I've gotten people asking, like, should I have an AI boyfriend?

40:34Allie K. Miller:I've had people ask, like, what secrets should I tell it? It's a lot of these, like, more vulnerable conversations. There's a lot of deception that is happening. so people are using ai to 2x or 10x their own work and they're not sharing it back with their company and so maybe they're asking certain questions around should i use a different device should i tell my boss that i'm doing this and what do you what's the answer like should they look if you're not incentivized to tell anyone at your business that you have gained this unbelievable learning or productivity or growth why would you right in general i'm going to side with that employee because they're going to be worried about their job, worried about their future, worried about their department, depending on how high up they are, worried about their bonus structure.

41:22Allie K. Miller:And so if they have not been incentivized, I'm going to tell them, hold your ground, right? Right. Like I, yeah. And what about the vulnerability side? This is, this is an intro, like, do you encourage people to be vulnerable with AI or to keep it pretty, uh, you know, pretty surface level? Yeah, I still think, you know, corporate and work use cases in the workplace should still be number one. There was some Pew research that came out for how often people claim that they're using AI for emotional support or companionship. And I actually think people underreported that. So people claim that they use AI for companionship about 4%.

42:02Allie K. Miller:This is U.S. adults. People claim that they're using AI for emotional support at about 12%. If you imagine that you are using it for extremely difficult work and you're overwhelmed, right? like this is an insane thing to admit on tv but like i just used my first ever credit card point and it was because i did not understand how to use these millions of points and actually like book a hyatt hotel and so i went into the system and said break it down that process of breaking it down provided me emotional support that process of breaking it down was vulnerable but was i asking for like extreme mental health support no but i think even in work use cases people are staying vulnerable in these conversations.

42:41Allie K. Miller:So it's a little hard to pinpoint how often people are using this as a vulnerability use case. I suspect that it's over 40%. Ali, you've never used credit card points before. Listen, every single person in my life has yelled at me. I have clients that are some of the largest airlines in the world. It's like the easiest thing to do. You just, it's like, I just redeem it for But my cousin has 12 credit cards and all this stuff. And I go, if I can't perform at that level, why perform at all? And I honestly think that's what holds people back in AI too, right? If people are getting out there, yeah.

43:16I don't have 34 agents, but I can redeem a credit card point. So maybe I've walked away from this feeling.

43:23Allie K. Miller:Thank you for setting the new bar. Now I feel capable of anything. All right. Well, Ali, I want to thank you for coming on. That is Ali Miller here on TI TV. Pricing has been a big story for AI models, but my colleague Laura Bratton, who reports on how AI is being adopted in big businesses and corporations, has new reporting that overcharges, or at least incorrect charges, are also now a big story for AI customers. I want to bring on Laura to share with us what she found out. Laura, welcome back to the show. It's great to have you here. Thanks. Good to be here. Happy Friday. Happy Friday. Have you redeemed credit card points before?

44:01I, you know, I was a little embarrassed when I heard that because I was like, I don't actually redeem credit card points quite as often as I should. I sort of forget that they're there, which is really ridiculous. And, and, you know, I should, I should be more aware of that. And my friends are always telling me about all the cool things they're doing with their credit card points. So that's my big lesson today. Maybe I'm, I don't know, maybe, maybe I'm not, I, I'm led to believe maybe I'm just not using them efficiently enough. I just redeem it for dollars because I, so. That's what I do too, yeah.

44:31And I just have to like remind myself to do that. But then when I redeem it, it's a lot of dollars. So, you know, perks of that, perks of waiting. Okay, so let's talk about the newsletter that you wrote. You write the Applied AI newsletter. You wrote about how AI companies are overcharging their customers. What's going on here? Yeah, so I talked to a startup that offers an auditing tool. They previously offered this auditing tool for companies for their cloud services bills, money that they're spending on advertising or shipping and logistics. And they recently launched a tool that helps customers audit their AI bills and how their token spend is going to model providers, whether that's directly with Anthropik and OpenAI or it's through a cloud services provider like Microsoft, Amazon, Google.

45:21And what this auditing startup said is that between March and June, it audited about$34 million worth of AI bills and found that about 5 % or$1.7 million was incorrectly billed. And that was either because, you know, a customer may have been charged for a newer model when they were using an older model, or maybe there was like an AI agent that continued to retry a task that it was completing incorrectly. And a customer didn't realize that the AI agent kept trying over and over again, and they were getting charged for it. Anyway, so there's all these reasons that this is happening. That's what I found from talking to this one.

46:06Did they get the money back? Yeah. So what the startup told me is that about 80 % of that$1.7 million was refunded. Not, I shouldn't say refunded, sorry. It was credited back to customers. Credited back. You get clawed credits. Right. Yeah. And I want to be careful just because, you know, Anthropic and OpenAI told me that they haven't seen evidence of these issues occurring. So, you know, Vaud had explained these common occurrences that might lead to overcharges. Anthropic and OpenAI said they're not seeing evidence of those issues happening. Anthropic was really adamant that, you know, they don't route the tasks that you ask your AI agent to do to a lower model and charge for that lower, you know, that high model while you think you're using lower.

46:57Anyways, the point being, there's no evidence that this is widespread according to the model providers, but I think that this is just another sign that as we are in this higher spending environment and people are blowing through their AI budgets, there's yet another thing that people might need to worry about, which is comparing your contract, what your contract says with model providers and cloud services providers, and what you're actually spending and having some sort of independent layer to validate that that's all being accurately built. Now, they seem to have gotten the credits back, but what's been the broader reaction here among customers?

47:36Have they taken any broader action against these companies? No broader action. And I should say, even just think about us as consumers, sometimes we'll get a bill from a provider. Yeah, you get overcharged. any service right it's like not right so it's not like this is some like you know malicious thing this is just something that like happens with providers and i think it's just a layer that you know i i don't i don't think it would necessarily be a massive concern if it wasn't for the fact that companies are really beginning to scrutinize their ai budgets and it's like you know what this auditing startup said is we kind of are just blindly trusting model providers and cloud services providers that they're grading their own homework accurately and billing us accurately.

48:20And what we need to do is look at this with a little bit more scrutiny and have some sort of independent validation layer. Obviously, the startup has a vested interest in telling me that because they want to sell their own product. I feel like the broader implication here, though, that I'm thinking about is that companies looking to develop their own models, they want to have more predictability in terms of what it can do and in terms of what they get charged. I mean, having these errors or having this uncertainty that am I getting charged actually for the tokens that I use, whether or not it's actually happening, I think it's another data point to suggest that there is reason to develop your own models from these open source models in the long run.

49:06That's true, but I will say then you still have to host your own infrastructure and then you you know, might be needing to audit those charges and make sure you're being charged accurately. So there's always going to be some sort of layer or some sort of piece associated with AI, some sort of bill that you're needing to maybe monitor and check. But I do think that that's a good point that, you know, maybe having more autonomy and control over your models and, you know, lowering that bill. It is another point that could bolster that argument. Right. Great. Well, Laura, I want to thank you for coming on.

49:43That is Laura Braddon, author of our Applied AI newsletter here on TITV. That does it for today's show. A reminder, we are on this stream Monday through Friday at 10 a.m. Pacific, 1 p.m. Eastern. If you cannot make it, then episodes are available on theinformation.com, on our YouTube channel, or wherever you get your podcasts. Make sure to follow us on social media, on X, on Instagram, on TikTok, and on LinkedIn. I am already excited for our next show on Monday. Have a great Friday. Have a great rest. Have a great rest of your Friday. Have a great weekend. See you soon. Bye-bye for now.

From the publisher

The Information’s Leo Schwartz and Amir Efrati talk with TITV Host Akash Pasricha about OpenAI's de facto licensing regime. We also talk with Ann Gehan about Google playing hardball with news publishers over AI licensing deals and Allie K. Miller, CEO of Open Machine, about building a 34-agent autonomous workforce inside Claude Code. Lastly, we chat with Author of Applied AI Laura Bratton about an independent audit revealing systematic token billing errors for OpenAI and Anthropic customers.


Articles discussed on this episode: 

https://www.theinformation.com/articles/trump-administration-asks-openai-stagger-release-new-model-security-concerns

https://www.theinformation.com/articles/google-strikes-tough-negotiating-stance-publishers-ai-licensing

https://www.theinformation.com/newsletters/applied-ai/anthropic-customers-find-errant-charges-auditing-startup-says


Subscribe: 


Sign up for the AI Agenda newsletter: https://www.theinformation.com/features/ai-agenda


TITV airs weekdays on YouTube, X and LinkedIn at 10AM PT / 1PM ET. Or check us out wherever you get your podcasts.


Follow us:

X: https://x.com/theinformation

IG: https://www.instagram.com/theinformation/

TikTok: https://www.tiktok.com/@titv.theinformation

LinkedIn: https://www.linkedin.com/company/theinformation/


Chapters:

00:00 - Introduction

01:13 - US Government Forces OpenAI to Stagger GPT-5.6 Release

16:57 - Google Pressures Publishers on AI Licensing Deals

24:32 - Inside An AI Power User’s 34-Agent Autonomous Workforce

44:34 - Audit Finds Systematic Billing Errors for Anthropic and OpenAI Customers


More from The Information's TITV

All 304 episodes
Trump Asks OpenAI to Stagger Release of New Model, Google Pressures Publishers on AI LicensingThe Information's TITV · 50 min
Listen in VO