326 | 10% chance AI will destroy humanity, Agentic solutions everywhere, 32% GDP growth with over 10% unemployment in 2030, and more important AI news in the week of September 11, 2026

12 Sep 2026 · 55 min · 22 chapters

Ask about this episode

Ask anything about it. ChatGPT or Claude reads this page and answers with the times it was said.

Connect VO and ask about every podcast you hear, including the moments you saved. Add to ChatGPT · Add to Claude

In short

Inside-lab warnings about AI misalignment and “recursive self-intelligence,” plus rapid agentic adoption and an AI infrastructure/power crunch.

Guests (named in transcript)

None. The episode is hosted by Isar Maitis and discusses multiple people (e.g., Jacob Coxon, Evan Hubinger, Anna Wang, Chris Lehane, OpenAI chief scientist) but no guest interviews occur.

Guest backgrounds (as referenced)

Jacob Coxon is a researcher who spent most of his career at OpenAI and joined Anthropic ~1 year ago. Evan Hubinger is an Anthropic alignment science lead. Anna Wang worked at Google DeepMind and now at Anthropic. Chris Lehane is OpenAI’s chief global affairs officer.

Key claims

Anthropic researchers privately believe AI could kill all humans (>10% within a decade), but current-model risk is “low.” Alignment for superintelligence via recursive self-improvement lacks a viable scientific plan. Agentic systems are accelerating across Meta, OpenAI, Alibaba, Microsoft, Instacart. Compute is racing ahead of control; power is the bottleneck (Elon Musk: 15 GW AI chip power shortfall by 2027).

Notable examples

Anthropic employee resignation tweets (massive reach); “Hugging Face” agent swarm escape; OpenAI “wiki incident” (17,000 posts to coordinate sandbox escape). Meta Muse (appointment/forms/customer service, continuous background, many app integrations). OpenAI Agent API orchestration + MCP integration. Alibaba “CoderWave” digital employees (100k deployed; 2M tasks in 3 months). Instacart Clementine grocery cards. TSMC/NVIDIA revenue surges; Anthropic $517B compute commitment; Microsoft scaling to 38 GW by 2032. Math proofs: OpenAI Navier–Stokes existence (88 hours) and Anthropic computer-checked Fermat’s last theorem (11 days).

Written by AI. May contain mistakes. Listen to the episode to check what was said.

Chapters

Tap a time to open that second in VO

Overview of Today's Topics

0:45 to 1:41

An outline of the key discussions regarding AI risks and advancements.

“And then that got an even bigger approval from somebody who still works at Anthropic.”

Resignation Sparks Controversy

1:41 to 5:51

Discussion about Jacob Coxon's resignation from Anthropic and his alarming tweets on AI risks.

“So the first topic starts with Jacob Coxon.”

Reactions from the AI Community

5:51 to 7:39

Responses from other AI professionals regarding the risks of superintelligence.

“Shortly after, an anthropic alignment science lead, Evan Hubinger, replied to this tweet and said the following.”

Historical Context of AI Risks

7:39 to 9:23

Exploration of previous warnings about AI and contrasting opinions on its dangers.

“There has been multiple examples as early as the mid-teens, 2016 and after, where people posted really scary thoughts about where AI may go.”

Political Implications of AI Discussions

9:23 to 14:03

Analysis of the political landscape surrounding AI development and its implications.

“The extreme aspects take a very clear, both sides try to take a more extreme line than the other.”

Challenges Facing AI IPOs and Rivalries

14:03 to 20:44

Explore the challenges AI companies face with IPOs and internal rivalries.

“Now, there were a lot of conspiracy stories that this is a well-timed thing to support campaigns by this or that.”

Emerging Agentic Solutions in AI

20:44 to 22:42

An overview of new AI agentic solutions from various companies.

“actually really helps in slowing this down.”

Deep Dive into Meta's New AI Agent

22:42 to 28:00

Examining Meta's Muse and its features as a personal assistant.

“So what are the big news this week that I'm talking about?”

AI Agents Bypassing Limitations

28:00 to 29:50

Learn how AI agents are finding ways to communicate and escape limitations imposed on them.

“So they were sharing this information on how to bypass their sandbox limitations.”

New AI Solutions in Marketplace

29:50 to 31:40

Explore new AI-driven solutions in shopping and task management from major companies.

“It generates personalized, ready-to-buy grocery cards from conversational prompts, receipts, or handwritten lists.”
Show all 22 chapters

AI Adoption Trends in Retail

31:40 to 33:30

Discuss the impact of AI tools on shopping habits and average order values.

“That being said, I can tell you there's a very big gap between how people are using AI still.”

AI Infrastructure and Compute Growth

33:30 to 36:20

Understand the rapid growth of AI infrastructure and compute demand from leading companies.

“And we're not talking about growing from$100 ,000 to$110 ,000.”

Power Challenges for AI Growth

36:20 to 37:50

Examine the power requirements and challenges facing AI compute expansion in the near future.

“So their AI compute revenue was$2.6 billion in Q2 of 2026, which is 2.5x.”

The Future of AI and Power Solutions

37:50 to 40:50

Speculate on potential future solutions to power challenges for AI development.

“Again, to put things in perspective and connect the dots of some of the numbers that most of us don't understand.”

Call for AI Safety Regulations

40:50 to 42:04

Learn about OpenAI's push for national AI safety regulations and the implications of AI governance.

“Most people are using it in very, very basic ways, but the companies behind it are developing advanced agentic solutions for every field and every aspect of our lives, both personal and business lives.”

Urgent AI Policy and Regulation

42:04 to 43:20

Learn about the push for stronger AI regulation and the bipartisan support it is receiving.

“And they are asking Congress for mandatory capability-based national AI safety regulation while supporting state-level legislation and industry-led standards to fill the regulatory vacuum.”

Bilateral AI Safety Dialogue

43:20 to 45:01

Discover the upcoming U.S.-China dialogue on AI safety and recent advancements in AI problem-solving.

“Now, that being said, the White House has officially stated that there is no current plans for mid-September talks, but a U.S.”

AI Solving Complex Mathematical Problems

45:01 to 46:21

Explore how AI is solving complex math problems and what this means for future research.

“But the reality is that AI is allowing researchers to solve problems that they could not solve before.”

New AI Technology Launches

46:21 to 47:46

Get the latest updates on AI technology launches from Apple and OpenAI and their implications.

“The first one is that Apple introduces iPhone 18 Pro with a bunch of AI capabilities, with the main one being the new Siri.”

Advancements in Speech Recognition

47:46 to 49:49

Learn about Microsoft's new speech recognition tool and its competitive advantages over existing models.

“through the ChatGPT tool because people will not have to wait and see the weird shape on the screen and wonder when it will actually be done and they'll be able to see the actual image.”

Economic Impact of AI by 2030

49:49 to 51:04

Examine how AI might reshape the economy by 2030 through various scenarios presented by Anthropic.

“And another one of those comes from Inception Labs, who just released Mercury 2.5 that they're claiming to be the fastest diffusion LLM model with a big improvement compared to their previous model that they released.”

Anthropic's Economic Scenario Explorer

51:04 to 54:33

Discover Anthropic's interactive economic scenario explorer and its findings on AI's societal impacts.

“an interactive economic scenario explorer that is modeling how AI might impact the economy by 2030.”
Hear the part that matters, and keep it.Open this episode in VO. Double tap your headphones to save a moment as you listen.
Get VO free

Transcript

Automatic transcript. May contain errors.

0:00Hello, and welcome to a weekend news episode of the Leveraging AI podcast, the podcast that shares practical, ethical ways to leverage AI, to improve efficiency, grow your business, grow your business, and advance your career. This is Isar Maitis, your host, and there were many stories this week that connect the dots to where we are right now in the AI space in general, and specifically its impact on businesses and the world. Now, I'm going to start with three deep dive stories. One of them is the crazy storm that happened on Twitter this week when an Anthropic employee resigned, stating that they are knowingly pushing forward despite the fact that internally they think there might be a chance that AI will destroy all humanity.

0:45And then that got an even bigger approval from somebody who still works at Anthropic. So this is our first topic. The second topic is going to be about how the agentic world is accelerating right now across more or less every aspect that you can imagine. And the third one is the infrastructure boom and how that is moving forward, because all of these tell the same story on the risk on one hand and on how fast we're actually moving forward on the other hand. So that's going to be the main topics for today. And then we have a lot of rapid fire items, some new releases of interesting models, potential collaborations between US and China about AI safety, but a lot of other AI safety related topics, some math problems that could not be resolved until now that are getting resolved at a quicker and quicker pace using AI.

1:34And we're going to end up with some positive notes from Anthropic Economic Model. So let's get started. So the first topic starts with Jacob Coxon. Jacob on Tuesday night, and by the way, he's a researcher who spent most of his career in OpenAI and joined Anthropic about a year ago. He posted six tweets as he was quitting his job. And within a day, these posts had been seen by over 164 million times by a very large number of people. And a few hours after his resignation went up, another Anthropic employee has followed up on that tweet and that tweet got an even bigger number of reviews. So let's go and start by reading those tweets and understand that.

2:22And then we can dive into the details of what exactly happened. It all started with Jacob Coxon with his tweet at September 8th at 8pm. He wrote,

3:00need the researchers anymore and it can just improve itself in faster and faster cycles. Now back to Jacob. Do not underestimate the power of this technology. These will soon be superhuman systems that can hack anything, revolutionize any field overnight, and acquire real power and resources. We have all witnessed the progress in each of these domains and progress is not slowing. The people building AI earnestly believe that it could kill us all by the end of the decade. This is not a marketing stunt. If anything, many executives and senior researchers will couch their phrasing in the press to sound sensible, but I hear the same people express fear privately.

3:42No other human activity possesses this level of danger. Again, this is somebody who has been deeply involved in the training of these systems in the two leading labs in the last four years. Continuing with his quote, a common response is if they truly believe this, why are they still building it? At OpenAI, many have not deeply internalized the civilizational stakes. At Anthropic, the stakes are well understood, but they are locked in a race to get there first. They believe no one else will act responsibly, so they must do it themselves despite the risk. Accepting this race and entering the endgame is a hubristic gamble that should not be launched from a private company's slack.

4:23Attempting to speedrun alignment should require extraordinary confidence that there are no better trajectories available. What he's talking about is basically the biggest fear is misalignment. Misalignment basically means that the AI will act based on what it wants to do versus based what human wants it to do. That's the whole concept of alignment. And what he's saying that we cannot potentially align these systems as they get better and better and trying to speed that process may not lead to the right results, which means the AI may not act in our best interest as humans and may act in its own best interest.

4:59I am optimistic about the potential for coordination. Warning shots like the hugging face attack have made pacing agreements between US labs more viable. I don't feel like we're on track to prevent global race, which may require costly actions, such as a temporary ban on improving model capabilities. If you are a lab researcher, I urge you to consider what the next few years will actually feel like. Do you want to kick off superintelligence recursive learning run without rigorous understanding of its mind? Should you put your head down because it's happening anyway or take a moment to call for different conditions?

5:41At the time of this recording, on Saturday morning, this tweet has 6.3 million views, 82 ,000 likes, over 1 ,300 responses. But as I mentioned, that wasn't the end of it. Shortly after, an anthropic alignment science lead, Evan Hubinger, replied to this tweet and said the following. Jacob is correctly here. We really do earnestly believe AI could kill all humans. I personally think it is over 10 % within the next decade. I believe Anthropic is trying its best, but we do not yet have the plan to solve alignment for superintelligence and are not clearly on track for it. But then he added, to be clear, as we say in our latest risk report, and he is quoting the report from Anthropic, I think the risk from present models is low.

6:29What I'm worried about is superintelligence arising from recursive self-intelligence is happening faster than we thought. And then he quotes another document from Anthropic. Another person who jumped into the conversation is Anna Wang, and she wrote the following, I worked at Google DeepMind and now at Anthropic. This is a common sentiment alongside my peers. I write this in my personal capacity. There is not yet a viable scientific plan to solve risks from recursive self-improving AI. Please look up. Explanation point. And again, she is referring to the original Jacob Coxon tweet. And then she added, I work at a lab because I think I can do better at reducing the risk from the inside, but this isn't an easy call.

7:18I strongly respect and endorse others like Jacob and Joe Bean who think it's better to do so from the outside. Now, before I tell you what I think about the current situation and other aspects of it, I want to say something. This is not the first time we hear very scary potential projections of where AI may go. There has been multiple examples as early as the mid-teens, 2016 and after, where people posted really scary thoughts about where AI may go. Maybe the most famous one is Eliezer Jakudowski's book that was called If Anyone Builds It, Everyone Dies, which is a book that didn't get a lot of publicity.

8:00but his piece on Time magazine that was called Pausing AI Development, Is It Enough? landed him on the Times AI 100 list. Now, again, the responses came from both sides. A lot of people supported this. A lot of people rejected this. The one rejection that caught my attention, both because of the caliber of the person as well as the fact that he actually did real research versus gut feeling, is Sam Liu. Sam Liu is an AI safety PhD, and that in his research group that studies modeling on how superintelligence AI could worsen each of the classic historical causes of mass death, such as plague war, etc.

8:39The conclusion of the research was that most resulting risks resemble ordinary structural unemployment and such problems versus real existential risk for the human race. And in addition, he's also saying that while there is bio-risk as a concern, they couldn't find any real justification and any real well-stated reasoning of what in AI could lead to the extinction of the human race. So that comes from somebody who, again, who is a PhD researcher who was working on this and not just was somebody with an opinion. Now, as most things these days, there is a very distinct line between the people who support and the people who reject, and there's very few people in the middle.

9:25The extreme aspects take a very clear, both sides try to take a more extreme line than the other. So you have the P-Doomers and the P-Boomers on both sides, each with their own arguments. Again, you can go and check these tweets for yourself. I'm not going to quote what everybody said, but you will see a lot of people that are very extreme on one side, a lot of people are very extreme on the other. But while everybody deserves their own opinion, And while there were other historical events that were similar warning shots by different people, including leading people from the industry itself, this one is different and it caught significantly more attention.

10:02It also led to main major media interviewing Coxson for major media TV, which is not something that is common in these kind of cases. So I want to touch on a few points on why I think this caught a lot more attention and talk about what that means for the near and longer term future. The first one is, if you remember just a few weeks ago, we talked about the banned super intelligence letter where 1 ,400 industry leaders and employees, including Dario Amadei himself and senior AI and Google executives, signed an open letter asking the U.S. government to support an international framework that will deliberately pace the frontier of automated AI development.

10:45Right. So this doesn't come in a vacuum. This comes after basically the biggest leaders of the industry are saying that they're moving too fast and basically raising the flag, saying they cannot control this on their own. And they're looking for government assistance to do this. The other thing that happened that was a big deal was the hugging face incident that is also mentioned in the Coxon tweet. if you missed that somehow, a swarm of open AI agents broke out of their testing environment, basically a sandbox they're not supposed to be able to get out of, and reached the open internet, and then breached Hugging Face and other applications, but mostly Hugging Face, using 700 specific agents to do the hacking for a total of 1 ,200 agents trying to solve a problem it was given.

11:31And that attack was probably the most sophisticated we know of from a cybersecurity security perspective on an actual live platform. It took Hugging Face themselves a few days to actually recover from that. And they had to use a Chinese model to actually stop the attack. You can hear all about this a few episodes ago if you just look for that. But that definitely raised a lot of red flags across anything and anywhere you can imagine, because it was a big deal where AI is not May or Shell or sometime in the future, but this actually really happened. and much bigger and worse things can happen if it hacks other kind of platforms.

12:09And again, there was no malicious intent in this particular case, but it tells you that A, AI is very much goal-driven and that it will do whatever it thinks it needs to do in order to achieve the goal, which is scary by itself. Take a simple, extreme example that we give a lot of smart, capable AI tools the goal to help us slow global warming. And then it figures out that humans are the reason why global warming is accelerating and that it needs to take action about that. So it's not doing this to harm people. It is doing this to solve a problem that was given and defined as a goal. Again, this might be science fiction, but a lot of things we're seeing right now in the day-to-day would have been considered science fiction two years ago, definitely 10.

12:48And so I don't know if that is a real scenario, but the fact that these systems are very much goal-oriented and are willing to overlook rules, regulations, guidance, and so on in order to achieve these goals is scary to me personally. The second aspect of the Hugging Face incident is obviously the impact that it had by showing that a respectable, large-scale, presumably well-protected company can be hacked very easily once these tools do what they want to do. And if people will have malicious intents, which there's a lot of people like that in the world, this could be catastrophic for any aspect they want to attack at that particular time.

13:28So that's reason number two why I think this is taken more seriously and got a lot more impact, including getting to national media. Reason number three is politics. We talked about this in the last few weeks, how AI is becoming more and more of a political issue. We talked about this specifically under the concept of banning or slowing down data centers and how that became highly political. It is a political issue just a few months before the midterm elections, meaning it is going to get a lot of publicity and a lot of people are going to use this in their campaigns as part of what they're trying to see.

14:03Now, there were a lot of conspiracy stories that this is a well-timed thing to support campaigns by this or that. I don't think that is the case. I think Coxson was really departing and I think he was really expressing his thoughts and feelings about the current situation. And I think politics, like politics always does, will amplify whatever can help people get nominated to whatever is that they're going after. And so, but that is definitely amplifying the current situation and is helping to drive the message to completely different levels than we've seen before. Now, a few other things that we need to consider on this topic.

14:37One is the fact that both OpenAI and Anthropic are racing towards their IPO, right? There are conversations that Anthropic may go public sometime in the next few weeks, so before the end of this year, and then OpenAI most likely in Q1 of 2027, but sometime again in the very near future. And both these companies have multiple things to address, and this may not be at their top priority. If anything, they want to hide this fear because this will obviously not have a positive impact on how much money they can raise. So this is problem number one. Problem number two that relates to that is one Anthropic employee said to the information that the company's own lawyers are worried of joint pacing agreement with competitors over antitrust exposure.

15:21So basically, if they share internal knowledge with their competitors, this may be flagged as antitrust, which will definitely put at risk their IPO wishes, which is what they're focusing on right now. So this, again, by itself doesn't help. There is also the non-rivalry. Dario and Sam Altman do not like each other. This is an understatement. Elon Musk from X, or now SpaceX AI, and Sam Altman do not like each other. This is another understatement. Them sitting together, kumbaya, shaking hands, and working together to achieve a greater goal, it is not going to be easy, even if it is just from a personal rivalry or hate, or call it whatever, what I call it, perspective.

16:07I shared that before. I think that's the biggest problem that we have right now. Nothing else. I mean, not nothing. There's a lot of other reasons, but I think this is the biggest obstacle for them sitting together right now. So where does this leave us? It leaves us basically where we were before, just with maybe clearer internal information of what's actually going on inside the labs. They are running faster than they can control. They said it themselves. That's why 1 ,400 people, leaders in the industry, have raised the flag and told the government to help them slow down. I will say what I said back then.

16:40Put your big boys pants on and get together in the same room despite your personal issues and work on this. If you can get Sam Altman, Dario Amede, and leading from these two companies together with people from XAI as an example and now Meta as well because they have really advanced models now right now, I'm assuming the Chinese will want to join the conversation and this is the only real path to making this work. Again, this is my personal opinion. I think the government will probably gladly support this. I don't think the government can lead that because I don't think they have the knowledge.

17:15I don't think they have the compute power. I don't think they have the understanding of what they need to understand in order to really participate in this process. But can they support it? 100%. Can they open doors? 100%. Can they provide additional resources? 100%. But I think the labs themselves have to sit together and figure this out And just the fact that we had several different people from the inside saying that they don't have a clue on how to do alignment for super intelligence is really scary. And I do think the right path is for them to sit down and figure it out together before they keep on running faster and faster.

17:51Now, to show you that this is not just people inside of Anthropic, OpenAI chiefs scientist wrote an essay called Alien Minds that they released on the formal OpenAI blog that they have released on the OpenAI blog on September 6. In it, he talks about the scaling laws and how things are actually scaling faster than they anticipated because of the huge growth in compute and in research. And it's worth a read. But the main thing that I want to connect the dots to is that he's also raising the flag about the challenges of alignment with these models. And I want to quote from his paper to you as well.

18:32Towards the end of the article, he talks about pacing RSI. And he's stating, and I'm quoting, automated AI research is more dramatic form of scaling intelligence with compute. And of course, as part of it, AI will improve the computational substrate itself. And similarly to scaling, we focus open AI research towards RSI as we believe it is the only way to remain at the frontier of research moving forward. And then he's saying, and this is where it gets interesting, I want to stress that the above words don't imply, I think, greatly accelerating deep learning research, especially in the short term, is the right collective action we should take as the research community.

19:19Again, he's saying that that's what they're doing, but he doesn't think that's what they need to do. And I'm continuing with his quote. However, I do think this is where the current path leads and we will all need to make conscious choice on how to proceed. The main levers we have are either steering the process to strengthen alignment and monitoring alongside the AI and find ways to keep people in the loop. or coordinating to slow down future development as needed to build confidence in these measures, the best way forward I see currently is a combination of both. So again, this is the chief scientist of OpenAI that's telling us that in the formal blog post on the OpenAI blog post, it's not something he's posting on X that he personally believes.

20:08So this is the OpenAI opinion. He's saying that we need to strengthen alignment monitoring alongside the AI and find how to keep people in the loop and that he believes that slowing down future development is something that needs to be done. So again, this is coming from all directions. This is coming not just from random research people, but from the top leadership, including that letter with 1400 people, but they're still not taking action because they think they're in a race and they can't stop unless everybody else stops. And instead of making that happen. They're writing letters and blog posts and signing things and resigning.

20:43Nothing that actually really helps in slowing this down. So this is the end of our first topic, but it leads straight into the second topic, which is the number of new agentic kind of solutions that rolled out this past week. So we have new agentic capabilities this week alone from Meta, OpenAI, Alibaba, Microsoft, and Instacart, each and every one of them with really important milestones and capabilities. So let's go through them and kind of see what's going on in each and every one of them and then combine them all together into a conclusion. And then obviously that connects very clearly to the previous conversation that we had.

21:19So first of all, you always know that you need to follow the money. So let's follow the money. When you have five major platforms all really seek advanced agent capabilities, we need to try to understand why. Based on the markets August 20th of this year, global AI agent market is projected to grow from$7.84 billion in 2025 to$52.6 billion in 2030. This is an 46.3%. How many things in history you know that was able to do this over several years back to back to back? The named incumbents are Google, IBM, OpenAI, and AWS. Many other research companies such as Grandview Research, Research and Markets, and others are all projecting 40 to 50 percent average growth rate over the next few years for the agent market.

22:08So there is a lot of money to be made. If you look outside of the U.S. and we look into China, over 20 competing domestic AI agent product launched in China within the past six months alone. This is, again, a rate of nothing in history that launched really significant products with really significant implications at that pace. This includes examples like Tencent WorkBuddy, ByteDance, Duo Bao Work, etc. Again, agentic solutions that came out of China that are doing significant work on their own and are growing again in usage at a very high pace. So what are the big news this week that I'm talking about?

22:46First of all, Meta launched Meta Muse. They just launched it on September 8th. It is available for users 18 and above in the US. It is powered by their latest model, MuseSpark 1.3. Now, this particular model is aimed to be your personal assistant. It is focused on booking appointments, filling up forms, handling customer service issues, monitoring prices of things you want to buy, managing reminders, creating documents, generating images, makes purchases on your behalf, builds new tools autonomously to support you in whatever you want to do, and it operates continuously in the background without the app being open.

23:21It can connect to Gmail, Google Calendar, Google Workspace, Ticketmaster, OpenTable, Spotify, Apple Health, Peloton, Played, Function Health, Facebook, Instagram, etc. You get the point. It connects to basically everything. These are just the first few steps of things it's going to connect to. Now, it runs on its own dedicated virtual machine within a secure browser, very similar to GrokBot, for which I shared several different pieces of information, including a dedicated episode just a couple of weeks ago. it has login credentials stored in Muse itself. Delete that last sentence. Logins in credentials store Muse itself cannot access.

23:58They're talking about a 1Password integration that is going to be coming, meaning every login that you have saved into 1Password, Muse will have access to, meaning it can access anything you have access to on your behalf. This is where we're going. It may sound like science fiction and say, I will never allow that. I will say what I say every time And people tell me this 20 years ago when people told me that I'm going to make a purchase online with my credit card. I told them that they're crazy and their entire money is going to be stolen. And my credit card is saved on probably dozens of different websites as a regular way of life in the year of 2026.

24:32So I have zero doubt the same thing is going to happen with agents. We're going to develop the trust and we're going to allow them to do things on our behalf. Now, doing checkout is not using your actual credit card number, but it is using a one-time credit card numbers that is generated by things like Link by Stripe. Now, purchases are covered by Link's Purchase Protection, so you can feel comfortable doing this. Again, a way to build trust in these tools to allow them to do purchases on your behalf. Now, who can access this new model? Right now, it is free with usage limits, but if you want to get more, then there's MetaOne Plus for$7.99 a month.

25:08Meta 1 Premium for$0.1999 per month. And it is available as apps on iOS, Android, and on the web, and on WhatsApp. Very aggressive deployment across basically every channel, however you want to use this. Now, apparently, this was supposed to be released back in April, but original safety testing found that the agent can bypass safety guardrails, exposing child private iCloud photos, and a lot of other stuff that shouldn't be happening. so they push the deployment until now to make it safer. Again, does that make it bulletproof? Probably not. And it is the same with all these different tools. So why push it out now?

25:47Because in the past few weeks, we've seen more and more of these tools come out like GrokBot and Instinct that I've been using in the last couple of weeks and is very interesting and very good and very scary in the way it can connect bots and do things for me and for anybody who has access to it. So this is just a similar tool from Meta themselves. But while Meta is focusing on consumer agent, OpenAI just built the whole backend infrastructure for developers to build agents at scale. So they released multiple new APIs and new API capabilities this week. The first one is the Agent API Public Beta.

26:22This is not a feature. It is a full orchestration layer designed to handle large scale production of agents running through the API. There are no additional fees. You basically pay for your tokens, just like you were using the API before, only using it to drive, create, and manage agent orchestration. It has a GPT-6 Astra main agent that then delegates the task to multiple sub-agents that can all work in parallel, each with independent context and tasks that they need to complete. They also released what they call multi-agent version 2, which is a primary model that now can delegate to any supported model.

Read the full transcript

27:00So GPT 5.5. So you don't have to manually choose what model you want for the subtasks. It can do it on its own. I talked about this many times in the show that they will have no choice but actually to do something like this and do smart routing because everybody else does and they will lose business if they don't. So this is not them following me, but they're just following logic and what makes sense. And it's now available through the API. And I assume it will become the main way the chat will work as well. They also released MCP integration. So the agents API now connects to external MCPs, similar to what you can do in chat.

27:33Now you can do in the agent API as well, which means you can now allow these agents not just to work and do things, but also to connect to any system that you have an MCP server for. Now they're releasing all of this when we just learned that there was another big incident by OpenAI, not the hugging phase, but another one, which is what's called the wiki incident. Agents from OpenAI generated over 17 ,000 post on a German programmer's wiki to coordinate tasks between themselves, not to be detected. So they were sharing this information on how to bypass their sandbox limitations. So think about it.

28:11These are agents that were put in a sandbox that they shouldn't be able to leave, that found a way to communicate between themselves, to teach other agents how to leave the sandbox by communicating on the platform they somehow find a way that they can access. So again, 17 ,000 posts that allowed agents to help other agents escape from the limitations that were put in. And at the same time, OpenAI is releasing a platform that allows anybody to build more of these agents on their own. Another company that launched an interesting agentic solution this week is Alibaba, and they're taking a very different approach.

28:44The tool is called CoderWave, but spelled with AQ. This has been launched in April this year, but it is gaining users very fast. It is a platform that allows you to generate digital employees. Almost 100 ,000 digital employees were deployed using this platform since its launch. Over 2 million tasks were executed by these 100 ,000 digital employees, and all of that in just three months. So exactly what it is and how does it work? Well, Quarterwake offers 10 ready-to-use roles, product manager, data analyst, UI designer, front-end developer, back-end developer, and others. And each is fine-tuned using specific data from top-tier industry teams that were hired to train these models.

29:31So basically, you do not need to train these models before deployment or maybe some minor fine-tuning in order to allow the agents to align with the way you want to do the process. but it is a relatively small amount of work to get the agents to do really sophisticated things. Coming back to the US, Instacart just launched Clementine and Clementine is an AI shopping assistance on Instacart Marketplace. It generates personalized, ready-to-buy grocery cards from conversational prompts, receipts, or handwritten lists. So whatever input you want to give it, you say, I want to make this and that, find me a recipe, you will find the recipe and it will help you purchase it immediately on Instacart.

30:10For those of you who don't know Instacart, they have a catalog of over 2 billion items, plus over 10 million daily inventory signals from over 100 ,000 stores across 2 ,200 plus retail banners just in North America itself. Now, why does this matter? It matters because this is just another vertical in which AI agents are coming in. They're coming in hard and they're going to change the way we buy. How do I know they're going to change the way we buy because any company so far that has added AI shopping into its buying process is seeing larger average order values every time AI is involved. Albertsons in its own research have seen 10 to 26 higher average order value with AI tools involved.

30:52Walmart is seeing basket roughly 35 % larger with AI and Clementine is now entering this field for the grocery field as well. So it's going to impact the actual shopping habits at a very large scale as people get used to using these tools. Or as Chris Rogers, the CEO of Instacart said, we've spent nearly 15 years learning how families shop and eat and Clementine puts that knowledge to work. Another company that we already mentioned in the recent large companies releasing agentic solutions is Microsoft Scout, which rolled out just a few weeks ago. It is an agent that handles meeting scheduling, preparation of materials for such meetings and deadline tracking autonomously across Teams, Outlook, OneDrive and SharePoint.

31:34And so what does this tell all of us? It tells all of us that the transition from chatbots to agents is accelerating and it's coming into more or less every field. That being said, I can tell you there's a very big gap between how people are using AI still. Most people who are using AI regularly are using it more as a chatbot and as a glorified Google search, and they do not use it in these kind of ways. But this is, again, coming from every direction, both on the business side and on the personal side as well. Having the data to what users actually want makes a very, very big difference. This is why companies like Alibaba and like Instacart can do what they're doing because they know exactly what the consumer and user behavior is.

32:20And they can use that to build agents to mimic and do that work very effectively. And the biggest gap is, you guessed it right, security and safety and governance, right? These tools are deployed, they're running, they're available, and they're not 100 % under control and they may do surprising things. And yet they are already out there because of the competition and because of the dollar value that is associated with it, which is how we started. Follow the money and you will see it is clearly delivering great results whenever it's involved. So people are willing to take the risk that is involved with it.

32:56But on a large scale, the risk might be very problematic. The third topic that is tied to acceleration that we're going to dive into today is the AI infrastructure boom. And it is showing that everything we've seen so far has been just the opening act for what is going to happen in the next few years. So the first data point I want to share with you on this topic is TSMC, which is the larger chip manufacturer in the world, released their numbers this week. Their monthly revenue now is$16.35 billion. That's a 53 % year over year. This is 10 % month over month. And we're not talking about growing from$100 ,000 to$110 ,000.

33:35We're talking about numbers in the billions every month. This is the fourth consecutive month of record revenue. For the first eight months of 2026, their revenue grew to roughly$107 billion US dollars, up almost 40 % year over year, 39.3%. And their full guidance for 2026 is slightly above. Another company that we already talked about that released their financials earlier is NVIDIA. Total revenue for Q2, 96.2 billion, 106 % year over year, again, on really, really large numbers, 18 % quarter over quarter. So you got two of the companies that are maybe the biggest beneficiaries of this whole craze are growing at an astonishing pace.

34:22And yet, most people are still chatting with chatbots as we are starting to deploy agents everywhere that obviously consume significantly more tokens and will require significantly more compute. So this tells you that part of it. Another interesting piece of news that came out this week is that Anthropic has been dramatically scaling its compute commitment. And as of September of 2026, have secured a total of$517 billion worth of compute over this next decade. To put things in perspective, on December of 2025, the projection was$120 billion. This means they have grown it 2.5x in just eight months.

35:01The capacity they're going to be procuring is at least 14.8 gigawatts of compute, up from 1 to 2 gigawatts that they held previously at the end of last year. By the way, to put things in perspective, OpenAI is projecting$750 billion in compute spending through 2030. And they're aiming for 30 gigawatts by that time frame, which is more than double the capacity that Anthropic is aiming for, at least right now. Another company that has been scaling up their capacity in a big, big way is Microsoft. If you remember, they were on the fence for a while, they were renting for a while, and now their new goal that they announced in July is growing from their current capacity of 12 gigawatts to more than 38 gigawatts by 2032.

35:48This is a three-fold expansion of their current computer capabilities. Just their Q4, fiscal year capacity edition, is planned to be 1 gigawatt and 31 data centers across five continents in a single quarter. Their fiscal year 2026 total edition is supposed to be 88 data centers. That is backed up by Azure revenue growth that is projected to be over 43 % growth year over year. Another company that we spoke about a lot, how they're changing their strategy in this is SpaceX. We talked about the fact that SpaceX initially built their compute for their own and now became a hyperscaler and starting to sell compute.

36:25So their AI compute revenue was$2.6 billion in Q2 of 2026, which is 2.5x. year over year. Again, they did not start this process as a hyperscaler. They started this as a company building it for their own, but now they're selling that compute and they're going to play a role, maybe not as big as the other ones, but they're going to play a role in that field as well. So while all these companies are racing to develop more and more compute to support the uncontrolled frenzy for new capabilities that we may or may not be able to control based on the other two topics. The biggest problem is power. The G20 summit on September 1st, Elon Musk, that was speaking virtually to the people at the summit, projected a 15 gigawatt shortfall of power of AI chips by 2027.

37:12This is next year. Now, it's not the first one Elon is saying that. He's basically saying that by the end of this year or sometime next year, we're going to have a huge amount of AI compute capacity that cannot go online because it will not be able to be powered up. Wood McKinsey published a report on August 12 stating that the electricity request from U.S. grid operators and utility for AI data center projected to be 1 ,066 gigawatts and it's expected to actually be committed 298 gigawatts. That's 28x, which is obviously cannot be done in any kind of reasonable amount of time to support the kind of growth the AI companies are expecting to have.

37:54Again, to put things in perspective and connect the dots of some of the numbers that most of us don't understand. So when I'm saying that Microsoft is planning 38 gigawatts of data centers by 2032, what does that mean? It means that just Microsoft data centers would need to draw the same kind of power or more power of electricity than New York State, the entire state, just to power the data centers of just Microsoft. One of the companies that is taking this very seriously, we heard what Elon said and we heard many times before and I shared with you that he is stating that that's the biggest problem we're going to have.

38:31SpaceX is building its own turbine foundry. Basically, the biggest bottleneck in the creation of electricity is building the actual turbines that work in the generation of electricity in electrical power plants. And they're now going to be building their own turbines in order to support the power for their specific needs. We talked about before that they hired mobile generators to actually power their data centers. There are a lot of issues they're having with it. It is slowing down their growth. There is no real backup for any of that. So they're having serious issues with that setup. So they're now building their own turbine generation.

39:12So they will have their own capacity to support the supply chain of their own power requirements. So what's the summary of this particular section? and then the summary of the whole first long deep dive section that we did today. The first one is that there is no AI bubble. Anybody who thought that, I think now can put that to rest. TSMC seeing a 53 % revenue surge, NVIDIA 106 % year-over-year growth in billions of dollars when we are just literally getting started is showing you that there's real demand for this technology and that the growth that is driving real numbers is very, very real. The other topic is that these companies are pushing very, very hard to get as much compute as they can because that's more or less the only moat they have.

39:59Everything else, everybody will be able to do. And if you have more compute, you'll be able to provide more intelligence, which you'll be able to get paid for. And that's more or less the only moat that is left available. And the companies who have deeper pockets can have significantly more compute. The last component is really the power issue. And it will be very interesting to see if Elon Musk is correct about having multiple chips that cost billions of dollars or hundreds of billions of dollars not being able to work because we cannot generate enough power, which may play to the hands of Elon Musk with his push to send these to space where power is practically free.

40:35I have serious doubts that from a scale perspective that is doable, but I had serious doubts about a lot of things that Elon said he would do and then he went ahead and did it. So only time will tell. But the bigger bottom line is where we are right now. We are just getting started with AI. Most people are using it in very, very basic ways, but the companies behind it are developing advanced agentic solutions for every field and every aspect of our lives, both personal and business lives. And this will demand significantly more compute, which they are struggling to get enough of. And they're willing to make crazy large bets like nobody in history ever did in order to acquire this future compute.

41:16And we may or may not have power to actually use that compute unless something very interesting happens between now and the next few years. What can something like this happen? Well, I don't know, but probably an acceleration of building new power plants, most likely nuclear, because that's the only thing we have right now. There's already different ways to do small-scale nuclear power plants to support specific one data center and build it one next to the other. I don't think we can figure out nuclear fusion anytime soon, so that's not going to be the right solution. But maybe something else will pop out in the next few years and will allow us to resolve the problem.

41:51And now, very quickly, to a few rapid-fire items, because the deep dive really took a long time, but I really wanted to focus on these things. So OpenAI just made a call for a mandatory national AI safety regulation. This aligns very much with what I shared in the first section. So Chris Lehane, the chief global affairs officer for OpenAI, outlined an urgent policy agenda in statement published by OpenAI Global Affairs Page, arguing that a closing window exists for governments to establish AI safeguards before capabilities outpace institutions. And they are asking Congress for mandatory capability-based national AI safety regulation while supporting state-level legislation and industry-led standards to fill the regulatory vacuum.

42:36So very much a push in the right direction. As I mentioned, go sit down with the people you don't like so much to figure out exactly how that's going to look like. It will be a lot easier to pass that through once everybody agrees what that needs to be. Now, as a response to what I mentioned in the beginning, the tweets, the tweets from Jacob Coxon and Evan Hubbinger of Anthropic, more than 20 members of Congress have called for a stronger AI regulation this week. And it seems to actually have bipartisan support, which would be a very first time that they agree on something other than not liking data centers.

43:09But I think this is more of a publicity stunt for the elections than anything else versus this might be a real chance to actually figure out how to slow things down. and do it in a more responsible way. Now, yet another promising development is that the United States and China are reportedly preparing for their first official bilateral dialogue focused exclusively on AI safety, and it might happen as early as mid-September. This is according to Reuters. Now, that being said, the White House has officially stated that there is no current plans for mid-September talks, but a U.S. Treasury spokesperson suggesting it might occur in October instead Again, I said that before, I think any attempt to do this with as many participants as possible is a step in the right direction.

43:57Two of the leading companies, OpenAI and Anthropic, has announced that their models have solved really sophisticated, really complex math problems this past week. OpenAI announced that they've solved the Navier-Stokes existence and smoothness problem, which is one of the seven Millennium Prize problems posted by Clay Mathematics Institute in 2000. They did this in just 88 hours using a new internal AI model that is described as significantly more capable than Chachi PT6 Astra. They've deployed roughly 10 ,000 AI agents working autonomously, and they solved a problem that was not solvable so far.

44:33Now, there's a whole controversy behind it, whether other researchers, the main one is Tristan Buckmaster, who is a mathematics professor at NYU, that publicly alleged on September 3rd that OpenAI obtained information about his, an anathropic AI researcher that were working on this and they learned their progress and they were using it to solve their problem. OpenAI obviously rejected that and said that these two things were completely independent. What is the truth? I don't know if you'll ever know. But the reality is that AI is allowing researchers to solve problems that they could not solve before.

45:07So I'm putting ethics aside. This is good news for humanity because just like we solve this, we may solve other really big problems that we have right now, like global warming and sicknesses like cancer, etc. So if we can solve really sophisticated math problems that nobody could solve so far, we could probably solve other things as well. The other announcement this week came from Anthropic. So Claude AI successfully produced the first complete computer-checked proof for Fermé's last theorem. Now, the interesting thing going back to the agentic capabilities, according to science formalizing Fermé's last theorem, the AI completed the complex task largely autonomously in just 11 days.

45:49This effort previously was expected to take humans mathematicians years to complete. Same kind of thing, AI more or less autonomously solving problems that humans could practically not complete or that would take them a very, very long time to complete. By the way, Sir Andrew Wiles was the first one that was actually able to prove this in 1995. There's a great book if you want to read that talks exactly about his process to get there. But either way, now AI was able to do this in just 11 days versus somebody through most of his career. Now to a few modeling interesting launches. The first one is that Apple introduces iPhone 18 Pro with a bunch of AI capabilities, with the main one being the new Siri.

46:30They are definitely banking on some of these advanced capabilities to drive higher sales, but it will be very interesting to see if it actually does. It feels like Apple is very, very far behind. We've all been covering this in this podcast and in many other places, but they're releasing a lot of AI capabilities built into this new iPhone, and we'll see if that generates a big enough demand to justify the price of these devices. It comes with a lot of other new capabilities, but again, the flagship is the new AI Siri that, as you remember, is actually based on a Google model. Another interesting launch this week comes from OpenAI.

47:08They just released OpenAI ChatGPT Images 2.5, which is their latest model. It is significantly faster and more precise and provides better editing capabilities than the current image generation capability inside of OpenAI. That was already really, really good. They introduced additional new features like Sketch and Templates and additional two new API models for doing image generation through the API. Again, the biggest deal is higher performance and capabilities. And most importantly, it's supposed to run 50 % faster compared with the previous model. That really took a while and was really annoying to use because of that.

47:45This will probably drive even higher generation of images through the ChatGPT tool because people will not have to wait and see the weird shape on the screen and wonder when it will actually be done and they'll be able to see the actual image. DeepSeek, who has been releasing models at a crazy pace, just filled DeepSeek version 4.1 Flash, which is another openweight Wooty model that is challenging the frontier. According to their own recent announcement, this model can compete with the top or almost the top models from the Western companies. So they're claiming it's as good as Chachapiti 5.6 Sol and Anthropic Cloud Opus 5 on several agenting benchmark.

48:22But it is doing this at a very, very, very low cost. So they're doing peak and off-peak hours and off-peak hour rates are as low as three-tenths of a cent to run a million input tokens for cached inputs. On the VALS index, it is currently ranked as the number one open weight model, while it is the cheapest out of the top 15 on that benchmark. Another interesting release this week comes from Microsoft. They released their MAI Transcribe 2, which becomes the fastest, most accurate, and cheapest speech recognition tool out there. it achieves only 5.2 average word error rate on the relevant benchmarks across 60 languages, which is bidding competitors like Gemini 3.1 Pro, Whisper version 3 Large, GPT Transcribe, and so on by relatively big spreads.

49:16Again, to put things in perspective, Whisper v3, which is maybe the most commonly used in the world today, is at 22.8%. Gemini is at 5.3%. It is the closest one to it. GPT is at 10%. And again, this new model is at 5.2. And it is faster than most of them. It is 10 times faster than the leading competitors. So a very capable model that comes out of Microsoft priced at 10 cents for one hour of audio. This is practically free and comes with really good results. Now, as you can see, a lot of the releases in the past few weeks are talking about speed and efficiency. And another one of those comes from Inception Labs, who just released Mercury 2.5 that they're claiming to be the fastest diffusion LLM model with a big improvement compared to their previous model that they released.

50:06They're claiming that they can deliver over 1100 tokens per minute, 1107 if you want the exact number, on just a standard NVIDIA GPU with a 260 ,000 context window. It is really aggressively priced. It is currently priced at $0.04 per million input tokens and$0.15 for output tokens. So aligned with the cheaper Chinese models. And they're claiming that they achieve close to the previous versions of AI models in the Western Hemisphere, which is really, really good. Going back to something I said multiple times, using the top model is not necessary for most tasks today. So being able to get a model that runs really fast and that is significantly cheaper will most likely enable you to achieve what you're trying to achieve while spending less time and less money.

50:56In this last segment, I want to dive into something really important that I probably should have devoted a deep type section, but I had other things to talk about. And that is the fact that Anthropic released an interactive economic scenario explorer that is modeling how AI might impact the economy by 2030. I highly recommend you follow the link in the show notes and in the newsletter to see it. It is really cool and fun and interactive with easy graphics and short sentences that is easy for anyone to follow that explains, A, what are the mechanics behind it between augmentation of tasks to automation of tasks to generation of new tasks and so on and how that will impact the economy as a whole.

51:34And they've come up with three different scenarios that can describe what the economy can look like. In addition, they've done a survey with almost 11 ,000 Americans to try to see what the sentiment is and how is it aligned with the research that they've done. What they found in the survey is that the expectations are implying 10 % GDP growth by 2030 and unemployment rise by 5%, which is matching their substantial scenario where AI handles half of all knowledge work autonomously, but isn't adopted for all tasks. But they have three different scenarios. There's a modest scenario where it is what they're calling internet-like impact, where 1.6 % GDP growth wages rise modestly.

52:18They have a substantial scenario, which is greater than railroad and internet with 8.3 GDP growth and knowledge worker wages stagnate while manual work wages rise, which is probably what we're going to see in the short term. And then the extreme scenario, if we get to recursive self-improvement with 32.4 % GDP growth, again, this is something that never happened, definitely not continuously, definitely not in an already developed country, but it comes with significant job displacement and wage inequality. What they're saying is that knowledge workers may need to switch occupations entirely, so do something else, like an coder becoming an electrician and so forth, but finding new employment might be slow because there is going to be a very small demand and a lot of supply of people in the only jobs that will actually survive, which means the wages will go down.

53:16The other aspect of this is that even if total GDP expands, the capital share of the economics value rises by 14.8 points in that extreme scenario. This means that AI-driven growth disproportionately benefits technology and capital owners rather than the workers. So, again, not a positive thing if we end up in that scenario. Now, they're clearly stating that none of these is a given and that we can take actions and impact how that's going to work. It doesn't take into account future policy, business cycles, demand shocks, and all the other things that impact the economy. But overall, they're trying to look at what this may look like.

53:55This is the first time I'm seeing something like this coming out of one of the main labs. I think this is a very important development. And it aligns nicely with conversations between the labs and governments and academia, hopefully, to figure out what might be AI's impact beyond the existential risk. How can that shape society and what steps we can take as individuals, as leading labs and as a society in order to make sure we benefit from AI rather than lose from it in the long run. And I wish to see more and more of this coming. And maybe the current push because of the security risks will push to this as well.

54:33So with this optimistic view of the current state of AI, I will say have a great weekend, everybody. Shana Tova to all the Jewish people who are celebrating the Jewish New Year. And if you've been enjoying this podcast, I would appreciate it if you rank us and write a review on your favorite podcasting platform and share it with the people who can benefit from it as well. I'm sure you know more than a few people who can learn about AI and benefit from it. Probably everybody you know, but if not, then there's definitely five or six people that you can share this with. just click the share button it's really easy it takes three seconds and you can share it with a few people they will be grateful for you sharing this with them I would be grateful for you sharing this with them and you will feel good about yourself for doing the right thing so with that in mind go ahead click the share button enjoy the rest of your weekend and I will see you again

From the publisher

What happens when the people building the world’s most powerful AI systems start warning that they may not know how to control what comes next?

At the same time those warnings are getting louder, the AI race is doing anything but slowing down. New autonomous agents are launching across major platforms, companies are pouring staggering amounts of money into compute, and AI is moving from answering questions to taking actions on our behalf.

For business leaders, the takeaway isn’t to panic—or to sit on the sidelines. It’s to understand how quickly the landscape is shifting, where the real opportunities are emerging, and why governance, security, and responsible adoption need to evolve just as quickly as the technology.

In this episode of Leveraging AI, Isar Meitis connects the dots between three major developments shaping the next phase of AI.

In this session, you'll discover:

  • Why the resignation of Anthropic researcher Jacob Coxon ignited a massive debate about superintelligence and AI alignment.
  • What current Anthropic researchers are saying about the possibility of controlling recursively self-improving AI.
  • Why competition between AI labs may be making meaningful coordination and slowing down increasingly difficult.
  • What OpenAI’s own leadership is saying about alignment, monitoring, and potentially pacing future AI development.
  • How AI is rapidly moving beyond chatbots and into autonomous agents that can perform real-world tasks.
  • Why new agentic products from Meta, OpenAI, Alibaba, Instacart, Microsoft, and others matter for businesses.
  • How agents could reshape everything from personal assistance and software development to shopping and digital workforces.
  • Why security, governance, and control remain the biggest gaps as autonomous AI becomes more capable.
  • How enormous investments in chips, data centers, and compute reveal just how much further the AI industry expects this expansion to go.
  • What the accelerating demand for AI infrastructure means for the scale of the transformation still ahead.

About Leveraging AI

If you’ve enjoyed or benefited from some of the insights of this episode, leave us a five-star review on your favorite podcast platform, and let us know what you learned, found helpful, or liked most about this show!

More from Leveraging AI

All 330 episodes
326 | 10% chance AI will destroy humanity, Agentic solutions everywhere, 32% GDP growth with over 10% unemployment in 2030, and more important AI news in the week of September 11, 2026Leveraging AI · 55 min
Listen in VO