1. Podcasts
  2. Interconnects
  3. Was I wrong about open models & cyber risks?
Interconnects

30 Oct 2026 · 10m · 4 chapters

Episode artwork

Was I wrong about open models & cyber risks?

In short

Whether “open-weight” AI models meaningfully increase cyber risk, amid a surge of vulnerability disclosures (“Black October”) and major incidents like a Binance crypto hack.

Guests

No guests are mentioned; it’s a solo episode with references to others’ public statements.

Key claims

The host argues earlier “open models = cyber weapon/disaster” predictions were exaggerated. Even if Claude Mythos weights had been accidentally released, risk would likely accelerate rather than cause a step-change. Cyber harm is driven more by ecosystem vulnerability growth and attacker incentives than by open vs closed models.

Notable examples

PHP to Shell, a long-standing GitLab bug, Epac.ai using GLM 5.3 to chain a Firefox exploit into file exfiltration via a malicious website, and quotes from Rob Wiblin, Anthropic’s Glasswing blog, and De Gevi.

Written by AI. May contain mistakes.

Chapters

0:45

Black October and Cyber Vulnerabilities

Discussion of recent cyber vulnerabilities and their implications for society.

“The Wall Street Journal reported the cyber first responders are strained, which seems like the system working.”
2:34

Reflection on Open Weight Models

Exploration of the implications of open weight AI models in cybersecurity.

“This was distinctly my impression, having lived through the online discourse.”
4:33

Predictions and Concerns about Future Cybersecurity

Analysis of potential future scenarios in cybersecurity and AI's role.

“For example, Epac.ai recently published a nice post on their internal work using GLM 5.3 to try and find vulnerabilities and chain them into what could be an attack.”
7:15

Ecosystem Perspective on Cyber Attacks

Discussion on the broader ecosystem impacts of cyber attacks beyond AI models.

“actors exploiting this area are actors who MO is exploiting things isn't a coincidence.”
A man walking through an airport, asking his phone a question

Ask about this episode

Get the gist, explore an idea or ask about something said.

Claude

On Interconnects, what are the key points of this episode?

Searching your listening

Transcript

Automatic transcript. May contain errors.

0:00Was I wrong about open models and cyber risks was published on Friday, October 30, 2026. Last week coined the term Black October after an onslaught of critical vulnerability disclosures, including PHP to Shell and a long-standing GitLab bug, signified the moment when the cyber risks of AI models started to materialize. It seemed like the news cycle had stalled a bit when I started writing this, but then there was the news about another major crypto security incident at Binance. The crypto industry has a very long history of hacks, so it's not the best industry to indicate vulnerabilities translating into new societal harm.

0:35Still, we are very much living through the implications of this movement. The best guess for what is happening in the cybersecurity space is that the behind-the-scenes work has only accelerated, bringing more people and resources in to try to patch the internet. The Wall Street Journal reported the cyber first responders are strained, which seems like the system working. We're living through this plot of an exponential rise in vulnerabilities, which will take a long time to level off at the top of the sigmoid. Click through to see the image of the critical vulnerabilities disclosure tracker. A few weeks ago, before the rapid acceleration in vulnerability disclosures and the uptick in reported hacks, I wrote the following take.

1:15It's been getting a pretty consistent barrage of feedback, some hopeless dunk attempts, and some reasonable discussion. So on to unpack where I stand. Quote, open weight Mythos in April would have been fine. When Claude Mythos was announced, it was previewed as if it was a new class of cyber weapon. where if it ended up in the wrong hands, it would have caused mass societal destabilization. It seems like this was wrong. By all measures, GLM 5.3 is the model that crosses that threshold of capability, and there's little public evidence that much has changed, and we're over a month out of the model weight release.

1:51In fact, I would go further. If Claude Mythos was accidentally released as open weight, it seems like the world would have been more or less fine. Yes, there would be a clear increase in cybersecurity incidents, and it would be bad for a society if the model leaked, but it would be a scenario that looks more like an acceleration than a step change in risk. The leading proponents of this new wave of open-weight fear-mongering have effectively been making a falsifiable prediction, that the current open-weight models are going to cause substantial, not-seen-before-AI harms by crippling our cyber infrastructure.

2:23Based on all the evidence I have, which I've unpacked above, they're set up to be wrong. At least now, after so many years of debating open-weight risks, we will start to get some real answers. End quote. To start the reflection, I wanted to do more due diligence and track down some receipts on the claims I made that the AI safety community was reacting as if open-weight mythos would be an actual disaster, not just a painful headache. This was distinctly my impression, having lived through the online discourse. I've gotten criticism that the frontier AI community never said it would be a quote true disaster, but regardless of exactly what they said, it is always about how people hear and internalize your information.

3:02Here are some examples of the sort of language that I felt was too exaggerated and from prominent people, which spilled into the public and more importantly the federal government perspective that this was a cyber weapon include. Rob Wiblin, host of the 80 ,000 Hours podcast, on his own podcast, quote, if it fell into the hands of criminals or hostile state cyber actors, it would be an actual disaster. Anthropic themselves, in the Project Glasswing announcement blog, quote, given the rate of AI progress, it will not be long before such capabilities proliferate, potentially beyond actors who are committed to deploying them safely.

3:39The fallout for economics, public safety, and national security could be severe, end quote. For one that is actually more reasonable, to illustrate the fine lines between correct and exaggerated from De Gevi, who I don't agree with on a ton of things. Quote, Claude Mythos would give the attackers a cornucopia of zero-day exploits for essentially all the software on earth. It would be chaos. End quote. To date, this chaos has been confined to those running large-scale digital products, which is good, but could change. I largely still stand by my above writing a few weeks ago, but I'm nervous about it.

4:13I'm not a cyber expert, I'm working hard to make the most educated predictions I can. It's a fine line between all of our tech companies need to work extra hard to keep us secure and public infrastructure is actually going down. It is very clear as of writing this that there are way more critical vulnerabilities which are being found in popular tools and fixes are being built. For example, Epac.ai recently published a nice post on their internal work using GLM 5.3 to try and find vulnerabilities and chain them into what could be an attack. The actual exploit they found in Firefox is a good example of why cyber risk needs multiple things to align for harm to be done.

4:49Quote, we use GLM 5.3 to create a website that simply when visiting a Firefox user, simply when visited by a Firefox user and without further interaction, gave the attacker the ability to exfiltrate files from the user's computer. End quote. Here the exploit is in Firefox and A would-be hacker needs to plant a website that is looking for this exploit. This is doable and could have serious consequences, but just finding the exploit is only one step in a multi-stage process. In the previous post, I should have been more specific on what fine is for the future of cybersecurity, and in this case, it means giving more credit to some of the AI safety community that discussed this reasonably as a new era in cyber instability.

5:33Reflecting on it, I'm not sure that fine is the right word to describe what is inevitably coming. A forced industry update to a new way of working with software, which will clearly be expensive and accompanied by some hard work. If you're already somber about the challenges coming from AI, I think fine is actually very suitable. If you don't price in a period of turbulence, fine undersells. I've written many times that I am in the former, difficulty will come, group. But I think humans are good at muddling through problems and patching immediate concerns. What my view was closer or two is that open models are providing balance in the offense-defense equation, and that mythos coming sooner wouldn't have massively upended this.

6:13I suspect most of these companies would be faster to adopt open-weight models than attackers, as most attackers are lower resourced than these companies. A key needle we're watching is the balance on how willing attackers are to cause physical harm within the U.S. and its allies. For now, while our adversaries are likely have likely used these models and exploits to extract information en masse in a clandestine way, it is not clear if there is a party who will cause mass harm by pushing the full force of these models at public institutions. I thought this tweet was a funny way to summarize some of the personnel motive gaps in hacking.

6:51Quote, life is a lot easier once you stop seeing threat actors as hackers who want to break into systems by any means possible and start seeing them as businesses with well-defined business processes. A bakery isn't going to start making dog food because there's a dog food shortage. Click fix and phishing attack actors aren't going to drop everything to vibe code exploits just because a critical CVE came out. The fact that the only actors exploiting this area are actors who MO is exploiting things isn't a coincidence. It's entirely predictable if you understand threat actor behavior, end quote.

7:24Where I sit, I expect most of these vulnerabilities are being found by closed models, and I have very high error bars on this prediction. A lot hinges on how open models are actually being used in the near term. Today, open models are expensive to serve and the compute to serve the largest models is extremely sold out. In the long term, I am very confident that margins and prices on open models will be driven down, as computing supply grows abundant. But in the near term, the closed models are definitely more price effective. Many of my positions are making sure that we get to this future, as otherwise a few companies are building the tools that produce some of software with vulnerabilities and also selling the tools to fix said software.

8:04For now, we're working through the backlog of cyber vulnerabilities as we transition from the human-focused internet to closed silos of human activity mediated by agents. All of this, I think, is way more about AI's capabilities and diffusion generally than anything about open versus closed models. In fact, I feel like in reading more cybersecurity-oriented discourse that they focus much more on the ecosystem perspective, how the rate of exploits and overall damages from cyber has been growing since long before ChatGPT, and how these recent events are on trend. It's just that trend line was exponential.

8:40An example plot of this trend is below from Joshua Sachs. These are the sort of ecosystem-level plots which can be very clear if AI's capabilities and diffusion is the bottleneck on cyber attacks. Click through to see a plot which shows a steady increase in cyber damages over time, with a small attribution to AI. When talking to people who are close to the AI community, especially AI safety, I find a lot of effort going into figuring out if open models are to blame, which we still have extremely low evidence for. Closed models have played a very heavy part in recent hacks, at least more than open models have.

9:16Cyber is a really societal problem, one which AI companies cannot solve alone. Effort needs to be spent at this higher level of abstraction. This is the first of many risks and transitions we'll need to manage with AI, none of which can be easily solved solely by the San Francisco-centric tech industry. Thanks to Seb Cryer for feedback on this post, and have a great day. If you're interested in sharing interconnects with your team, I offer tiered discounts for group subscriptions. Please reach out and email me if you are interested.

From the publisher

Last week coined the term “Black October“ after an onslaught of critical vulnerability disclosures, including PHP2Shell and a long-standing GitLab bug, signified the moment when the cyber risks of AI models started to materialize. It seemed like the news cycle had stabilized a bit when I started writing this, but then there was news about another major crypto security incident at Binance. The crypto industry has a very long history of hacks, so it’s not the best industry to indicate vulnerabilities translating into new societal harm. Still, we are very much still living through the implications of this transition.

The best guess for what is happening in the cybersecurity space is that the behind the scenes work has only accelerated, bringing more people and resources in to try and patch the internet — the Wall Street Journal reported that cyber first responders are strained, which seems like the system working. We’re living through this plot of an exponential rise in vulnerabilities, which will take a long time to level off at the top of the sigmoid.

A few weeks ago, before the rapid acceleration in vulnerability disclosures and the uptick in reported hacks, I wrote the following take. It’s been getting a pretty consistent barrage of feedback, some hopeless dunk attempts and some reasonable discussion, so I wanted to unpack where I stand.

Open-weight Mythos in April would’ve been fine?

When Claude Mythos was announced, it was previewed as if it was a new class of cyber weapon, where if it ended up in the wrong hands it would’ve caused mass societal destabilization.

It seems like this was wrong.

By all measures, GLM-5.3 is the model that crosses that threshold of capability, and there’s little public evidence that much has changed, and we’re over a month out of the model weight release.

In fact, I would go further. If Claude Mythos was accidentally released as open-weight, it seems like the world would have been more or less fine. Yes, there would be a clear increase in cybersecurity incidents and it would be bad for society if the model leaked, but it would be a scenario that looks more like an acceleration than a step change in risk.

The leading proponents of this new wave of open-weight fear mongering have effectively been making a falsifiable prediction — that the current open-weight models are going to cause substantial, not seen before AI harms by crippling our cyber infrastructure.

Based on all the evidence I have, which I’ve unpacked above, they’re set up to be wrong. At least now, after so many years of debating open weight risks, we will start to get some real answers.

To start the reflection, I wanted to do more due diligence and track down some receipts on the claim that the AI safety community was reacting as if open-weight Mythos would be an actual disaster, and not just a painful headache. This was distinctly my impression having lived through the online discourse. I’ve gotten criticism that the frontier AI community never said it would be a “true disaster,” but regardless of exactly what they said, it is always about how people hear and internalize your information.

Here are some examples of the sort of language that I felt was too exaggerated and from prominent people, which spilled into the public and more importantly federal government perspective that this was a cyber weapon include:

* Rob Wiblin, host of the 80,000 hours podcast, on his own podcast (April 10, 2026): “If it fell into the hands of criminals or hostile state cyber actors, it would be an actual disaster.”

* Anthropic, in the Project Glasswing announcement blog (April 7, 2026): “Given the rate of AI progress, it will not be long before such capabilities proliferate, potentially beyond actors who are committed to deploying them safely. The fallout—for economies, public safety, and national security—could be severe.”

For one that is actually more reasonable, to illustrate the fine lines between correct and exaggerated, from Zvi Mowshowitz (who I don’t agree with a ton of things on) on April 9, 2026: “Claude Mythos would give attackers a cornucopia of zero-day exploits for essentially all the software on Earth … It would be chaos.” To date, this chaos has been confined to those running large-scale digital products, which is good, but could change.

I largely still stand by my above writing a few weeks ago, but I’m nervous about it. I’m not a cyber expert, I’m working hard to make the most educated predictions I can. It’s a fine line between “all of our tech companies need to work extra hard to keep us secure” and “public infrastructure is actually going down.” It is very clear as of writing this that there are way more critical vulnerabilities which are being found in popular tools and fixes are being built.

For example, Epoch AI recently published a nice post on their internal work using GLM-5.3 to try and find vulnerabilities and chain them into what could be an attack. The actual exploit they found in Firefox is a good example of why cyber risks need multiple things to align for harm to be done:

We used GLM 5.3 to create a website that, simply when visited by a Firefox user and without further interaction, gave the attacker the ability to exfiltrate files from the user’s computer.

Here, the exploit is in Firefox, and a would-be hacker needs to plant a website that is looking for this exploit. This is doable, and could have serious consequences, but just finding the exploit is only one step in a multi-stage process.

In the previous post, I should’ve been more specific on what “fine” is for a future of cybersecurity, and in this case it means giving more credit to some of the AI safety community that discussed this reasonably as a new era in cyber instability. Reflecting on it, I’m not sure fine is the right word to describe what is inevitably coming – a forced industry update to a new way of working with software, which will clearly be expensive and accompanied by some hard work. If you’re already somber about the challenges coming from AI, I think fine is actually very suitable. If you didn’t price in a period of turbulence, fine undersells. I’ve written many times that I am in the former, difficulty will come, group — but I think humans are good at muddling through problems and patching immediate concerns.

What my view was closer to is that open models are providing balance in the offense-defense equation, and that Mythos coming sooner wouldn’t have massively upended this. I suspect most of these companies would be faster to adopt open-weight models than attackers, as most attackers are lower resourced than these companies. A key needle we’re watching the balance on is how willing attackers are to cause physical harm within the U.S. or its allies. For now, while our adversaries have likely used these models and exploits to extract information en-masse in a clandestine way, it is not clear if there is a party who will cause mass harm by pushing the full force of these models at public institutions.

I thought this Tweet was a funny way to summarize some of the personnel / motive gaps in hacking:

Life is a lot easier once you stop seeing threat actors as hackers who want to break into systems by any means possible, and start seeing them as businesses with well defined business processes. A bakery isn’t going to start making dog food because there’s a dog food shortage. ClickFix and Phishing actors aren’t going to drop everything to vibecode exploits just because a critical CVE came out.The fact that the only actors exploiting this are the actors whose MO is exploiting things... isn’t a coincidence. It’s entirely predictable if you understand threat actor behavior.

Interconnects AI is a reader-supported publication. Consider becoming a subscriber.

Where I sit, I expect most of these vulnerabilities are being found by closed models, but I have very high error bars on this prediction. A lot hinges on how open models are actually being used in the near term. Today, open models are expensive to serve…



This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit www.interconnects.ai/subscribe