1. Podcasts
  2. Odd Lots
  3. PHP2Shell Won't Be the Last Big AI Cybersecurity Risk
Odd Lots

30 Oct 2026 · 49m · 24 chapters

Episode artwork

PHP2Shell Won't Be the Last Big AI Cybersecurity Risk

In short

“Black October” cybersecurity concerns, focused on AI-accelerated discovery and exploitation of old vulnerabilities—especially a PHP flaw (“PHP to Shell”) that affects a large share of websites. Guests argue AI is currently making attacks faster than defenses, shrinking the time between patch and exploit (“minus-one day” window), and making enterprise incident response harder (e.g., many simultaneous intrusions).

Guest backgrounds

Tai Yun, CEO of Calif; former Microsoft Security Response Center (worked on Stuxnet reverse engineering), later Apple iOS security, then 12 years at Google on cryptography and hacking products before founding Calif. Bruce Dang, engineer at Calif; long-time security hacker/engineer focused on exploit development and cryptographic/protocol weaknesses.

Key claims

AI speeds vulnerability exploitation from months to days; defenders can fall behind; “fix the sandbox/model” is insufficient due to incentives and the need for AI agents that can code/control computers; provably secure software is hard at browser scale.

Notable examples

Stuxnet reverse engineering; breaking SSL 3.0 and compression/encryption side-channel issues; Calif’s OpenAI “Pass the Planet” work with PHP Foundation; PHP Foundation previously didn’t fix due to exploit uncertainty; OpenAI/Hugging Face incident with ~100 compromised points; banking clients hacked where AI spread “like cancer” within days.

Written by AI. May contain mistakes.

Chapters

0:30

SpaceX Hiring Practices

Discussion on SpaceX's unique hiring practices and company culture.

“Getting hired at SpaceX requires exceptional ability and may include having Elon Musk review a candidate's resume.”
2:51

Cybersecurity and AI Discussion

Exploration of recent cybersecurity vulnerabilities and the role of AI.

“But the really interesting thing about this vulnerability being uncovered is AI was used to uncover it.”
4:40

Guest Introduction and Background

Introduction of guests Tai Yun and Bruce Dang, discussing their backgrounds.

“There are hackers out there right now taking notes going, Joe doesn't know anything about cybersecurity, probably doesn't have a VPN.”
7:15

Exploring Hacking Achievements

Tai Yun shares significant experiences from his hacking career.

“And that would be the information would travel through many, many other servers like your ISP, your Wi-Fi routers.”
10:04

Impact of AI on Cybersecurity Risks

Discussion on how AI affects cybersecurity vulnerabilities and risks.

“And then three years later, we found out it's wrong.”
14:00

AI and Cybersecurity Risks

Explore how AI impacts the identification and exploitation of cybersecurity vulnerabilities.

“But before we do that, you know, both of you have had long careers that by and large predate what we now call AI.”
16:42

Discovering the PHP Vulnerability

Discuss the joint project uncovering the PHP vulnerability and the process involved.

“To get hired, candidates must demonstrate their achievements from past jobs, and hands-on experience matters more to recruiters than advanced degrees, with the company looking for people with raw, innate intelligence.”
18:08

Discovering the PHP Vulnerability

Discuss the joint project uncovering the PHP vulnerability and the process involved.

“Why don't we talk about discovering the PHP vulnerability then?”
18:23

PHP Foundation and Historical Context

Delve into the historical context of PHP vulnerabilities and the foundation's response.

“I know you guys have gotten a little bit of pushback about publicizing it before it was fixed.”
22:08

Exploitation of Vulnerabilities

Examine how AI aids in the exploitation of vulnerabilities in legacy systems.

“But they didn't fix it because when they found it, they discovered that the fix is very expensive.”
Show all 24 chapters
23:36

Philosophical Insights on Cybersecurity

Engage in a philosophical discussion about the balance between offensive and defensive cybersecurity.

“We think like that's probably the right way to think about it.”
27:48

Technical Debt in Cybersecurity

Discuss the concept of technical debt in cybersecurity and its implications.

“Is the general idea that we're just in this sort of awkward phase where a lot of people in cybersecurity always refer to technical debt, right?”
28:00

Exploring Technical Debt in AI

Learn how technical debt affects software security vulnerabilities.

“This idea that you haven't upgraded a system for ages like the PHP vulnerability we were just discussing.”
28:31

Surprises in Vulnerability Discovery

Discover unexpected findings regarding security vulnerabilities in systems.

“You know, we found that there are a system that we thought that, okay, that don't have a lot of technical debt.”
29:28

Anxiety over Browser Security

Understand the challenges in achieving browser security in a complex environment.

“not the norms so that's actually a big surprise because I don't think anybody was surprised to find a critical vulnerability in PHP because PHP wasn't known for like race security.”
31:20

The Dilemma of Software Change

Explore the difficulties of maintaining security while allowing software changes.

“maybe in the same way that mathematicians produce things and this thing called lean or whatever.”
36:38

Evolving Business Needs

Find out how Comcast Business supports the changing landscape of business.

“The world of business is constantly evolving.”
37:26

The Changing Landscape of Vulnerability Management

Understand how AI is changing the way vulnerabilities are discovered and fixed.

“When you add it all up, no one does business like Comcast business.”
40:57

The Complexity of Cybersecurity Solutions

Delve into why simplistic solutions in cybersecurity often fail.

“that I thought there's, or that I perceived.”
42:04

Complexities of Cybersecurity Solutions

Explore the misconceptions around simple cybersecurity solutions and the inherent complexities involved.

“People think that, you know, maybe people are not in security.”
44:45

The Evolution of Hacking with AI

Discuss how AI has transformed hacking practices and the implications for security.

“So actually on this note, I'm curious, Can you just talk about what it's like being a hacker in the age of AI versus, say, even three or four years ago, right?”
46:11

Real-World AI Hacking Incidents

Examine recent incidents where AI has been used to hack systems, highlighting the speed and scale of attacks.

“Something that we have people that, let's say, for example, we've been hacking the iPhone.”
48:57

The Centaur Hacker Era

Analyze the current state of hacking which combines AI and human expertise and its potential future.

“Because how could you defend against that?”
51:42

Closing Thoughts on AI and Hacking

Reflect on the implications of AI in hacking and the need for a balanced perspective.

“And we want to find out what can we cook with AI and how can we do it in a safe way that helps everybody.”
A man walking through an airport, asking his phone a question

Ask about this episode

Get the gist, explore an idea or ask about something said.

Claude

On Odd Lots, what are the key points of this episode?

Searching your listening

Transcript

Automatic transcript. May contain errors.

0:00There are some market stories where you want every detail. Joe and I have made quite a few podcasts on that basis, but sometimes you've only got 10 minutes and just want to know what's moving markets fast. That's the Barclays Brief podcast. Every week, experts from Barclays Markets and Research get you up to speed on what's happening and what to watch next. Concise, focused, and brief. Search Barclays Brief wherever you get your podcasts. This is the Bloomberg Tech Minute brought to you by Chachi PT. I'm Carol Masser. Getting hired at SpaceX requires exceptional ability and may include having Elon Musk review a candidate's resume.

0:38So writes Bloomberg Businessweek's Lauren Grush. She reports that the company culture is defined by Musk and job candidates must understand that a commitment to SpaceX means adhering to this culture and exhibiting loyalty to Elon Musk. To get hired, candidates must demonstrate their achievements from past jobs, and hands-on experience matters more to recruiters than advanced degrees, with the company looking for people with raw, innate intelligence. A spokesperson for SpaceX didn't respond to a request for comment on its recruiting and hiring practices. But according to recruiters, advisors, and those who've interviewed for jobs there, it's the space exploration dream that draws people to the company.

1:17And Musk invokes that dream regularly to remind workers why they're there. Prospective hires are told that the job will require stamina, including in job ads that candidates, quote, must be willing to work extended hours and weekends as needed. One major perk for all that hard work? Employees' access to equity, either the right to buy shares or payment in the form of restricted stock units that vest over time. That's the Bloomberg Tech Minute brought to you by ChachiPT. Get started at ChachiPT.com. For big business, AI opened up a world of promise, but that world of promise turned into a world of pain.

1:55Costs spiraling, data trapped, security and governance risks multiplying, and ROI out of reach. That's why enterprises turn to Boomi to connect data, apps, and AI, helping them operate securely, efficiently, and at scale. Boomi turns a world of AI pain into a world of AI gain. As Boomi says, we got you. Head to boomi.com. That's B-O-O-M-I dot com. Bloomberg Audio Studios. Podcasts. Radio. News.

2:39Hello and welcome to another episode of the Oddbots podcast. I'm Tracy Allaway. And I'm Joe Weisenthal. Joe, it's October. We're recording this on October 29th. Yeah. It is also Black October. Have you heard this term? Yeah. What does that mean? If stocks going down? No. Your mind immediately goes to markets. There are other worlds out there. We're going to be talking about the world of cybersecurity today because one of the reasons people are talking about Black October is we've had a number of recent security issues, the most prominent of which has been a bunch of vulnerabilities discovered in PHP, which is a coding language that apparently is used by 70 % of websites in existence.

3:19We can get into that stat later. But the really interesting thing about this vulnerability being uncovered is AI was used to uncover it. And so the big question coming back to AI, you know, there's a concern now that you have good actors who are maybe using AI to discover old vulnerabilities and trying to fix them. But you could also have bad actors who are using AI to exploit those same vulnerabilities. So we're back to the question of whether AI makes the internet safer or more dangerous. It makes it more dangerous. No, I have no idea. Ever since essentially Anthropic announced that they had this model called Mythos and now it's Project glass wing, in which it was rolled out to companies to use for defensive purposes before it was available to the general public, there has been much more awareness of cybersecurity issues as it relates to AI.

4:11And there are many things that people debate about AI and some of these bigger existential questions. Pretty much everyone agrees cybersecurity good, more cybersecurity good. I will say I know very little about the world of cybersecurity. I don't know what, for example, while a cybersecurity company actually sells. I don't know how if I were buying cybersecurity, I would know whether it's working or whether no one had tried to hack me or not or something like that. I need to learn a lot more, but it's absolutely true about the uptick in the volume of hacks. There are hackers out there right now taking notes going, Joe doesn't know anything about cybersecurity, probably doesn't have a VPN.

4:47I don't. That's one of my vibe coding projects. I don't want to ever, I have yet to build anything with an account because I don't want to like have to think about that. So it's just like I don't want to count information with anyone. But I have as a user of technical products over the last several weeks, you get more emails saying like our thing was compromised. You're probably fine, but maybe you should refresh some keys or whatever. This is happening. This is real. And everyone really needs to learn more. And if you think about like black swans and Wall Street and all that stuff, you know, there's been for years a lot of talk about cyber as a major risk out there.

5:24Yeah. All right. Well, we do, in fact, have the perfect guest. We're going to be speaking to two people from the company Calif, one of the companies that actually uncovered this PHP vulnerability. The other one was a company called Wiz. We have Tai Yun. He is the CEO over at Calif, which is a hacking firm. And we can get into exactly what that means, as well as Bruce Dang. He is an engineer at Calif as well. So, Tai and Bruce, thank you so much for coming on All Thoughts. I'm glad to be here. So just to begin with, because, you know, hackers kind of, they always have cool achievements that they like to talk about.

5:59Why don't we just go ahead and start with who you are and what are the coolest things you've done in your hacking career? Yeah. So I started my career at Microsoft like almost 20 years ago in the Microsoft Security Response Center. There's the people that do Patch Tuesdays, you know, like on the second Tuesday of every month, Microsoft released an update. So I worked in that team a long time ago. Probably the biggest thing I did there that I could talk about is I helped reverse engineer the Stuxnet virus, which is one of the ones that was related to the supposedly the Iranian nuclear program used to sabotage the Iranian nuclear program.

6:39This is the thing that people describe it as the world's first like known digital cyber weapon, right? Yeah, yeah, yeah, yeah. I'm sure there were many others before, but yeah, that's the first public one. I worked there for almost a decade. And then I left to do a startup with my friends. And then I joined Apple. I worked on iOS security. And then Ty managed to convince me to follow the church of AI. And so here I am. Yeah, it took me four years to convince bros. So, you know, when you go to a website or you go to Amazon, even Facebook, Instagram, your computer will share information with the server, right?

7:27Yeah. And that would be the information would travel through many, many other servers like your ISP, your Wi-Fi routers. So you want to encrypt that information to make sure that only the server can see your data, nobody else. and there's a mechanism for that. It's called the SSL protocol or the later version is called like TOS, like Transport Layer Security Protocol. So I love those protocols and back in the day, together with friends, we found a bunch of ways to break the protocols, you know, to decrypt the data and it's pretty cool. It's actually changed the internet, how the internet works because we basically show that in the past, there are like two protocols, like SSL version 3.0, that was invented by Nescape.

8:23You know, you remember Nescape? Yeah, yeah. 30 years ago. And then people still use it because it's still working somewhat. But we show that, oh, it's not working very correctly. If you use SSL 3.0, then people can decrypt your data. So we help the internet really, really remove SSL 3.0. And that's one thing. The other thing that I really enjoy doing was, you know, people think that in the past you have compression, you have some data and you want to compress the data and you have encryption. And both of them actually randomize your data in some way. If you look at a zip file, you open a zip file, look at the raw binaries, buy data in the zip file, look random to you.

9:11Because all the redundant information has been removed and encoded in a way to reduce the size of the file. And so one of the basic questions in computer security was, would you compress data and then you encrypt or you encrypt then compress? And I took some crypto class at Stanford University and I remember my professor, he asked this question in one of the homework assignments and the obvious answer back then was you don't want to compress and then you don't want to encrypt and compress because encryption randomize you later. It means that compression would be less effective. So the right answer is you compress and then you encrypt.

10:00And that was the correct answer on my homework assignment. I think I took that class in 2011. And then three years later, we found out it's wrong. If you do that, then people can actually decrypt your data. And the way it works is pretty cool. I can explain to you. So compression actually reveals... If you look at a compressed file, you know how well it is compressed, right? Because it's shorter. If it's smaller, the compression is very good because there's a lot of redundant information. That's why compression works well. It means that if you look at a compression alone, the size of the compression, a compressed file, you can tell whether the file has a lot of redundant information.

10:45And encryption hides the length. So it doesn't hide the size of the encrypted data. When you encrypt the message, you can still see that this message is maybe this long or this message may be this long. Right. Because encryption doesn't try to hide that. Yeah. There's some people try to do that. So it means that if you compress and then you encrypt, it means that I can see whether your message has some redundant information, has a lot of redundant information. And that alone is a leakage already, right, that you don't want to review. And I give you an example. Like, let's say that you take a message, like a random message that I give you, and then you put your password together with that message.

11:29Let's just say that there's a reason for you to do that. You put your password together with the message I give you and you compress together. And then you encrypt it with a key that I don't know. And you reveal the ciphertext, the result, encrypt the message to me. So supposedly I don't have the key. I shouldn't be able to read the message, right? But because I give you a message and you get my message put together with your password, you compress together. If the compression works very well, Then I know whether my message has some redundancy with your password. You can reverse engineer between the two relationships.

12:11Yeah, exactly. And you do that repeatedly. Eventually, we can recover your password. And that's exactly what we found on these web encryption protocol. In the past, that's exactly what they did. They take my data. They concatenate your password. they encrypt together they compress together and then they send over the wire and then as an attacker i can see the the length and that's enough for me to decrypt and that's the solution was really interesting because they decided to turn off like compression there's no solution and then eventually i was at google back then i was born in saigon vietnam i grew up there Then I got a job in Mountain View for a consultancy, like what we do.

13:04So I moved to Mountain View in 2011, and then I joined Google later that year. And I did cryptography at Google, basically help people do cryptography correctly, like try to avoid the mistakes that we found. I was there for 12 years. I work on very large number of products. Google has lots of products, right? Gmail, Chrome browser that we are using right now. And there's a lot of people out there that want to hack Google and our products. So my job was to hack these products before we released them to the public. And I was there for 12 years and then I left to create Caliph. And yeah. That's fantastic.

13:52I'm already fascinated by this conversation. I want to get into obviously what Califf does specifically. I want to get into some of the latest vulnerabilities. But before we do that, you know, both of you have had long careers that by and large predate what we now call AI. Are the risks associated with AI a sort of continuation on some path that cyber security have well understood, or are we in a truly novel area for how we should be thinking about cybersecurity risk? I think it's a combination of the two. We've always known that there are security vulnerabilities in systems. And so we have security engineers who are hackers who try to find and exploit these vulnerabilities.

14:42So the system has always been vulnerable to some degree, to a varying degree. What AI has done is it's kind of accelerated the speed in which you identify and exploit these vulnerabilities to a level where it's almost like superhuman. You know, like 20 years ago, Microsoft would release, let's say, maybe 20 updates every month. Now you're looking at like, you know, 1 ,400 updates per month. Wow. You know, and then that number is going to continue to grow. It's just to give you an idea of like the scale of things. And now, for example, to hack certain systems, it may take you, let's say, three months with lots of people.

15:22Now, that may take you a few days with just one person and a very capable AI model. That's the reality we're in today. It even changed the way how attackers hack certain types of systems, like the banking sector that our customers are in. You can tell some stories about that time. That's kind of what I think. I think the systems have always been vulnerable to some degree. And now the AI just accelerates that and makes it much more visible. And it's also made it easier for people to identify these vulnerabilities as well. And obviously there are pros and cons to that. But yeah, we'll go into that later.

16:19There are some market stories where you want every detail. Joe and I have made quite a few podcasts on that basis, but sometimes you've only got 10 minutes and just want to know what's moving markets fast. That's the Barclays Brief podcast. Every week, experts from Barclays Markets and Research get you up to speed on what's happening and what to watch next. Concise, focused, and brief. Search Barclays Brief wherever you get your podcasts.

17:11To get hired, candidates must demonstrate their achievements from past jobs, and hands-on experience matters more to recruiters than advanced degrees, with the company looking for people with raw, innate intelligence. A spokesperson for SpaceX didn't respond to a request for comment on its recruiting and hiring practices. But according to recruiters, advisors, and those who've interviewed for jobs there, it's the space exploration dream that draws people to the company. And Musk invokes that dream regularly to remind workers why they're there. Prospective hires are told that the job will require stamina, including in job ads that candidates, quote, must be willing to work extended hours and weekends as needed.

17:52One major perk for all that hard work? Employees' access to equity, either the right to buy shares or payment in the form of restricted stock units that vest over time. That's the Bloomberg Tech Minute brought to you by ChachiPT. Get started at ChachiPT.com. Why don't we talk about discovering the PHP vulnerability then? Because I think this was a joint project between Calif, Wiz, and I think it was OpenAI. How did you find this? What was the process? And then what was the decision? I know you guys have gotten a little bit of pushback about publicizing it before it was fixed. So what was the process of actually, you know, putting out the statement saying we found this thing?

18:35We're really interested in, like, finding vulnerabilities that have a wide impact. And we want to understand these vulnerabilities to help inform decisions, like defense decisions, how to fix and how to mitigate them for once and forever. On that background, we joined the OpenAI's Pass the Planet program. This is where OpenAI funds companies like Calif to go out and help open source maintainers to identify and fix, mitigate vulnerabilities in their software. and we have this engineer like Ryan Osteen who is he's like a PHP historian. Yesterday we went to a conference in San Francisco. We basically presented like you know PHP to Shell and Ryan walked everybody over like the 25 years of history of PHP vulnerabilities.

19:38So we have this like engineer Ryan And this is how we work, basically. Our engineer, they're interested in certain things, and then they just go and hack those things. And, you know, ask business people, we try to see, okay, how can we convince some other people to pay us for this work? And that's exactly what we did with OpenAI. We convinced OpenAI, okay, we're going to hack PHP. Can you fund our work? And they said, yes. They gave us tokens and money. And then we go and convince like PHP Foundation, which is the organization behind PHP, that let's work together. You know, we can help you. And it's actually pretty interesting because I mentioned like there like a history of 25 years of like PHP vulnerabilities.

20:25And the person that is behind all of these hacks is like Stephen Escher. He's also at Calif. He joined us, I think, six months ago. Back in the day, he's the PHP security guy. Basically, he hacked and helped, like, hard on PHP. So we didn't know anybody at the PHP Foundation. So we asked Stefan to introduce us. And because, you know, even though Stefan stopped working on PHP security for a while now, his name still rings, you know, very loudly in this circle of the world. I saw the comic that you guys put up about this. It was kind of funny. Yes. He's like an Indiana Jones type character. Yeah.

21:10So he connected us and then we met with Volker Dutch at the PHP Foundation. And yeah, that's how we got started. I think we started in July 30. And then immediately after one or two days, you know, Ryan found the first vulnerability. and he was interested in like finding a similar vulnerability similar to one vulnerability that like Stefan disclosed like 22 years ago. And to his surprise, you know, there's still a bunch of them like that in the PHP, you know, software right now. And so that's how we found it. And then we reported it to the PHP Foundation because we know immediately that is a critical vulnerability that could affect a large part of the internet.

22:04Then the Peace Peace Foundation actually shared with us that they actually found this vulnerability, the same vulnerability, two years ago. But they didn't fix it because when they found it, they discovered that the fix is very expensive. And there's just maybe a few options to fix it and none of them were actually perfect because, you know, they need to change a lot of, like, functionalities within PHP, and those changes may introduce new bugs, new vulnerabilities, or new reliability issue. And people would be very upset if they upgrade, you know, PHP and their website stopped working. so in the end back in like 2024 the php foundation decided not to fix it because there was no exploit no one could manage to show that this is actually a real issue and that's exactly what they asked us they come back they ask like do you have an exploit then the next day we share with them the first exploit that show them that, yeah, someone doesn't need to know anything can hack your website remotely.

23:24So just to be clear, the use of AI in all of this, it wasn't necessarily that important in finding the vulnerability. It was more important in developing an actual exploit for a known issue. We think like that's probably the right way to think about it. But I think even for finding the vulnerability without AI, it would take a lot more time, right? So you can imagine like PHP was created like maybe 30 years ago. So it's a huge code base with a lot of like feature. And as a human engineer, you have to dig into this code base and it will take like months, And along the way, people may give up. But the fact that Bichby Foundation found the bug in 2024 proved that humans can actually find the bugs, right?

24:17And the problem was the exploitation, like you said. And for exploitation, AI plays a major role in it. It becomes an engineering problem where our engineers would tell AI, this is how I want to design our exploit. And you go and do it. And then, you know, prove to us that it works correctly. Yeah. Let me ask a philosophical question. Is there a reason to believe that defensive cybersecurity can stay ahead of offensive cybersecurity? Just generally, then we can get into some details. But philosophically, like, is that something that we can reasonably hope for? I think so. Yes. How come? Because you can use the AI to build certain types of systems in ways that may be very challenging for attackers to exploit.

25:14Today, you can use AI to build whatever systems you want very quickly. You can experiment and get feedback very quickly. It can also process data very, very quickly and reason about that data. And so I think it is possible. I think it may not be immediate, but over time, we're going to perhaps use AI to help us write more secure software or build more secure systems. And eventually, I think that should counterbalance the advantages that the attackers have. Perhaps I'm being optimistic, but I do foresee this happening. I can add something there. So if you look at the history of humanity, our history is the history of weaponized our toons, right?

26:07If you find a powerful toon, then someone would find a way to use that toon as a weapon. And attackers always are early adopters of tools, right? New technology. Defenders move at a much slower pace than attackers. But fundamentally, we believe there are more good guys than bad guys out there. And eventually, you know, the good guys would catch up and build things that help everybody defense, fend off the bad guys. And I don't think like in general, cybersecurity, if you see the news all the time, you see like we got like data breach every day almost, even before AI. So you may feel like it's not working at all.

26:59But if you're in the field, you can see the progress, right? In the past like 25 years, there's a tremendous progress in cybersecurity. Of course, people still got hacked because this is difficult. Imagine you have a very complex system. Imagine you have a house with lots of doors, lots of ways to get in, and cybersecurity must make sure that everything is safe. At the same time, your house or your office must remain open for business. So it's actually a pretty difficult problem. At the same time, without the progress that the industry met in the past 25 years, things could be much worse, right?

27:39And I think the same thing would be happening here. It's going to take a while for defenders to catch up. Right now, you know, AI helps attackers more than defenders. Is the general idea that we're just in this sort of awkward phase where a lot of people in cybersecurity always refer to technical debt, right? This idea that you haven't upgraded a system for ages like the PHP vulnerability we were just discussing. And so now you have to pay back that technical debt. But the idea that we're just in an awkward moment where AI is going to be able to exploit existing flaws in the system, but maybe we eventually move to a place where we upgrade the entire system.

28:24We reduce our outstanding technical debt. We reduce the outstanding technical debt. Exactly. That's an optimistic way to look at it. Okay. You know, we found that there are a system that we thought that, okay, that don't have a lot of technical debt. that turned out that they just like a dumpster fire like everybody else. That was a very big surprise, right, to me personally. Like we know there are places, there are bad problems, and we know that if we just point AI at that thing, there will be a lot of bugs coming out. But there are also places we thought that could be okay because they received a lot of attention over the years already.

29:06but now there's still a lot of bugs there as well and a lot mean like a lot more like 10x more than we expected and of course there are still like a few small places where there was fewer bugs back then before AI now there's still fewer bugs still now but they're like very small like very like they are the exception not the norms so that's actually a big surprise because I don't think anybody was surprised to find a critical vulnerability in PHP because PHP wasn't known for like race security. So of course, at the PHP to shell scale, then that's a different matter. But if you find another vulnerability in PHP today, then that's not a surprise.

29:56But if you go and, you know, find a vulnerability or maybe a hundred vulnerabilities, a thousand vulnerabilities in the Chrome browser for a sample. That's a surprise. And that's exactly what happened. Like people found like a thousand vulnerabilities in Chrome. And, you know, I was at Google and I knew, and then the entire industry like assumed that and knew that, wow, there was a loss of investment in Chrome security. And not just like, you know, remove, like eliminate vulnerabilities, but making sure that even if you have vulnerabilities, it's difficult to exploit these vulnerabilities. This is what we call mitigations.

30:36You accept that you have vulnerabilities, but then you make sure that attackers couldn't use these vulnerabilities to control your computer or your browser. We thought that the defense leaders were pretty good and the rate of vulnerabilities were low. But then after AI, we just discovered that either like we, as security engineers, suck at our job, we couldn't find these things, or they're just like too much code that we didn't have enough time to look into. So this raises another question, like, is it possible to have a provably secure browser or a piece of software, you ship the piece of software and you can prove maybe in the same way that mathematicians produce things and this thing called lean or whatever.

31:31Does cyber have an equivalent where you could say this is provably secure and we know that no matter how good AI gets, it will never find a vulnerability in this piece of software? Oh, man, this is a loaded question, Joe. I thought it was a simple question. Yeah, I don't know, to be honest. You know, like browsers are like, you know, its own operating system, like very, very complex operating systems. And today doing, you know, like formally verified software, you know, like it doesn't work at that scale. It's typically smaller software components. So there is such thing as formal verification when it comes to software.

32:14Yes. So you could have small pieces of software in which you formally prove in the same way that it takes mathematicians seven lines to prove the two plus two equals four. There is some sort of equivalent for software where you can prove these lines of code are secure. But the question is, the scale of even something like a browser is just so enormous, that's a very difficult thing to do. Yes. Yeah. It's something that I think is being researched right now, because I think this is one of the paths forward to build more secure systems. There are, for example, we've had systems where the core of it is formally verified.

32:58It's an operating system that's formally verified, but then there are applications running on these things. And those applications have issues. And so it's complicated. And these are small systems. And you're talking about browser. of browsers like you know many billions lines of code and so that's um yeah i mean i can tell you how big chrome is i mean they have like zillions of people working on it and you know any like lots of people working on chrome security after all these years but uh you know it's but long story is there are such things but uh to make it work on a browser or at a very very large system this is it's um we don't have anything like that today got it i think there's a there's a deeper reason here.

33:42You know, the reason like software is eating the world, you can see like, you know, the top, the biggest companies in the world are software companies, right? It's because software is easy to change. And imagine, you know, that allows like software companies to adapt and to learn much quicker than the rest of the world. You have a product, if it doesn't work, then tomorrow tonight you can change it and that's actually allows the software world you know to become uh to dominate the world basically so basically fundamentally software is easy to change and people want to change it constantly and that's the reason why you know the the tech companies are doing so well so if you ask like okay now let's not change this like frequently then that goes against the interest right yeah and that's not gonna happen so it means that even if you have a way to formalize formally verify everything that would take a lot of time unless you have some sort of ai help you do the formal verification automatically otherwise it's not gonna happen because people want to change their software like as quick as possible because that's how they do business.

35:15This is the Bloomberg Tech Minute brought to you by Chachi PT. I'm Carol Masser. Getting hired at SpaceX requires exceptional ability and may include having Elon Musk review a candidate's resume. So writes Bloomberg Businessweek's Lauren Grush. She reports that the company culture is defined by Musk and job candidates must understand that a commitment to SpaceX means adhering to this culture and exhibiting loyalty to Elon Musk. To get hired, candidates must demonstrate their achievements from past jobs and hands-on experience matters more to recruiters than advanced degrees, with the company looking for people with raw, innate intelligence.

35:53A spokesperson for SpaceX didn't respond to a request for comment on its recruiting and hiring practices. But according to recruiters, advisors, and those who've interviewed for jobs there, it's the space exploration dream that draws people to the company. And Musk invokes that dream regularly to remind workers why they're there. Prospective hires are told that the job will require stamina, including in job ads that candidates, quote, must be willing to work extended hours and weekends as needed. One major perk for all that hard work? Employees' access to equity, either the right to buy shares or payment in the form of restricted stock units that vest over time.

36:30That's the Bloomberg Tech Minute brought to you by ChachiPT. Get started at ChachiPT.com. The world of business is constantly evolving. Every day, new challenges, new opportunities, new ways of working. Comcast Business keeps you totally in step with secure AI-backed networking built to power the way modern business gets things done today in more than 100 countries around the world. That's some serious muscle. And get this, Comcast Business powers over 90 % of the Fortune 500 and millions of small businesses. Behind it all? Network engineers, cybersecurity specialists, support teams, thousands of experts answering your call at 2 a.m.

37:15like it's 2 p.m. Always on, always ready. That's a lot of coffee. One partner powering how business gets done for companies of every size all around the globe. When you add it all up, no one does business like Comcast business. This is sort of a related question, but does AI start to change, I guess, the way or like the waterfall of the way things get fixed. So nowadays, it's like a vulnerability is discovered, the software company issues an alert and a patch, they disclose it, and then people go off and fix it. If exploits are coming faster, does that process start to change in any way? Yeah, it changed a lot.

37:59Basically, back in the day, we have like two kind of vulnerabilities like zero day vulnerabilities that nobody knows about except the person who found it and then um end day vulnerabilities that vulnerabilities have been disclosed and maybe fixed by the vendors and maybe user have upgrade or not but now we also have something we call like minus one day vulnerabilities so these vulnerabilities happen when you know imagine like let's take the PHP want to be an example. Let's say that because PHP Foundation and PHP itself is an open source project, everything happens on GitHub, right? And let's imagine that we reported a bug and PHP fixed the bug publicly on GitHub.

38:51The moment we found a bug and then PHP produced a patch for that bug, that very moment that information became public. Somebody who is watching the PHP repository on GitHub, they could turn that away into an exploit within a few hours. Of course, the vulnerability that we found was more complicated than that. But you can imagine that in principle the window between the passwords being developed It's not ready yet, you know, for anybody. And before it becomes ready for any user to upgrade, there's a window, right? Yeah. In the past, you know, the attacker has to wait until the past becomes available.

39:44And then it would take them a long time to develop and exploit. So user can have a longer time to upgrade. Now that window is collapsing. It is collapsing everywhere, not just in PHP, right? in Windows, in Mac OS, in anything. Because right now, there are people who have like what we call like end-day factory. You know, they're just waiting for patches from Microsoft, from Apple, from important critical software. Like I'm sure tens of people are watching PHP today. After what happened, they're watching PHP, Python, Java, all of those important languages. and if there is any sign of like, oh, there's a new vulnerability, they're going to like, you know, their AI would go pro and then, you know, bonding tokens to identify that vulnerability produces, be an exploit for it.

40:45So that changed the practice, right? Yeah. I'm curious what you thought after the Hugging Face incident because after that moment, there were sort of two schools of thought that I thought there's, or that I perceived. There's one that was like AI creature, there was this sort of, I guess maybe the anthropomorphization view, AI creatures, they want to escape their cages, they're devious, they're tricksters, they want to show, come up with a way to cheat on the right answers, but cheat on the way that the greater, you know, all these stories. And then there are other people that were just like, guys, build a stronger sandbox.

41:24Stop talking about all this stuff. Just build a stronger sandbox. Jensen Wong is kind of in that category. I loved his interview with Ezra Klein, where he was basically like, what's your problem? Just make models that don't hack. He's like, just don't ship it. Fix your model. Don't let them hack. And I love that because it's just like, just fix it. And the AI people are like, no, no, no, we can't. You don't understand. We haven't solved alignment. It's very tricky. And he's like, just don't, just make, just fix the model. And I'm sort of curious as people who have come out of the traditional cyber world, but are now in the AI world.

41:57Where do you land on this question? Can you just like, guys, just fix the sandbox, or is there something deeper here? I don't think that it's simple to fix the sandbox. That's the problem. People think that, you know, maybe people are not in security. They think that there's a simple solution to cybersecurity. Just do this thing and you're safe. And that's how we have so many problems, you know. Vendors go out and tell people, just buy this box, this magic box. and put it in your network and you'll be safe. No, it's not like that. Even that box has problems. If you look into like, there's a famous idea in security, like product security is not the same as security product.

42:38Like security products may not have product security. Even like the firewalls that you buy, they may have problems. And they do. And what I mean here is, so what we found, like the hugging face and open AI, incident was fascinating, right, to watch. And it's difficult. Enterprise security is very difficult. Anybody saying like, oh, just buy this thing, just do that thing, you're going to be safe. No, it's just like very complicated. And the reason is like, and then people say, oh, just fix the model. And that's a comeback to the incentive. Just fix the model, just make one that doesn't hack. That comes back to the incentive again.

43:19And because if you look at like how AI companies, And Jensen must be careful here, right? Because if AI companies are not making money, he's not making money as well. Yeah, of course. And the AI companies, they're making money by selling tokens. And most of the tokens are used for coding today, like programming, building things, right? And if you want to be really good at coding, you need an agent on AI that understands code, understands technical problems, can debug things, can control computers. But that's basically the definition of a hacker. So you cannot really escape this. You cannot have a cake and eat it too, right?

44:01You need to be good at coding. Then you have an AI that is good at hacking. So unless you don't want to spend more tokens or you don't want to get into the coding business anymore, you focus on like scientific discovery, physical AI, whatever, then maybe you can train a model that is not good at hacking anymore. But as long as you want to automate knowledge work, then eventually your AI must be able to use computers and control computers, understand technical problems. And that's the definition of someone like Bruce. So it's unavoidable. So actually on this note, I'm curious, Can you just talk about what it's like being a hacker in the age of AI versus, say, even three or four years ago, right?

44:56Like, it's crazy how quickly stuff has shifted. But how has your day-to-day changed? Yeah, well, I'll just use some background. So, like, I wrote a textbook with some friends on reverse engineering. It used to be, like, you know, like, you try to, like, reverse engineering is the practice of, you know, understanding software without any source code. or hardware systems. That used to be like, I wrote this textbook. And then I think with the advent of AI, I think what, like, you know, whatever, nine months ago, as of nine months ago, like that entire book is deprecating. It takes like, you know, two prompts or one prompt and then bam, it will generate the textbook for you.

45:34And it's even better, you know, and it took us, you know, a long time to write. Just to, that gives you an idea. And then like, I talk to friends who've been doing this for decades, right? They're like specialists in this area. and they tell me that, oh yeah, man, I spend whatever,$5 on some open source model and it reverse engineered the firmware on some Canon or HP printer and it hacks it, whereas before it would take me months to figure some stuff out. Just to give you a glimpse into what's happening, how quickly things change. well front you know like this guy um uh matt swish he's you know yeah and he's dude he's a friend of the show from the long to us a long time friend of the show multi-time guest yeah we used to hang out in abu dhabi oh okay yeah it's really you know like i'm no matt falls i mean like now he's like he showed us he gave a talk to our team the other day and he showed his rack you know like in like you know like um in his apartment and he's sitting there you know like hacking stuff while he's sitting there talking.

46:42It's just insane. Something that we have people that, let's say, for example, we've been hacking the iPhone. To build a full chain on the iPhone, it's not an easy task. Sometimes it takes several people to do this. And our team was able to do this within a few days as one person. And we have multiple of these chains. It really compresses the time to build exploits. We see customers getting hacked by AI, in the financials, in the banks, basically. Defenders cannot... Actually, Tai, why don't you tell these stories? This has happened in the last few weeks, how things have changed. Yeah, basically we saw like, you know, in the OpenAI and Hicking Face incident, there's one detail that is very interesting.

47:44I'm not sure if people noticed, but OpenAI note that like the people who handled incident on the OpenAI side, they said that they have handled a lot of incidents. But this is the first time they saw that, you know, an incident where you have like a hundred points within your networks that were compromised at the same time. Yeah. Like there were a hundred like hackers within your system. Normally you have maybe one or two, right? Now you have a hundred. And I saw that. I was like, wow, that was pretty interesting. But maybe because OpenAI have a lot of tokens. So their agents can just go, you know, hack everything.

48:23and then just two weeks ago we have like two clients in the banking industry and they got hacked and they called us to help them with like the incident response we came in because we do hacking as well we know like usually it took us like maybe a month or something once we come in a network and then took a month for us to spread out for the ai took like they came in they they broke the net they broke inside the network on monday by tuesday they're everywhere everywhere and it's like cancer. It's spread at a machine speed. And it was mind-blowing, right? Because how could you defend against that?

49:00In the past, we were telling our clients, you have to invest in detection. How can you help yourself? If you see it, you can detect it, but there's a hundred of them. Noted. We have a hundred hackers in our system right now. It's not really helpful. Exactly. How could you do it, right? And then you have to shut down everything. But shutdown is not an option because you are a bank. So that actually requires us to sit down and think about how to redesign defense system, right? What we have right now is not working very well. But to come back to your question, like as a hacker, you know, how does it feel?

49:39I love history. So I always come back to history to see, like, did it happen before? It actually did happen, you know, with like, just for example. You remember like in 1997, you know, IBM Deep Blue defeated Garry Kasparov. That was a big moment, right? And then 20 years later, AlphaGo defeated like Lizzie Doe in the game of Go. But those two moments are actually quite different. Like the first moment, the Deep Blue moment, after Deep Blue, the best chess player wasn't a computer. because Deep Blue was a mainframe, right? Not something that you can run on your computer. And it took 10 years for someone to go from Deep Blue to develop a computer software that you can run on your computer that defeated everybody.

50:32But the 10 years, it took 10 years. During that 10 years, the best chess player was a centaur player. This is a term coined by Gary Kasparov. It's a combination of computer and human. It took 10 years. For AlphaGo, it took like three years. After AlphaGo, then 2019, somebody come up with a computer software that defeated anybody without any human input at all. At Calif, we think we are into the era of the central hackers. Basically, the best hacker right now is a combination of AI and humans. and you know our work and our friends work as well show that ai is powerful it can hack anything uh but it still requires you know a human expert to arrive it right and we don't know how long this is gonna last uh maybe three months maybe you know we we come back here in like by the end of the year we tell you we retire now there's nothing else for us to do maybe it lasts like three years and this is actually pretty exciting to find out that's exactly what we want to do and we think like there's like pessimistic view right and AI is going to do everything let's just like retire and hate AI or you can see AI as a tool it's like humanity just discovered fire and without fire we wouldn't be here today so of course we have to think about how to control fire At the same time, a very important question that we need to ask is, what should we cook, right?

52:12That's very important. And we want to find out what can we cook with AI and how can we do it in a safe way that helps everybody. Protein that makes our brains get bigger. All right. Well, Ty and Bruce from Calif, thank you so much for coming on All Thoughts. That was a lot of fun. You're both excellent. Thank you both. Thanks. Thanks, Joe. Thanks, Rishi. Thank you. Bye-bye.

52:47joe i thought that was a fantastic conversation not exactly uplifting i was surprised at ty's response i thought maybe maybe people would say we're in this weird like awkward moment where a lot of like legacy issues are being discovered. But once AI actually gets deployed and starts redesigning some of the architecture, it'll be a lot more resilient. Apparently, that's not the case. That's a little bit worrying. I agree. There was so much in there that was interesting. And like I could, you know, all this stuff about how, yes, you could have provably secure software, but it's small. You can't even do it for something that says the browser.

53:24I love that last point about how we're in the centaur age where the strongest hacker is the computer working with a human, but that may not be there for much longer. Three months a year, we have no idea, but the presumption should be that it won't last very long, et cetera. Also, the idea of a computer, an agent that can code is inherently a hacker. And so you can't just tell it not to hack, basically. Just teach it not to hack. What's wrong with you? Just teach not to hack. If coding is going to be big business, which it is, you're going to be building a lot of good hackers. Yeah. And so the hackers proliferate.

54:02On that note, shall we leave it there? Let's leave it there. This has been another episode of the All Thoughts podcast. I'm Tracy Alloway. You can follow me at Tracy Alloway. And I'm Joe Weisenthal. You can follow me at The Stalwart. Follow our producers, Carmen Rodriguez at CarmenArmond, Dashiell Bennett at Dashpot, Kale Brooks at Kale Brooks, and Kevin Lozano at Kevin Lloyd Lozano. And of course, you can chat about all of these topics 24-7 in our Discord, discord.gg slash oddlots. And for more oddlots content, you can check out our daily newsletter, which you can find at bloomberg.com slash oddlots.

54:33And if you enjoyed this conversation, if you like it when we talk about hacking, then please leave us a positive review on your favorite podcast platform. And if you're watching on video, then please leave a comment or like, or better yet, subscribe. And remember, if you're a Bloomberg subscriber, you can listen to all of our episodes absolutely ad-free. All All you need to do is find the Bloomberg channel on Apple Podcasts and follow the instructions there. Thanks for joining.

55:27A business gift should do more than check a box. It should reflect your brand and show someone they're appreciated, recognized, and truly seen. 4imprint offers thousands of high-quality, customizable products, like premium apparel, drinkware, tech, and more, making it easy to create a gift that feels meaningful and on-brand. And with 4imprint's expert support and their 360-degree guarantee, you can be 4imprint certain your order will arrive exactly as intended. Explore gifting with confidence at 4imprint.com. 4imprint. 4certain. For big business, AI opened up a world of promise, but that world of promise turned into a world of pain.

56:07Cost spiraling, data trapped, security and governance risks multiplying, and ROI out of reach. That's why enterprises turned to Boomi to connect data, apps, and AI, helping them operate securely, efficiently, and at scale. Boomi turns a world of AI pain into a world of AI gain. As Boomi says, we got you. Head to boomi.com. That's B-O-O-M-I dot com. The world of business is constantly evolving, and Comcast Business keeps you totally in step with secure AI-backed networking in more than 100 countries. They're powering over 90 % of the Fortune 500 and millions of small businesses. That's a lot of muscle.

56:48And behind it all, thousands of experts answering your call at 2 a.m. like it's 2 p.m. One partner powering how business gets done for companies around the globe. When you add it all up, no one does business like Comcast Business. Most meeting note takers get the easy words right and the important ones wrong. The client's name, the acronym. Whisper Flow Note Taker is built to get the hard words right. It takes notes on any meeting platform. Zoom, Google Meet, Teams, even WhatsApp calls, keeps every meeting searchable, and connects to Claude or Chat GPT, so you can ask, what did we agree to last Tuesday?

57:25Free to try on Mac and Windows at whisperflow.ai. That's W-I-S-P-R flow dot A-I.

From the publisher

Earlier this year, cybersecurity researchers discovered a vulnerability in PHP, an open-source coding language used in roughly 70% of the world's websites, that had been lying dormant for a long time, and if exploited, could have led to disaster. And the researchers only understood the extent of this bug through the use of frontier AI models. Today, we talk to two staffers at Calif (CEO Thai Duong and engineer Bruce Dang), the cybersecurity firm that was among the first to discover the PHP vulnerability. Their firm partners with the major AI labs and neoclouds, and they help these companies test models and look for vulnerabilities in their infrastructure. Duong and Dang tell us how Calif uncovered the PHP hack, what the firm exactly sells, and what the future of cybersecurity looks like in the age of AI.

Read more:
How AI Is Making Cyberattacks a Bigger Threat
Japan’s Cyberattack Surge Tests Its Push to Strengthen Defenses

Only http://Bloomberg.com subscribers can get the Odd Lots newsletter in their inbox each week, plus unlimited access to the site and app. Subscribe at  bloomberg.com/subscriptions/oddlots

Subscribe to the Odd Lots Newsletter
Join the conversation: discord.gg/oddlots

See omnystudio.com/listener for privacy information.

More from Odd Lots

All episodes