1. Podcasts
  2. Risky Business
  3. Snake Oilers: watchTowr, XBOW and CoreView
Risky Business

11 Sep 2026 · 42m · 14 chapters

Episode artwork

Snake Oilers: watchTowr, XBOW and CoreView

In short

This episode of Risky Business (“Snake Oilers: watchTowr, XBOW and CoreView”) is a sponsored vendor pitch segment about rapid cyber mitigation, automated web app exploitation, and Microsoft 365 security governance.

Guests

  1. Ben Harris, founder of Watchtower. Background: security research and honeypot-driven threat intel; builds rapid mitigation capabilities.

Key claims

uses a global honeypot network, recon engines, red teaming automations, and “rapid reaction” to validate exposure within hours; converts POCs into WAF/IDS/IPS rules within single-digit hours; integrates with enterprise WAFs (Akamai, Cloudflare, Imperva) to avoid destabilizing changes.

Notable examples

jailbreak/reverse-engineering of appliances; STAB in-memory kernel backdoor; telemetry to detect persistent backdoors after patching.

  1. Fedor Kirschbaum, head of security labs at Expo. Background: leads an AI autonomous pen-testing effort.

Key claims

Expo is an autonomous AI pen tester focused on application/web vulnerabilities; black-box runtime testing; “brain + body” harness with a coordinator and specialized solvers that chain findings into exploits.

Notable examples

aims to produce outcomes (exploits) rather than lists; uses multi-agent reasoning to confirm impact.

  1. Andrew McAllister, CoreView (Australia). Background: M365 security SaaS.

Key claims

aggregates tenant visibility via Graph API; daily immutable configuration backups plus near real-time drift detection; automated remediation and governance for risky third-party Entra apps and security baselines.

Notable examples

found 33 global admins in a public-sector tenant; global admin accounts with mailboxes; SharePoint sites (tens of thousands) with external sharing left enabled; conditional access geolocation checks disabled.

Written by AI. May contain mistakes.

Chapters

0:45

Introducing the Featured Vendors

An overview of the vendors featured in this episode and their backgrounds.

“I didn't actually know what Watchtower did until we recorded this segment.”
2:44

Ben Harris of Watchtower

Ben Harris introduces Watchtower and discusses its mission and capabilities.

“But I didn't actually know what it is that they do.”
3:30

Deep Dive into Watchtower's Operations

Detailed discussion on how Watchtower operates, including threat intelligence and rapid response.

“We build tech that helps organizations understand how they're exposed to emerging threats.”
14:00

Mitigating Security Vulnerabilities

Discussion on the importance of finding effective ways to mitigate security vulnerabilities in organizations.

“And then you want to get those mitigations.”
14:58

Introduction to Expo and Fedor Kirschbaum

Introduction to Fedor Kirschbaum and his insights on Expo's pen testing capabilities.

“And yeah, I'm glad I finally know what it is that they actually do.”
15:46

Exploring Expo's Autonomous Pen Testing

In-depth exploration of Expo's autonomous AI pen tester and its application security focus.

“Expo, it's, you're right, it's an autonomous AI pen tester.”
22:20

The Role of LLMs in Pen Testing

Discussion on how Large Language Models (LLMs) are changing the landscape of penetration testing.

“So I'll start with this, with the beginning, which was actually when it started, most people thought LMs were not good for cyber, right?”
26:57

Conclusion with Fedor Kirschbaum

Wrapping up the conversation with Fedor Kirschbaum about Expo's impact on offensive security.

“Well, Ferdinand Kirschbaum, thank you so much for joining me to talk all about Expo.”
28:01

Introduction to CoreView

Learn about CoreView's role in managing Microsoft 365's complexities.

“Anyway, it is time now to hear from Andrew McAllister of CoreView here in Australia.”
28:51

Deep Dive into CoreView's Functionality

Explore how CoreView enhances visibility and manages security configurations.

“CoreView is a SaaS solution that plugs directly into your Microsoft 365 tenant.”
Show all 14 chapters
30:10

Cybersecurity Solutions Offered by CoreView

Understand the cybersecurity benefits and backup solutions provided by CoreView.

“but also a cyber resilience perspective.”
31:25

Identifying Security Risks in M365

Discover how CoreView identifies and mitigates security risks in Microsoft 365.

“you know, a critical part of the BCP or disaster recovery aspect of the tenant.”
34:20

Case Studies and Misconfigurations

Hear about real-world misconfigurations and security assessments conducted by CoreView.

“like just showing you basic things that you should know, but most administrators don't, right?”
36:39

Conclusion on M365 Security and CoreView

Summarizing the importance of using tools like CoreView for M365 security.

“Yeah, I mean, we've got the privilege of being brought into some large public sector organizations, I will say, to run security assessments.”
A man walking through an airport, asking his phone a question

Ask about this episode

Get the gist, explore an idea or ask about something said.

Claude

On Risky Business, what are the key points of this episode?

Searching your listening

Transcript

Automatic transcript. May contain errors.

0:07Hey everyone and welcome to this Snake Oilers edition of the Risky Business Podcast. My name's Patrick Gray. For those of you who don't know what a Snake Oilers podcast is, that's when we get a bunch of vendors to come along and pitch you all their products. They pay to be here. This is a wholly sponsored podcast. But yeah, we've got three vendors you're going to hear from today, and they are pitching very interesting products, in my opinion. First up, we're going to hear from Ben Harris, who is the founder of Watchtower. And a lot of you out there would know Watchtower because they publish really great security research, often with very funny blogs and whatnot.

0:43They clearly know what they're doing. But as much as I know their name and I've read their blogs, I didn't actually know what Watchtower did until we recorded this segment. Well, until they approached us about recording a segment. So yeah, if you too want to know what Watchtower does, you're going to find out in just a minute. Then we're going to be hearing from Fede Kirschbaum, who is the head of the security labs at Expo. And Expo, of course, is that AI pen testing agent that first became really well known because it was climbing the rankings on like HackerOne and all the bug bounty programs and whatnot, which, you know, for an AI agent to do that at the time, obviously created a big buzz.

1:21So Fede will be along shortly to explain to us exactly what Expo does. And, you know, at least at the moment, they're focusing very heavily on web application security testing. So that is an interesting chat. Fede also was the original co-founder of Echo Party, the Latin American conference. I actually met him. We realized that we met a very long time ago in Vegas. So there you go. Just one of those things that happens, I guess, when you've been floating around the industry long enough. And then finally today, we're going to hear from Andrew McAllister, who works for CoreView here in Australia.

1:54CoreView makes a platform that does M365 security. Of course, M365 is a very complicated platform. It's got a lot of bells, whistles, knobs, and dials. And, you know, the odds of your M365 tenant being appropriately and properly secured and, you know, put together without you having gone through some sort of exercise. I'm going to just go ahead and guess that's pretty low. So CoreView, they make a platform that really helps with that. So Andrew comes along in the third slot this week to pitch CoreView. And big thanks to CoreView's Australia team for booking this. They do have a substantial team here in Australia.

2:32So yeah, it's good to have an Australian voice in this snake oilers edition. But yes, first up, let's chat with Ben Harris, who is the founder of Watchtower. Watchtower published just terrific research blog posts about vulnerabilities that they've found or teardowns on other stuff that they've come across. Really good stuff. But I didn't actually know what it is that they do. And it turns out that really what they do these days is they help their customers to be able to apply detections and preventions for bugs, I guess, before those customers can patch them, right? So they can do really rapid mitigation of certain vulnerabilities at the border for their clients by helping them spin up detections and preventions.

3:22It's going to make more sense when Ben explains it. So I'll drop you in here now where Ben Harris explains what it is that Watchtower actually does. Enjoy. We build tech that helps organizations understand how they're exposed to emerging threats. Effectively, we have three core pillars in the business. We have an Intel team, our pre-empt capabilities. That team is hyper-focused on using our global honeypot network to understand what attacks are doing right now, whether it be emerging threats, end-day, zero-day exploitation, post-exploitation behaviors, because we build rootkits to jailbreak lovely appliances, all the way through to building algorithms to allow us to predict what's likely to receive in-the-wide exploitation yet.

4:00We then use that capability to then inform client exposure. So we have recon engines to understand what does organization A look like on the internet. We have red teaming automations that allows us to basically work out how we break in. And then we wrap that around, and of course what we call our rapid reaction process. So our ability to go from disclosure or hint of an emerging threat to telling an organization if they're exposed and validate that exposure within hours. Of course, one thing we've launched recently is our mitigation capability. Given how quickly in the wild exploitation now happens, we're talking single digit hours, because we've become, I think, well used to reproducing vulnerabilities that scale very quickly, especially now with the advent of AI, we can flip reproduction, so POCs, into WAF rules, IDS, IPS rules, and ultimately then push those automatically once we actually find a vulnerable VPN or mail server or similar.

4:49So ultimately, our job... Pushing a rapid detection is going to be less... Look, it's not always going to be reliable, but it's always going to be less risky than pushing an emergency patch, right? I'm guessing that's the appeal for a lot of people there, right? Exactly, and I think that the reality is that as much as we want to go faster, patching is not a big red button that we just kind of hit very quickly. It's a process, especially for regulated organizations or large organizations. They can't just YOLO patch, right? So our aim is to basically sandbag. If we can make it harder to exploit a particular system in that first exploitation wave, we buy those teams time so they can go and do remediation properly in their own kind of terms, on their own kind of timelines.

5:27It's probably, it would probably make sense at this point to describe what sort of technologies you're doing this for. Like, you know, obviously people are giving you money to mitigate vulnerabilities and classes of products. What products are they that they are most concerned about that they're giving you budget to help mitigate? So I think if, you know, if we talked about it kind of 12 months ago, I think we'd have the kind of big hits of VPN, remote access solutions, all the kind of like management solutions of environments through to mail service. Effectively, all the things that we tell people don't expose to the Internet, but for some reason they just keep doing.

6:00And of course, I think given kind of what's changed in the last six months, that's now rapidly kind of, I think, expanded. The reality is that now everything's getting exploited, whether it's kind of easy or hard, because LLMs are lowering the bar for, I think, for kind of sophistication needed. So where I think historically we'd seen the big concern around, you know, those typical legacy enterprise solutions that we pay lots of money for, that has broadened quite significantly, I'd suggest, at this point. So, right. So it was like the 40Net Palo Alto VPN concentrator problem was what you were solving, and now you're trying to solve like the everything problem because everything's getting owned because now all it takes is for someone to use an LLM to say, oh, well, I've just found this thing on the edge of a network that looks pretty crusty that I've never heard of.

6:41Can you please develop an exploit for it? And some open weights model says, yeah, okay, here you go. Exactly. I mean, literally that. And of course, I think we've all seen the kind of drama in the last couple of months. It's not going to get better, right? And the reality is that teams have struggled to reduce what they exposed to the internet for the last 10 years. They're not going to suddenly figure it out now. So if we can use existing security controls to kind of, again, just kind of stem the bleeding, like a birth phrase, like then they get the time to carry on that process while we kind of adapt to this new reality.

7:06Now, you just touched on something very briefly at the intro there, which I thought was actually very interesting. Right. So I want to pick you up on it. Because, you know, you're just like when someone mentioned, oh, yeah, we do this little thing, which I know is really hard, you know, really hard and a lot of work. And I'm like, OK, that was a weird thing to gloss over. but you said that you actually like reverse engineer some of these appliances. And I'm guessing that is the forties and the, and the Palos and whatever. And you can actually get access to the firmware, which means that you can see what attackers are doing on them, you know, in these, in these honeypots.

7:39Is that, is that about right? Like you act, is that actually how you're able to get some insight into TTPs once attackers are actually like popping shell on those devices? It's a great question. And I think this is really interesting. So let me, can we give some background? because I think backgrounds kind of explains a lot of why we went down this path. A big part of us reproducing vulnerabilities, right, is getting access to different versions of appliance A, right, and being able to diff them, work out what's changed between patched and unpatched. Now, of course, that means we have to jailbreak, crack open some of these appliances because they don't want you to kind of go through them.

8:11As I said, you glossed over that part, and I know that that's not that easy. Like, it's doable, but it's work, right? So I'm like, okay, well, you're doing it for a reason. Correct, correct. And so we were going through this process every time, And basically it added time to the amount of time we needed to rapidly react to emerging threat because sometimes we play cat and mouse with certain vendors who would try and break ways to jailbreak their appliances. And we kind of came to a conclusion at one point and kind of went, okay, this is actually really annoying now. I'm taking too much time. And one of our very uniquely skilled researchers, Alas, decided to build what we call STAB.

8:45So STAB is effectively our in-memory kernel backdoor. We can inject via a hypervisor into a VM that gives us a shell on most appliances at this point, even when Fortinet do very strange things with their kernels. But ultimately means that we can skip that entire reverse engineering process, that jailbreak process at scale. Now, we then one day woke up and went, vendors aren't giving telemetry from these devices or these appliances, but people are getting popped constantly. EDR can't be deployed at this point because they have locked them down. how about we take these appliances load stab onto them load our own edr so they look like real appliances they are real appliances to as a honeypot for intensive purposes but we then get pre-post-exploitation artifacts and exactly to your point we get all this elementary then for oday exploitation that's pretty useful really isn't it i mean uh you know you're collecting all of those ttps i imagine you're collecting things like you know c2 as an ioc and whatever and like you know that's just going to be that's just going to be pretty handy and then what you You got some thread intel people who pull some threads there?

9:45Yes. So, I mean, the big theme, and we've been talking about this now for like maybe 18 months, we know attacks are getting faster and faster to exploit vulnerabilities. They've been becoming a little bit more sophisticated around this. But the TLDR is they pop appliances very, very quickly. They backdoor them. Sysadmin rushes in, patches them as fast they can. Machine is now patched. Backdoor, of course, persists. They're still popped. And so our challenge was we can identify exposure and vulnerability, but we can't actually then work out if someone actually came in. So by putting telemetry and artifacts off those honeypots, like you mentioned, we can then effectively work out where the web shells are being dropped.

10:20Can we see if they're patched but actually still backdoored? And that's been an incredibly useful... So you can build like a remote detection, right? So if you've actually seen what they're dropping on it, you can then go and probe your customers and see which ones. Okay, that makes sense. I can absolutely see why someone would pay money for that, 100%. The other side of this though is that there's, you know, you mentioned that there's like this WAF component to it, right? Is this a watchtower developed WAF that goes in front of an organization's applications? Or are you just providing rules for existing WAFs?

10:47How does that work? So the big thing for us with mitigation at this point is that the challenge around remediation and moving these things in is stability, availability, change controls. We don't want to start implementing new technology and new products into things because that defeats the point. So we integrate directly into enterprise grade WAFs, your Akamai, your Cloud Flares, your Impervas, etc. The value of what we do though is the speed to generate those WAF rules. If we can generate them within 30 minutes of a vulnerability becoming known before exploitation begins, if someone else can produce that same rule two days later, it's fairly useless at that point from an exploitation perspective.

11:21So again, it's our speed and our ability to deploy that that becomes, we think, very, very powerful. So this stuff I'd imagine is a product and sort of thread intel feed for the top end to town, the sort of organizations that actually have the, you know, have WAFs and stuff in the first place, right? Which is going to be your bigger orgs. Correct, correct. So we see ourselves as that always on red team, trying to constantly break in and then mitigate what we find. So yeah, you'll see us typically within government environments, Fortune 10, 50, 100, BFSI, Crystal Infrastructure. That's where we're typically kind of called in because the reality is we are designed to help with a threat that's very aggressive, very persistent.

11:58It's sort of those kind of same characteristics are now flowing into every man, dog with an LLM and more. Now, you mentioned too, a couple of times it's come up that you do research, you find your own O'Day, right? And then you can mitigate O'Day, you know, and then you go off and patch it to the vendor. You're not the only company that does this. I mean, look, people have been doing this forever, right? I've always questioned the utility of it when there's people actually out there using exploits in the wild that you have to mitigate. You do that, right? So there's obviously a great deal of value there.

12:25and I can see that the research that you do is awesome marketing. I mean, we're always talking about it on the news podcast, mostly because you guys write really funny blog posts and it's great research. But like, how much is that pushing the ball forward, right? Really, apart from like being a good time and getting your name into like the media, like how useful is it to have you guys finding bugs that might otherwise be undiscovered, you know, and then mitigating them? Like, how does that work? so I think the world has changed quite significantly so my my view used to be that it's our job to understand what kind of exposure looks like kind of tax officers look like see what's going to be targeted by attackers or has historically been targeted and actually help them preempt what's going to be very clearly coming next and that honestly we believe really made a material difference and I think again we went on a bit of a rampage with regards to what we think the challenge looks like in the industry at this point and how we think at least things should at hopefully improve.

13:19What I think has massively changed now is the reality that we can't wait for disclosure vulnerabilities. We can't wait for information to leak because you've got people with LLMs who won't go through the disclosure process for vulnerabilities. And so what we've effectively now done is orchestrated and kind of scaled that research process. So instead of lots of researchers, we're now using researchers that are fueling our internal kind of harnesses. We reproduce vulnerabilities at scale based on the tech that we see our clients using. It means that we can effectively, again, keep getting further and further ahead of what attacks are likely to do.

13:47No, no, this makes, look, this makes a lot of sense because what you want to do is every time a new model drops, you want to throw your harness at it because that's what everyone else is doing as well, including malicious types. They're going to go figure it out. I mean, what you're doing is you're finding the bugs that are going to come out of that new model with a one shot, which is what everybody's doing. And then you want to get those mitigations. That makes a lot of sense. That's a smart idea. So the big thing for us right now as well is that being able to find ways into organizations, we feel is just not enough anymore, right?

14:15It's one thing to say, look at me, I've got this end day or O day, et cetera. It doesn't feel like it's actually helping when teams have got just more holes in this than they've ever had before, right? If we can now help mitigate as well, it goes from being, to your point, you know, sometimes a little bit performative through to actually making a difference to actually help organizations defend themselves. And again, in a world where things are moving so quickly, we feel like we have an impact, if that makes sense. It sure does. All right, Ben Harris, thank you so much for joining us and explaining to us what Watchtower actually does.

14:45As I say, it's a company that we've spoken about thanks to your research so many times on the regular show. So I jumped at the chance. I jumped at the chance to bring someone along to actually explain it. A real pleasure to chat to you. Thank you. Likewise, Patrick. Thanks for your time. Appreciate it. That was Ben Harris there from Watchtower. Big thanks to him for that. And yeah, I'm glad I finally know what it is that they actually do. So now we're going to hear from Fedor Kirschbaum, who is the head of the security lab over at Expo. And Expo made a big splash early on through the whole AI revolution because they had put together a pen testing agent that was really doing well on the bug bounty rankings.

15:25So it was actually leading the rankings, I believe, at Hacker 1 for a while, which really caused quite a stir. So, you know, I thought it'd be good to get these guys on the show and find out exactly what it is that they're selling, you know, how it all works. And yeah, that's what Fedor joined us to talk about. So here he is explaining to you all what Expo is and what it does. Enjoy. Expo, it's, you're right, it's an autonomous AI pen tester. We are focusing mainly on application security vulnerabilities. we are trying to make findings and discovery something that can be made autonomously and produce exploits rather than vulnerabilities we care about outcomes not just you know a list of problems so yeah expo if you have to think about it it's a ai take on finding and exploiting vulnerabilities.

16:28That's interesting, right? Because we've seen other off-sec, like, you know, clanker off-sec startups, right? They're going after things like, you know, how to get domain admin or how to, you know, get into a corporate environment. Whereas what you're saying is like, this is very much application security focused, very much like web application security focused. Currently, we are trying to focus on what most companies are developing and exposing. I think infrastructure is super interesting. There are a number of companies that are trying to tackle that. But I think what Expo is special, it is trying to audit custom apps.

17:08And it's not only trying to find, you know, what's unique from your app, but it's also trying to actually exploit them. and in a way there are not many playbooks for that it is how you can build that instinct that adversarial mindset and understand based on different rules and strategies hey is this interesting can I mix it with other findings oh I can change stuff so for us it is how we can synthesize the same questions we would do to build the tools that would find the bone and then exploit it. So yeah, I think we're mainly focused in how we would do not only pen testing, but vulnerability research in general.

17:52Yeah. I mean, I think one thing that I've discovered about these LLMs, having just studied them a lot, I guess, is that they're really good at reading the manual, which is if you know hackers, right? You've been around hackers long enough. This is their superpower. A lot of the time is they read the manual. They read a lot about how to do stuff. And that's one thing the machines are very good at doing is just reading a lot and sort of knowing where to go. So, you know, what we used to think of as like some sort of, you know, superpower ability just to see things that other people don't. I mean, really, it comes down to the fact that you know a lot more about how computers work because you've read the manual and the machines are good at that, right?

18:32So it's sort of eroded that superpower in the humans a little bit hasn't it i think what i always trying to share in hacking in general it is you know it's people that spend a bit more of time trying to you know troubleshoot and then they know the limits and they know how they work and um i don't know how many people actually knows aws documentation in a full but i know lllm does yeah i mean this is this is the point i'm getting at, right? Is they read the manual, you know? I jokingly like to say to some, and this is like pre-LLMs, I had a kind of a way of telling pen testers about penetration pasting, you know, when all these cheat sheets came out and people just copy and paste comments out and see what was happening on the other end.

19:22And for some, that was pen testing. And in fact, they were half true. but I think the challenge is when you were off script and what made some companies or some individuals find unique stuff and not just you know run-of-the-mill findings so I find pen testing that has been commoditized for sure and I think everyone who has been in the pen test industry has a same love and hate. But I think we're in this unique time that, you said it, you know, basic bones that are on the manual can be detected and can be removed, but also a bit more complicated that require reading the manual to exploit. It's a great moment for doing that right now.

20:12Well, I mean, I think we should celebrate, you know, people talk about the commoditization of pen testing like it's a bad thing. I mean, it's a terrific thing when you think about it because it makes it available to more people once it becomes commodity, once it's not a highly paid specialist discipline. I mean, look, you're always going to need human pen testers to go that extra mile or even to scope things with the LLMs. Like, you know, my colleague, James Wilson, is doing a lot of vulnerability research at the moment using LLMs. And, you know, he has to whip these things around to get them to do what he says because they'll come back to him and say, oh, there's no way to go further with this.

20:47And he's like, yes, there is. Keep going. It'll, you know, convincing these things to keep going because of his knowledge, right? So there's always going to be people who need to do, you know, human beings are always going to be needed here. But I guess what this means is the baseline for what we can automate has gone up substantially. And it looks like, you know, in the case of Expo, you're really trying to apply that to web application testing. And I imagine it really is the case where you give it, you know, some guidance on how to poke, you know, through your harness, on how to poke at an application.

21:19And it's got the flexibility, because it's an LLM, to know that when I get this sort of response, hey, there might be something interesting down there. I mean, that's pretty much what the product is, right? I'm guessing Expo is basically just the harness. I'm guessing the models are, you're probably using multiple. But why don't you tell me? Like, what is the actual, you know, architecture of the product? Don't get wrong. I love seeing, you know, that reverse engineering on how it should be and you're right um so expo it is a harness you're right we call it like a mix between the brain and body body being the harness so hey how can you use tools how can you interpret output and the brain it is a mix of models and we normally try sharing which models are we using and which models are useful for.

22:10Each model has its own personality. Some are a bit more aggressive. Some are more cautious. Some are great at source code, but are really bad interacting with a live site. So I'll start with this, with the beginning, which was actually when it started, most people thought LMs were not good for cyber, right? And it seems like a long time ago, but it wasn't. It was like a year and a half. And that's when we got number one on HackerOne, competing with real humans. But in order to understand the process, it is, hey, how can you find a vulnerability and how you can confirm it? And I think that's the thesis of Expo, trying to identify a problem, seeing in the context of the application if has any use and trying to understand its impact like if you have a sql injection it's not just about getting a sleep timer but rather hey can i read something can this be used to extract the token and then log myself in or craft a cookie so when we think about expo it's which questions are best answer with which brain and what are our body so it's a it's a harness and a router right that's cool you know yeah no it's really interesting and like do you have an llm do you have a model which is driving the router as well or how does that work um so we have what we call a coordinator and that coordinator tries to manage are solvers.

23:49Our solvers are agents that have hyper-focus and they have one task and one task only. One of our distinguished engineers, Brendan, gave a talk a few days ago about how we prompt these solvers to get the problems, you know, get them as much as they can, and just trying to force them into finding something that we don't know if they are there. By the way, Expo works at runtime. We work in a black box approach. You can give credentials, you can provide source code, but our native approach, it's black box. So give us a URL and we'll take the rest. But yeah, we have a coordinator and each of these agents have specific vulnerabilities that are trying to find.

24:42and all those findings get into a bigger context. And if one of these agents see that one of the outputs of these agents are useful, they can chain that thought together and later exploit it. It's amazing that this is basically how a pen test team works, right? Where you've got this guy over here, he's really good at stringing together Java gadgets, right? So like there's a deserialization thing. Hey, Fred, you know, hey, Sarah, come over here. I need some help, you know? And it seems like it's the same thing, but you're just using multiple agents instead, but they're still specialized like people are.

25:17Yeah. Our team is quite diverse. We have people that have spent 30 years in the offensive side of things. Some people are newcomers, but they went really well on back bounty programs. So I think the mindset or these sort of agents that we're building have their unique personalities and their unique traits. you mentioned you know the serialization so alvaro muñoz which was one of the biggest implementers of you know why so serial for example and it leads the offensive capabilities team so for me it's impressive because it's not only about finding the problem and exploit it but also see the reasoning and judgment on how and when it does something and there are things that the tradecraft It's not really human.

26:05It's not that they're super smart, but they're persistent and they try every single option. So it's interesting watching somebody work over the shoulder. Which is, in my view, I think pen testing, vulnerability scanning, web application security scanning, black box style. Is this all collapsing into one thing, is my question. What do you think? I think we are going to become the pen testing, what I call pen testing at least, the validation layer where we can grab information, ask the right questions, and go to the right asset and actually ask that question. Hey, is this model? Yes, no. And if it is, prove it.

26:47So I think we're becoming that sort of transformation between all the noise and start providing some signal. All right. Well, Ferdinand Kirschbaum, thank you so much for joining me to talk all about Expo. I mean, I remember watching Expo rocket up those charts. And I think initially me, like others, was like, eh, they're just automating a bunch of not-so-important things and just reporting them at scale. And then I sort of thought, well, hang on, that's what a lot of people are, that's what a lot of humans who do bug bounties are doing. And then you just saw it consistently rocket up and do very well on the charts.

27:25And it was fascinating to watch and certainly one of the products and projects that got me interested. in the application of LLMs in this space. A pleasure to chat to you. Really enjoyed that. And yeah, we'll stay in touch. Thank you, Pat. Keep up with the great show. That was Fede Kirschbaum there, the head of the security lab at Expo. Very interesting stuff. And yeah, I mean, it's been fascinating to see what AI has done to offensive security testing because it's not just Expo. Like this stuff is genuinely useful. and to a surprising degree, I think. Anyway, it is time now to hear from Andrew McAllister of CoreView here in Australia.

28:09CoreView, not an Australian company, global company, but they do have a substantial team here in Australia. They make an M365 security platform, basically, right? So as you're going to hear, the M365 platform, it's got a lot of knobs and dials. There's a lot of foot guns, like just so many foot guns And Microsoft doesn't really make it that easy for you to know when you've done something wrong, when your configuration is drifting into a direction that is dangerous, so on and so forth. So that's really what CoreView exists to deal with. So here is Andrew McAllister explaining in more depth what it is that CoreView actually does.

28:50Enjoy. CoreView is a SaaS solution that plugs directly into your Microsoft 365 tenant. and what we do after we've established the connection is using the graph API and a bunch of other APIs and scripts that we've developed, scrape the tenant and capture all of the metadata of the usage of all of the Microsoft 365 services inside the tenant. And we also are able to capture and consume all of the configurations and the settings and the policies of these workloads and aggregate them into what our platform is. So CoreView at its heart and soul is an amazing visibility tool that aggregates and centralizes all of the information reporting visibility of what's going on inside your tenant into one place instead of the 30 different Microsoft 365 admin consoles.

29:40And then - Ooh, I love a bit of shade. Well, you bang on, you bang on, right? Like it's a nightmare. You shouldn't need a third-party platform to do this, but I'm thankful that there are third-party platforms to do this because it needs to be done. There are. I mean, we would never position ourselves as adversarial against Microsoft. We wouldn't exist if Microsoft didn't exist. But the fact is that their platform has evolved so rapidly over the last 10 to 15 years that it's left a lot wanting from both an operational perspective but also a cyber resilience perspective. So CoreView has kind of come in behind this amazing ecosystem and filled in some of those gaps.

30:21Yeah, so let's talk for a moment. I mean, you've described what the product is, right? And I've spoke to other vendors on the show where it's a similar sort of thing, right? You give them access into the tenant, graph API, pull down a whole bunch of data, and then start to glean some insights. So what are the main problems that you're actually solving here for customers? this? Yeah, on the cyber side, you can really think about Corview as being a beautiful intersection between the operations and the cyber. So I like to kind of go down those two paths separately. So on the cyber side, what Corview does that nobody is doing right now is taking a backup of all of the configurations and settings inside the tenant.

31:00So it's a daily immutable backup at the configuration layer. And because of the way that we handle the backup, we're also providing near real-time drift detection. So anytime a critical setting or configuration changes inside the tenant, Corview will see it and report on it and allow the operators or the security team to roll that setting back to a known healthy baseline state. So yeah, on the cyber side, think about it as a, you know, a critical part of the BCP or disaster recovery aspect of the tenant. You can't just back up the water anymore in the glass. If you think about the water and glass analogy where your tenant is a glass of water.

31:38Everybody is backing up the water inside the glass today, which is all of the data, but nobody's backing up. No, no, I get it. I mean, this is like someone flicks the wrong switch or some threat actor gains access to the environment and they make a mess, right? So revert to known good state, handy. Again, I feel like Microsoft should offer this in an easy to access form that doesn't involve a whole bunch of PowerShell scripts in a trench coat, but that is a good idea. So what else? Keep it rolling. Yeah. So the other part of what CoreView can offer is deep visibility into other potential security risks inside the tenant.

32:13So one of the great examples is all of the third-party entry applications connected to the tenant. CoreView can take an inventory of all of those and provide governance life cycles on those apps. Those apps are actually now one of the main ways that adversaries are getting into tenants is they can scan a Microsoft tenant. They can find these old Entra apps that have just been left behind with weak permission models. And often those Entra apps have significant read-write access in and out of the tenant. And so CoreView is able to provide a governance lifecycle on those apps. Well, hang on. How does the threat actor go from actually enumerating the apps in the environment to spotting a weak one to then using that app to do things?

32:57Well, I mean, it's very easy to get a little scanner that can scan an M365 tenant and find the app in the first place. And then it's a matter of not necessarily having to breach the administrative account of the tenant to get into the tenant. It's about a breach on that app. A lot of these apps are commercial off the shelf apps, which usually have good protections in them. But many, many, many third party entra apps are little homegrown, home built apps that don't have good security controls built into them in the first place. So it's those ones that are quite easy to compromise. What's they going through the app makers infrastructure or what get into the GitHub like that sort of thing or?

33:39Yeah all sorts of different methods on this. You can speak to our engineers about the more technical routes here but the point is that third-party entra apps is that's how the Microsoft Midnight Blizzard attack happened in the first on the Microsoft tenant is a weak third-party app there. So, yeah, CoreView will inventory these. It will show you where you have apps that have read-write permissions. It will show you where certificates aren't being updated on these apps and give you some automated remediations to make sure that you never have this drift in these apps that are connected to your tenant.

34:14So, yeah, configurations, app control, and then essentially aggregated security Intel like just showing you basic things that you should know, but most administrators don't, right? Like how many of my users are authenticating into my tenant without multi-factor as a default? Yeah, it's amazing how hard that is to figure out often. And it's not just Microsoft that's guilty here, but the number of times you need a third-party tool to be able to tell you that's insane. Well, it's also insane the number of administrative accounts that have multi-factor switched off, right? And so we will just show you all of these risks, but not only show you if you can use CoreView, so not only reporting and visibility, but we have a bunch of out-of-the-box remediations built in that you can automate, you can schedule.

35:04And so you can build these policies or use our out-of-the-box policies to decide what good looks like on the security side, baseline it. And then anytime CoreView detects something outside of that swim lane, it can automatically run a remediation. So instead of waiting for the sort of six monthly audit to fix up all of these things a couple of times a year, it's constant compliance on that. So I'm guessing that might be something like some admin somewhere enabled an insecure protocol for email, you know, for users to be able to retrieve email or something like that. You know, I mean, that's a classic misconfiguration that you would see in an M365 tenant.

35:40It is, right? Other obvious examples are where users or admins have set up some sort of automatic forwarding rule on their Exchange Online mailbox, right? That clearly offers a huge security risk. It's not just email either. Think about the data lakes within M365, SharePoint, OneDrive. So if you've got SharePoint sites that have been sitting there with external shares open for months and months and months because it was needed for a project and then never properly shut down, you end up with this sprawl of data but also permission models across the tenant that just slowly degradate the overall health of the system.

36:20So these are all of the metrics that we are collecting and aggregating into a governance dashboard. Now, someone in your sort of role, one of the questions I love to ask, because these are the sort of products that find the wildest stuff that you can imagine. Have you got a few worries for us about some wild, absolutely berserker misconfigurations that you've seen? Like your all-time top five. Yeah, I mean, we've got the privilege of being brought into some large public sector organizations, I will say, to run security assessments. So that's actually something that CoreView does before we even attempt to sell our platform is we will connect to a tenant and offer a low cost or no cost and no obligation security assessment of that environment.

37:12Well, it's a great way to sell a product, right? is you do the scan, it pops out a nonstop show of horrors, and then, yeah. Yeah, exactly. So, yeah, I mean, one of the large public sector tenants that everybody in Australia would be impacted by, I will say, we discovered that they had something like 33 global administrators in that one tenant, for example. and clearly that is a challenge and a risk. And when it came down to it, it was really just because it was more convenient to assign higher privilege to admins than it was to create bespoke admin roles for them. I mean, that's usually how that happens, right?

37:59Yeah, right. I mean, I will say this much is that the Microsoft 365 admin permission model inherently breaks traditional least privilege rules of just enough and just in time, right? So this is something we see quite often, but 33 is egregious. You know, Microsoft themselves say you should only ever have a maximum of three or four global admins inside any tenant. And so to find 33 of them was pretty shocking. We have seen global admin accounts in some significant tenants that have a mailbox assigned, right? And when you combine global admin privilege with mailbox phishing propensity, having a mailbox assigned to any administrator or administrative account is just a massive no-no.

38:45But again, there it is happening in large corporate and public tenants. Conditional access policies switched off that monitor geolocation of administrative sign-ons. and so you know this particular customer was concerned about about work that seemed to be happening outside of regular business hours and lo and behold that you know there were there were operators that were now accessing admin accounts from the other side of the world unbeknownst to them because they had not had the you know the correct conditional access policy on on sign in location configured properly. We've seen SharePoint sites, you know, we work with the university sector, so SharePoint sites numbering in the tens of thousands in some cases, so 60 ,000 or 70 ,000 SharePoint sites that were created for projects and never spun back down again, all of which had some level of external share still enabled or at a minimum didn't have an administrator assigned to them anymore, all with PII from the university sitting inside of them, right?

39:58Yeah, just a ticking time bomb there. I mean, there's a bunch of examples here, but if you think about, you know, that inherent risk that you're assuming when you sign up to the Microsoft ecosystem, the idea of sharing your PII out of this platform externally is really easy. It's really easy to hit the share button in SharePoint. It's not so easy to unshare that. Yeah. All righty. Well, Andrew McAllister, thank you very much for joining me to pitch it. It's always good to hear about solutions like this. I think there's a lot of people out there that don't quite realize what a blind spot it is.

40:29I mean, Microsoft has certainly come a long way in terms of allowing people to access certain features. Like, you know, figuring out which apps are authorized into a tenant is actually possible now. And it was very, very difficult in the past. And, you know, they've tidied up their defaults somewhat. But, you know, M365 is still just a collection of foot guns. So, you know, I'm very supportive of companies using platforms like yours to go and figure that out. But yes, a pleasure to chat to you. Thanks for joining me. Thanks so much, Patrick. That was Andrew McAllister there from CoreView. Big thanks to him for that.

41:07And yeah, it's funny, right? When you think about M365 as just like an office suite in the cloud. I mean, it is and it isn't. And like, what is a cloud platform versus a SaaS platform? And the lines start to get pretty blurry. So, you know, I think it does make sense to at least do an eval using tools like these to see where you're at. Because I am familiar with horror stories. Let's just put it that way. But that is it for this edition of the Snake Oilers podcast. I do hope you enjoyed it. I'll be back soon with more security news and analysis. But until then, I've been Patrick Gray. Thanks for listening.

41:50Thank you.

From the publisher

In this edition of the Snake Oilers podcast three vendors stop by to pitch the audience on their products:

  • watchTowr: We’re all familiar with watchTowr’s research, but what do they actually do?
  • XBOW: The AI pentesting company pitches its approach
  • CoreView: Your M365 tenant is probably a security disaster. Tame it with CoreView!

This episode is also available on YouTube.

Show notes

More from Risky Business

All episodes