Benjamin Plummer (Dragonfly Intelligence) on AI's Real Bottleneck, and Why He's Betting on Australia

0:00Georgie Healy: You're listening to a DayOne.fm show. Can we start about Bridgewater? Nine years, the world's largest hedge fund. Why are you nice? I don't think we've ever seen a company be so proud of losing control of its own software and having it do things that weren't intended. No, the police would be... Public announcement. Yeah, the police would come over. Exactly right. I mean, you've got something that's effectively locked in a box that you're making smarter and smarter and its incentives is to break out of the box. It does look good on a chart, Ben. It really does. It has a lot of pain and kicks and twists and turns underneath that chart.

0:37Georgie Healy: You should have a lot more gray hair. I think what AI is really changing is people with agency to go and create and build and do something different are going to be extraordinary beneficiaries. It's like pretty hard to attract great people into a sinking ship. And so while I don't think it's too late, there's definitely a window of time where if you don't sort of get on board and start moving, it's going to be really hard to catch up. Scan my nail for me. What? There you are. Oh my gosh. Show the cameras what happened. It is my YouTube page. I've got an NFC chip in my nail. It's the most genius thing I think I've ever done.

1:20Georgie Healy: hello and welcome back to in the blink of ai i'm georgie healy and after today's episode you're going to be a massive fan of benjamin plumber i definitely am but i confess uh ben came to me very strongly recommended by very smart people but that happens a lot i have the most incredible recommendations and it took me a long time to schedule a call anyway four minutes into that call, I was like, oh my goodness, I need to move some things around in my calendar. Ben is the co-founder of Dragonfly Intelligence. He ran Invisible Technologies, working with Frontier AI Labs. And before that, he spent nine years at Bridgewater in New York City, the world's largest hedge fund.

2:02Georgie Healy: He's been working on AI since before ChackGBT was even a word in our lexicon. And today we get into some really big headlines, like the hugging face hacking incident and the lack of accountability there? New bottlenecks in building businesses and its people? What does nine years at Bridgewater Capital under Ray Dalio teach you? And software bloat. We've got more and more features and vibe coding and platforms trying to be something like everything for everyone. We kick off the show with me asking Ben to scan the NFG chip in my fingernail. So make sure you watched that part on video and let's dive in.

2:40Georgie Healy: You're listening to a day one.fm show.

2:46Georgie Healy: Founders scale faster on Deal. Set up payroll for any country in minutes, hire anyone anywhere, get visas handled fast and get back to building. Visit deal.com slash day one. That's D-E-E-L dot com slash day one.

3:06Georgie Healy: Benjamin, Ben, thank you for coming on In The Blink of AI. We always start up the episode with a hack of the week. Start us off strong. What's your hack of the week? So one thing that I've been using a lot lately, and Andre Kapathi, a famous researcher, tweeted about this recently, is the rambling session, which is take a microphone, and take your recording transcribing tool of choice and just talk for five, 10 minutes, explaining an idea, a concept, a problem you're wrestling with. And there's something like really powerful once you learn not to try and compress your thoughts into a sentence or two of a prompt.

3:48And you really give it all the richness of your thinking, the things you're not sure about, the nuance and feed it into the model. it's incredible how well it can distill all your rambling thoughts and play them back to you more coherently and clearly than you could ever imagine it's amazing what are you using to ramble mostly whisper flow or sometimes i just go have a granola meeting with myself for

4:12Georgie Healy: 20 minutes doesn't matter can i tell you i've been doing this and it is one of the few ai tools whisper flow that isn't just a fun little hack that I then retire. It's incredible. And you're right. I do a lot of content. I do a lot of writing. I do podcasts, obviously. And it's about the vibe. It's not about having the perfect prompt. And to get that feeling, that emotion, it's really hard to put that in a sentence sometimes. And it takes some getting used to, like even pausing and gathering your thoughts is quite weird when you're in a sort of conversation but the AI will happily wait for five minutes if you need five minutes and so you do need to sort of retrain yourself to allow yourself to really just sort of express the thoughts I find especially for creative things it allows you to just sort of like really get in a flow and explain what's on your mind whereas the typing can be really slow so yeah I use it all the time I probably five ten times a day it's amazingly powerful when combined with the LLMs to clean it up on the other end.

5:18I think if you just got a long rambling list of your notes, probably not so helpful, but it's helpful in both ways.

5:25Georgie Healy: So strong. Don't try this at home or do. My best thoughts come like really late at night. The whole family's asleep, but with WhisperFlow, you can genuinely whisper. So I'll be in bed being like, great event idea. Yeah, I have those in the morning sometimes, the same thing. Everyone's still asleep. Okay, you're going to be my guinea pig for the morning. You'd think I invented nuclear fission. I'm so proud of myself. Do you have your phone on you? I do. What have you got for me? Scan my nail for me. What?

6:00There you are. Oh, my gosh.

6:02Georgie Healy: Show the cameras what happened. It is my YouTube page. I've got an NFC chip in my nail. It's the most genius thing I think I've ever done. I put my YouTube page on there. There's a lot of events this week. It's just a much more fun way of, you know, oh, what's your podcast? It's called this. Then they may or may look it up on their phone. QR codes are not so whimsical. I find that fun. Surely people have to remember that. I've not seen anyone doing that. That's awesome. So I've got my YouTube page on. I'm going to put my LinkedIn on my other thumb. I will make all my nails the same color. I just wanted to try this before the pod.

6:39Georgie Healy: That's my hack of the week. Thank you for humoring me. Okay. So speaking of hacks, I genuinely need to dive into this. Hugging face, Chack GPT hacked it. It became like this, it felt like a celebratory moment where they're shaking hands and like so happy with the partnership of being hacked. I'm like, should we be more worried? Is this marketing? What's your take then? Yeah, I think both are true, which is certainly I don't think we've ever seen a company be so proud of losing control of its own software and having it do things that weren't intended. And I think, you know, there's certainly an element of this where, you know, the idea of these models becoming more and more powerful, anthropic, doing a similar thing in the early phases of Fable, I think is a very consistent sort of pattern with that.

7:30I think on the other side, these threats are very real. And in this case, it wasn't sort of a malicious threat. it was the model basically trying to cheat on a test that it was doing. And that is a very common behaviour for these models. The way they're trained and the way they're incentivised to sort of achieve a goal means they will do basically anything they can to achieve that goal, which in this case includes breaking out of their own harness. So I think these sort of challenges are very real. I think the other interesting part of that story, which is sort of less reported is Hugging Face actually caught it about a week or so before OpenAI.

8:12They did so using open source models. And so there's a very interesting sort of other side to that story around the balance of these things where sort of either the threat or malicious actor side of things and the detection mechanisms really need to move in unison or I think there's going to be challenges. I think the other sort of really interesting thing there is just around accountability and who's actually on the hook for this, which is, you know, in the OpenAI case, it's their models and their actors basically doing it. And so it's a little clearer, but in a world where some other company using OpenAI or anthropic models does something similar, I think it's going to be very hard to attribute who's actually at fault and who's responsible.

8:59In this case, there was no harm, there was no damage, but very easily that could be a different situation. And I think the sort of legal frameworks around the accountability for this is really unclear and something we're going to need to invest a lot in.

9:14Georgie Healy: So well said. Imagine a person, imagine you or I hacked into Hugging phase, I don't think it would be the public announcement. Yeah, the police would be coming over. Exactly right. And so, like, I think that is sort of the undercurrent of this thing is really around who's responsible for these models as they become more and more powerful. And, you know, a lot of this is at the sort of harness layer, that these underlying models are way stronger and more capable across a range of different dimensions. And these safety guard rails are meant to protect them from doing these particular things. But those are not bulletproof, as this points out.

9:59And as there's many examples online of people being able to sort of break out of those safety guard rails. And that is another challenge here, where you sort of got these things that are increasingly more and more powerful that need to be contained and understood on the other side. in terms of what those threats look like and how to protect against them.

10:18Georgie Healy: Such a great point. I remember when we had Anthropic on the show, they were talking about agentic harnesses, and it sounds perfect, right? You know, this is the safety, this is the privacy, this is all our rules and regulations, and it's like, great, done. But since this happened, like a powerful company like OpenAI doesn't have control of their harness? I mean, you've got something that's effectively locked in a box that you're making smarter and smarter, and its incentives is to break out of the box. And so inevitably, what do you expect is going to happen, particularly if you have actors who are trying to get it to break out of its box.

10:57In this case, that doesn't seem like that was necessarily so, but certainly there will be others who are. I don't think this necessarily needs incredible amount of alarm and blocking these models and things like that. I think really what it is about is recognising that as these things become more and more capable. We need to be just more aware of the threats that are emerging in different ways.

11:20Georgie Healy: One more thing on this, you mentioned, you know, hugging face being the ones that identified that this had happened. Anyone that's listening that might not be aware, it's like a GitHub for AI models. This is a very advanced technical company that could identify something like that happening. Do you think this would even be identified with a less sophisticated company or? Highly unlikely. I think you're talking about the real sort of operational lines of technology capability within these organizations. Interestingly, you know, you could kind of argue that they're an indirect competitor of open AI and that in a lot of ways they represent open source and a sort of alternative path.

12:04And so even that creates like a really interesting dynamic. Imagine you had some other company accused of hacking its effective competitor. you'd have a whole bunch of different questions. And so, yeah, I think most organizations are totally unequipped to deal with the level of sophistication. You're looking at these models being able to find vulnerabilities that have existed in software for 20 years. And this is like web browsers, core infrastructure of the internet that sort of every engineer in the world has had access to. And I mean, poking holes in, these models are finding gaps in that core infrastructure.

12:43And so it's just a whole new level of capability that most organisations don't have. And I think one of the risks of, you know, companies that probably shouldn't be building software, building software opens up is that, yes, it's much easier than it's ever been to build and vibe code and prototype things, but actually building robust, secure software is probably as hard as it's ever been.

13:09Georgie Healy: What take right there. You're going to have so many opportunities for more hot takes. You're the CEO and founder of Dragonfly Intelligence. After a series of incredible career steps, which we'll unpack, but some things that I read on your website and on your blog that I'd love to unpack, one of which AI expands coding capacity exponentially. We've seen that all the engineers have reported this, but then every other process in the pipeline is exposed as the bottleneck. What are some bottlenecks that you think are particularly risky? Yeah, look, I think if you sort of focus in on engineering and software development to start, you know, either side of the coding activities, I think you're seeing people sort of slow down.

13:58One, you have to think about what you want to build, decide what's important, what's not, have judgment around that and that you know there's elements of that that you can use these models to help with but you know the humans as think are still really important in that process of sort of taste and judgment and decision making and on the other end of that is this sort of verification and validation of like did the model actually build the thing i wanted and i think you know in a lot of cases humans are still quite important there and so what you're seeing is historically the sort of coding was the part that took all the time and there was much less effort on these other things it's now sort of flipped in the coding becomes really quick but deciding what you want to build and then checking it was actually built becomes a real problem and then if you zoom out I think there's a much bigger sort of organizational societal problem which is we're just being overwhelmed with software, which is because it's so easy to produce apps or solutions to things.

15:00Every day, there's 50 new applications, open source, closed source, that do one very niche thing. And even in areas that I care deeply about and spend a huge amount I don't have time to go test them all out and figure out which one's good and which one's bad. and that's the same within an organization people's ability to change and learn about all these new tools and capabilities is really going to become the bottleneck and there's probably a backlog of 20 amazing apps or sort of frameworks that have come out in the last month that I'm desperate to try and just don't have the capacity to go figure out exactly what they do and how they fit within our stack and so again it's sort of back to the humans being the lowest common denominator, I think people on the forefront are getting more creative around that, which is, okay, how do we use the agents to actually go test four or five different pieces of software and give me an assessment of how they work and how they're different?

15:59And so we're slowly sort of abstracting our way out of some of those activities as well, but that's going to take time that we're sort of very early in those phases, I think.

16:34Georgie Healy: Thank you. at deal.com slash day one. That's D-E-E-L dot com slash day one.

16:48Georgie Healy: I don't know if we can equivocate it exactly, but it does remind me of the complete, like, explosion of AI imagery for a short time there, and then everyone was, like, revolted and disgusted, and I haven't seen it quite so much. Do you think that's kind of similar? Yeah, I think it's going to be really interesting in that like one of the things that's happened over the last decade say is I'd say generally software has gotten way worse and it's gotten way worse because things you start a company with an idea that's different that has an opinionated view of how things should work and then over time you just keep adding features and capabilities and it becomes completely unopinionated you're trying to be everything to everyone it's bloated with all sorts of different things that no one needs just go open up slack excel whatever whatever software you want there's a million things that you have no interest or need for i think there's an opportunity for ai to strip that back and end up with software that is purpose built for you that has every feature you need and none of the features that you don't need that i think is much more of a sort of apple approach to software development which like there's simplicity and beauty in minimalism.

18:06And I think that's really exciting in what it can do for companies and people. I think on the other hand, there's basically no barriers to shipping software now. And so there's going to be a whole bunch of noise and crap that people are going to need to sort through. And so there's a little bit of good and bad that I think is going to come from this over the next few years.

18:26Georgie Healy: I know it when I see it, in those monstrosity websites, that it's every feature, we do everything. and it's like just stop. Every customer, every salesperson wants one more thing and they never take anything away. And that's sort of been, I think the last decade has been that shift towards just adding and adding and adding and not really taking away anything. So agree. Before we talk a bit more about Dragonfly Intelligence, you have a crazy origin story. I remember when we first got on a call, my A4 page just got filled up very quickly trying to figure out what to talk to you specifically about.

19:05Georgie Healy: Can we start about Bridgewater? Nine years, the world's largest hedge fund. Why are you nice?

19:15I think people fundamentally misunderstand Bridgewater. I think there's a lot of quirks around how that place operates that gets a lot of attention, whether it's the recording and some of the tools. I think at the essence, it's about this sort of search for truth. And that comes from trying to understand the world and how the world works. It comes from trying to understand each other and what we're like. And actually, when you sort of think about it, being direct and telling you what I think and when I disagree and when I don't agree with you and why and when I think you're making mistakes is so much nicer than sitting here and thinking you're making all these mistakes and not telling you.

20:03That's not how most companies operate but that was sort of very much an idea that Bridgewater lent into and once you've sort of experienced that it's kind of hard to ever go back. You're just kind of like, why would it ever exist any other way?

20:20Georgie Healy: I love that. I love when someone tells me to my face, I don't, I read your media deck and I didn't like this. I love that. That's so helpful. Yeah. Otherwise you just get crickets and then you wonder why. And it's really interesting how in other domains people sort of really understand it. Like if you go to professional sports or whatever, it's like very clear there's a goal to win. And there's no surprise that, hey, you look at tape afterwards, you give each other feedback, you're out of position, you missed that. And it's sort of very clear that the purpose is making it better. It's not that you hate those people.

20:58It's not that you're trying to like advance your own causes. It's like we were all playing a game. The purpose is to win. We want to get better. and I think Bridgewater sort of took that same philosophy around you know the markets in which they wanted to participate and win and it was the same mentality of like how do we get better every day how do we push each other what type of environment and culture is required to enable that and it's sort of very refreshing after you sort of go it's it's a little it takes a little bit to adjust to honestly I think as an Australian it was way more natural to me than a lot of Americans feel the sort of transition.

21:35I think we're naturally more direct and sort of culturally, I think, a little bit more aligned with that way of thinking. And it is interesting how different cultures react very differently to that type of behaviour.

21:49Georgie Healy: Yeah, hot take. Queenslanders should work at Bridgewater in New York City because I feel like we've given each other so much shit by the time we're 20. It's like, hit me. I can handle it. And clearly a sucker for punishment, nine years in a hedge fund and then New York City you started a startup no no before that Elemental Cognition tell me about that first yeah so Elementor was an AI lab that we incubated within Bridgewater this was probably 10 maybe more years ago and the founder Dave Ferrucci who was the inventor of IBM Watson back in the day that beat Jeopardy, had a very clear vision for the sort of next wave of AI and what some of the gaps were in the current sort of machine learning approaches and other things that were quite popular at the time.

22:40Georgie Healy: And for the record, 10 years ago is before GPT-3. Well before, yeah. And maybe even longer, but it was certainly at least 10 years ago. and so Bridgewater sort of seeded that and invested in growing that out it got to a point where it was very clear that there was sort of much broader applicability than Bridgewater had used for and so we spun it out and raised external capital from a bunch of sort of top tier VCs and I left as part of that and built the commercial side of that business over a few years and it was just a fascinating time to dive into the AI space as you said this is a couple of years before ChatGPT, but it's very clear that these technologies are heading in a direction that's going to be much more broadly useful than pure sort of machine logging algorithms or anything like that.

23:30So it was a really exciting time. Lots of challenges in taking an extraordinarily talented group of researchers and scientists and building a commercial business around them. So lots of learnings, but amazing fun. And I learned so much about these technologies, the limitations, the types of places they succeed and fail through that experience that's been really helpful over that time.

23:56Georgie Healy: I have to know, when did you think AI might be a thing? It's fine. I mean, at every juncture, it seems so obvious. But then you look back at what's happened since each one of those pieces and you're like, I had no idea what was about to transpire. And so I think those early days of Elementor, you just sort of have these aha moments where, and I suspect everyone sort of had these, some of the early days of interacting with ChatGPT where you're like, wow, this thing really surprises me in ways that I have not, you know, ever experienced with technology or software. and so I was lucky enough to have many of those moments early on where it's clunky, it makes mistakes, it does silly things but you see these glimmers of potential where it's very clear that the kinks will be ironed out and what remains is something that's like incredibly profound.

24:55Georgie Healy: And did Elemental give you, like did you get bitten by the VC bug, like what is it like to have a real start-up, I'm going to go all the way to SF now? yeah like what was that thinking it definitely I'd sort of gone if you sort of follow my career it's like every point I'd gone smaller and smaller and earlier and earlier stage and so I mean Bridgewater wasn't big by any stretch of the imagination were about 1500 people but it started to feel big after a period of time Elementor was a great way to sort of move you know still pretty closely connected with Bridgewater but do something more entrepreneurial and Invisible was sort of the natural extension of that, which was a company I'd been advising with and helping from sort of the early days of inception that I eventually took over as CEO.

25:45Georgie Healy: Tell us how much revenue and profitability? So we grew a lot. So we went from about 10 to 15 million USD to about 160 over the course of 18 months, which looks really good on a chart. It does look good on a chart, Ben. It really does. Has a lot of pain and kicks and twists and turns underneath that chart. You should have a lot more grey hair. But just an amazing experience. We sort of ended up in an incredible position at the middle of, I'd say, the largest reallocation of talent and capital I've ever seen in my lifetime, but I think probably that we've ever seen in society. And so we had an amazing group of clients.

26:32We had an amazing team and got to do some really cool work.

26:35Georgie Healy: My favourite part of the interview, you're back in Sydney, Australia proud, CEO of Dragonfly Intelligence. Tell us what it does. Tell us why you're excited after doing these incredible things to date that you're like, you know what, all in on this. Yeah, look, I think in a lot of ways, Dragonfly is the culmination of all of those things, which is you know one of the things that was really apparent to me in the work that we did in invisible is just the huge disparity between what these technologies are capable of how fast they're moving and how fast they're adding capabilities and how far behind the whole economy is in terms of being able to metabolize those changes and realize those benefits and in some ways, the companies that have the most to gain are the least equipped to actually harness those capabilities.

27:31And so I spent a lot of time thinking about what is the right mechanism for sort of creating value and driving this change in this new era. And it was clear to me it wasn't going to be SaaS. It wasn't going to be consulting. Companies were not going to figure this out on their own. And so the idea behind Dragonfly is we're a capital allocator and investor. We invest in buyer companies. We're a technology company. We've got our own proprietary AI platform. And we're operators. We're entrepreneurs. And so we take these businesses, we rebuild them from the ground up as AI native versions of themselves and really unlock the potential that exists within these industries that, you know, in many cases haven't evolved in 20 or 30 years.

28:19And we think there's a really important moment in time now where AI sort of unlocks a number of constraints that have been holding these businesses back.

28:29Georgie Healy: Right. Ready yourself up. I have so many questions. Number one is how do you identify a company, especially private markets, where I called them zombie companies when we spoke before they may have got VC capital and they actually don't have any customers or they're actually not making any money or their churn is crazy and you don't know any of this like how do you identify good and how do you know oof that's red flags yeah I think there's sort of two categories of you could call them zombie companies um they play out slightly differently I think there's a lot at the moment of these I built some product that I find useful therefore it should be a business and lots of people running around trying to convert the first thing into a second thing and realizing that building the product isn't the hard thing particularly now with these tools selling it serving customers you know building revenue raising money all of these other things were actually way harder and and particularly great engineers sort of solve the first thing very quickly and then very quickly run into these other sets of problems.

29:38And they're smart enough that rightfully one or two companies will take a punt on them and they'll get some traction, which in some ways is worse because it sort of perpetuates the belief that they have a real business. And I think there's lots of those sort of different versions of that, of every week there's someone else pitching me some agentic harness thing that they've built, that they're using, that they're going to turn into a business and the reality is like every great engineer has one of those now you're not like building something that you're going to sell to the masses and the average day person is not looking for an agentic harness and so there's like a market it's not in my google search history no and then i think the other sort of category and this is sort of much more i think strategic is when each model release comes out does the gap between your business and the alternatives get larger or does it get smaller and there's a lot of companies that have built things that you go back to like in the early days there was um i can't remember the name of now there was like a writing app that like exploded it hit like 100 million in revenue it's not grammerly or one of those i can't remember the name of now unfortunately um but explosion in revenue it was really cool it took these models that were kind of hard to use and made them slightly more usable and it was like at the time one of the fastest revenue growing companies you've ever seen but then very quickly like open ai could just do that and then claude could do that and people like why am i paying for this other thing and i think there's a lot of startups that are just ahead of the models that they've sort of taken the models and layered them or put a ui on them and it is helpful now it's better than using the models themselves but that's just a matter of time before they basically eat you up.

31:26And that's a hard place to be in. And I think knowing where those models are going, and I describe it like a freight train, like they're coming and you better not be on the tracks. That's easier said than done. It's not totally clear exactly. Yeah, we're not judging.

31:42Georgie Healy: It's not easy to do, but we see it. But that's a really important question to ask, I think, for venture investors investing, saying, hey, how's this going to play out? Is this going to be consumed by the models? Is there real sustainable differentiation, which means this company is going to win over a long period of time? Or is this a flash in a pan thing, which could have great success for a period of time and then likely dissipate? And you can still make a lot of money, you can build some great businesses, but those are probably not venture scale businesses, just given the time horizons that are involved.

32:17Georgie Healy: Yeah, you need, I think for VC funds, it's what, an average of 10 years? Yeah, I mean, there's a whole bunch of factors that meant that those distributions and returns have really dragged out. Companies are staying private for a lot longer. There's not IPOs, there's been less M &A. And so while those time periods used to be a lot shorter, they're really dragging on now. So can I be cheeky and ask you to be specific? Because like I'm thinking of industry verticals, but I've seen them get disrupted. You know, dentistry products that rely on image generation. And then when Nano Banana came, oh, there goes that one.

32:56Georgie Healy: Like what, is it getting even more domain specific? Yeah, so I think like to use a specific example, there's a lot of incumbent software, use Xero as an example, that have a really, actually have an incredible opportunity when you think about what they have. They have extraordinary distribution. They have millions of customers. They know a lot about them. They have a lot of data. But to actually move up the stack, they basically need to cannibalize their existing business and compete with their customers. Instead of providing accounting software, go be the accountant. And that, in theory, is a really easy thing to sit down and say, of course you should do that.

33:40That is the way out of the current predicament you're in. Getting alignment across shareholders, board, CEO, leadership team, all the functions that have a vested interest in protecting what exists there is nearly impossible. And so I think, I just use that as an example, it might not be the most extreme one, but I think there's a lot of versions of this where there's a theoretical, obvious move a company should make to get themselves in a stronger position to move up the value chain, move out of this sort of like token eating into your margin problem and actually solve the customers to problem.

34:17Don't just provide them a tool, solve the problem, but it's actually a lot harder to execute than it sounds. And so there's part of what we're betting on with Dragonfly that actually starting with the services business and turning them into an AI native business is probably faster and easier than taking a piece of technology and trying to turn it into a service delivery business.

34:41Georgie Healy: You don't hear that take often. I like it. Yeah. I mean, people have been attuned over the last decade or so that software is where the value's at. It's where the multiples are at. It's where the scalability is. And I think that is becoming less and less true, that it's really hard to build defensibility in software alone, that there's a lot of competition and sort of replication. You build something, someone else builds it the next week. And so I think we're at a tipping point where a lot of the things that were true over the last decade will cease to be true in the following decade. I have never been more important with my charisma, I will tell you.

35:21Georgie Healy: I was so sad I couldn't code, then I was like oh my gosh I did chemical engineering not software my career is over and I'm like back in the game okay so I went so deep on the Chinese AI models because we knew about DeepSeek that that changed the game in terms of wow you can do a lot more with less but with Moonshot AI and their Kimi models and that there's just so many Chinese models I read somewhere that there's a new Kimi model every 10 weeks or something crazy like that when you're when you're looking for businesses to buy and they're private, what is your recommendation? Open source? Start somewhere, we'll work our way through.

36:04This is like such an amazing, look, I think my overarching advice to people is do not get yourself trapped in being stuck with any particular model provider or approach. Like we're in such the early phases, we've seen the back and forth between even the frontier labs in terms of who's leading, who's most cost effective, who's better at what.

36:29Georgie Healy: Yeah, Ben, I keep changing my stickers. It was OpenAI, now it's flawed. You know, if you build your whole organisation around one model, you very quickly could be stuck with the most expensive, the least capable or whatever. And I think open source just broadens that continuum of options that you have. There are more complications with the sort of open source models that I do think you need a bit more technical depth and understanding around how to use them, how to put some of these guardrails. And so they're a little less user friendly, but extraordinarily powerful. And I think at the moment they're like a quarter to a third of all tokens are going through open source models.

37:10I think that's only going to increase. Like I think there's a lot of companies that are mostly focused on building out capabilities first and then we'll think about optimizing cost second. And open source has a really key role to play in that cost optimization.

37:27Georgie Healy: I read that Kimi K3, I know we've got Opus 5 now, but it was a quarter the cost and similar benchmarking to Opus 4.8. It's like, what are we doing? I mean, there's some important nuance there around, A, there's a lot of accusations around, are they distilling these models? Are they benefiting from them? I think certainly in the past that has been the case. Whether that's ethical or not, I think sort of put that to the side. I think it's certainly helping them catch up. And then the other thing that sort of isn't reported as much is the benchmarks can be a little misleading. in that one of the things that if you sort of look at the real world use of these models is these models are hyper optimized for the benchmarks that they're trying to appear much better than they are and then when you look at their sort of real world usage it drops off it's much more spiky and then it's really good in certain things and then much worse in others where because the frontier models are getting so much usage they're pretty well-rounded in terms of the frontier of their capabilities.

38:33And so the headline numbers don't necessarily always tell the story, the full story, but it's certainly true that they're accelerating and they're very close to the frontier and increasingly seem to be closing the gap between, you know, if they were six months behind, maybe they're three months behind now or something, but it's not far. I did try and try one of these models for myself.

38:55Georgie Healy: You can pick one of the Kimi models in GitHub. It's got the same dropdown as the Western Labs, but it's coding and I'm not a coder, so I can't really judge. Ben, how do you recommend to your companies what to do? Yes, don't be too loyalist to any one company, but high level, is there anything you tell them? Yeah. So it's really important to understand how the models perform for your business and your needs. And that means you'll hear this word evals, but basically having a set of tests that you can run the models through constantly to evaluate how they're performing relative to your specific task.

39:37And the reality is any business is made up of hundreds of different tasks and the right model for one task might not be the same model for different tasks. And so it's not even one uniform answer for a particular business. We have lots of processes we run that might have three or four different models in the same process. And so those evals are really important in knowing how it's performing, what is the quality per model, what is the cost per model, and you can make informed evidence-based decisions around those. And I think, you know, the sort of state-of-the-art company have built really sophisticated infrastructure around these evals that as soon as a new model comes out, they're able to run it through every single use case they have across the organization and flick a switch and say, we're migrating to this model for these five things.

40:25We're using it as a backup model for these three. And it's automated. They don't even need to make some sort of judgment decision around those things. It's sort of based in data and math around which models perform best. Organizations don't need to build something that sophisticated, but certainly having a sense of how do these perform in real world scenarios for my business is really important. Just because one's better on a benchmark doesn't mean it's the best model for your specific use.

40:55Georgie Healy: So well said. Even listeners will know, if you want to do your color analysis, you can use ChatGPT for that. Do you really need Fable? Like, are you burning through credits when the questions you're asking are not that critical for that? I actually have yet to see a use case for Fable. It really made sense. Have you seen any? Well, look, I think certainly we're, in that same process of sort of experimenting with how much better is it where are those gaps we're testing it as in as we should as the type of company that we are and so we're using it for a lot more sort of strategic planning architecture decision making and you know in some cases running that side by side with opus or other models to test like where does it outperform there's certain areas would actually underperform which is overthinks things and it sort of makes things more complicated maybe than it needs to be.

41:47And so that sort of fine-tuned understanding of what the character of these models are is really important.

41:55Georgie Healy: It is like a character, right? They've got personalities. They've got their own personalities. And look, I don't know if you saw, this whole open source thing has blown up in the US over the last few days. There's sort of various voices in the Trump administration on both sides saying they should be banned and Kimmy should be banned and there should be all sorts of controls. It seems like some lobbying from the frontier labs around that. A huge consortium of NVIDIA, of Google, Microsoft, who's who strongly supporting the open source ecosystem in these models. And so that opens up just a whole can of worms around what does banning these open source models really mean?

42:44what geopolitical implications of that how does a country like australia participate in that where we don't have our own frontier models the open source models can be really valuable to us from a strategic perspective if we get cut off from fable again or fable like models those open source models are really valuable and so it's going to be interesting to see how this plays out over the next few weeks, it's hard to not criticise. Everyone's kind of taking a pretty obvious self-serving position around their views on those things.

43:18Georgie Healy: Oh, no kidding. You don't want us to not spend money on US models. What if Meta became more powerful in the open source? What do you think would happen then? Because American company... I do think you've sort of got two problems wrapped together, which is this sort of closed versus open source and then US versus China. and it just so happens to have played out for a variety of different reasons that China's been the clear leader in open source models and the US has been the clear leader in closed source models and there's been various attempts in the US it's sort of half-hearted efforts to have sort of open source models but nothing that's sort of been really credibly close to the frontier for any sustained period of time.

44:03I do think one of the likely outcomes of this sort of current posture is that there'll be either incentives or more pressure for the frontier labs and hyperscalers to start producing frontier level open source models to give a bit more of an alternative to the Chinese models. And so we'll see. I think that's like a little bit TBD, but that would be my guess.

44:29Georgie Healy: So you think like Anthropic or OpenAI? Or Google or like, anyway, there's a whole bunch of them that have the talent, the compute, the resources to go do this and some of them actually the incentives to go do so. And so I wouldn't be surprised if we see more frontier-like models coming from those other players. When it happens, I'm tagging you in a LinkedIn post. Heard it here first. Yes. okay when you guys announced your business of course it was in the AFR the most prestigious paper in the country uh and it was posted on your LinkedIn and I was looking through the comments I was borderline obsessed with this one this is a great idea there are so many boomer slot businesses just sitting there what's a boomer slot business I know you didn't write it um and and another the common rhetoric in the comments was this is such an ambitious thing.

45:23Georgie Healy: Australia needs to be more ambitious like this. Do you think you guys are particularly ambitious or you just stand out comparatively? It's a good question. Let me answer that. I think we are trying to be quite ambitious in the sort of breadth and scale of what we're setting out to do. There's something like$2 trillion of services in Australia. I don't think most of it has changed in decades. we think we can put a huge dent in basically bringing that into this sort of AI native world and there's a really amazing blog post I think from Sam Altman a few years ago about doing hard things and he's basically view was I loved this it's actually easier to do hard things than it is to do easy things you can attract better people you can attract better talent it's less competitive it's worth the effort of dragging yourself through it and I think there's a lot of truth to that, that actually the more ambitious you are, the easier it is to get people excited about the mission and where you're going and what you're doing.

46:26And so I think there's a lot of that that's sort of woven into Dragonfly, which is that there's no reason we can't be maximally ambitious around the impact we want to have on the Australian and global ecosystem. I think there's a lot of ambitious people here in Australia. I think there's a bit of a density problem that they're kind of scattered all over the place and you kind of have to find them and they're not all concentrated in the places that you would expect in a way that the US kind of does. And the broader sort of economy has been quite rewarding to people who don't take risk. It's kind of been a great ride.

47:07Property's been great. There's good, stable paying jobs. There's lots of stable sort of companies. And so I do think that over time folds into the culture and the DNA, that there's a lot more risk-taking and sort of contrarian thinking that's prevalent, particularly in the US. I think the US stands sort of head and shoulders above most of the world, all of the world in that case. But there's no reason that needs to be true. I think Australia can do amazing things. We've built some incredible companies at global scale, and we should build a

47:40Georgie Healy: lot more of them perfect follow-up around data centers this is such a hot topic then if you're on my uh instagram algorithm it's they're pure evil like they're they are actually hell on earth and nothing could be worse than to have even a single data center here but then on my linkedin it's like can we be a little bit more ambitious how are we going to compete in the future How is the economy going to survive? We don't want to hurt the environment, but let's be realist. Where do you fall? Look, I think this is super clear cut for me, which is, it's as you said, we need to have a vision for what type of country we want to be and how do we want to participate in the next 20 years of the global economy advancing.

48:29We mostly spent the last 20 years digging rocks out of the ground and sending them overseas. That's probably not the place in the world that...

48:37Georgie Healy: That's my undergrad degree, but thank you. It's probably not going to be how we want to position ourselves for the next 20 years. And I think it's important to look at what are our competitive strengths and play into those and not try and replicate what makes sense for other countries might not make sense for us. And I think we have extraordinary energy capacity for a variety of different mechanisms. We have a huge amount of space. we have a pretty sophisticated like construction ecosystem there's a ton of reasons where there's a proximity to Asia there's a whole bunch of different things that mean this is an amazing place to build these data centers we could build a real competency and expertise in these ways that you know we're not going to be building frontier models in Australia ever and so that's not going and be our path to participate in this sort of AI wave.

49:32I think the data centers is a very credible way for us to play to our strengths and solidify that. I think the superannuation capital base is another really unique feature of the Australian sort of financial system that can take long-term views and support some of that stuff. And mostly, like, if you actually look into the environmental and the pricing stuff, it's, like, totally alarmist. It's like ignores a whole bunch of facts around what's likely to actually transpire around renewables, the mix of technology, no government policy around pricing. And the same thing happened in the US. There was a lot of sort of alarmist rhetoric that I think actually the Trump administration came up with some really sensible policies around how the hyperscalers pay for the electricity they use.

50:20It doesn't disrupt the grid. If anything, it's actually feeding power back into the grid. subsidizing it.

50:26Georgie Healy: That is what they're all saying. We're going to pay more electricity bills. So that's not happening in the US? No, I'm not sure that that policy actually flowed through, but all the major tech companies have agreed to it, which is they'll build their own power. So if Microsoft's building a data center in Texas, it will build a power station next to the data center. It's totally off grid. It's not taking power away from anyone. They're actually selling extra capacity back to the grid and producing net more power. And I think it doesn't need to be that exact configuration, but I think there's lots of ways to solve that problem if you're committed to actually doing something versus just sitting on the sidelines and complaining that it's not perfect.

51:06Georgie Healy: No risk of people saying we didn't really step on the wire here. Yeah, let's go. I was sent a link to ABC Four Corners, and I knew it would end badly about how bad AI is. And data centres was one of the things. And I copied this transcript because it was such alarmist journalism that I was like, I'm just going to copy and put in Claude and be like, verify the facts, one of which was the cost of these data centres, the water usage, the power. And Claude was like, respectfully, this is assuming that you would use, you would have the poor efficiency of a very, very old 30-year-old data center, when you're building them from scratch, you would never build them in that way.

51:52Georgie Healy: And they're extrapolating in a way that's just false. Yeah, people are just cherry-picking. Like you can go find data to support whatever point of view you want. It's not exactly like the most productive going back to sort of like the search for truth. It's not exactly the most helpful way of navigating what are in some cases quite complicated topics. But I think the idea of sort of just sitting on the sideline and outsourcing basically everything to the rest of the world seems like a much more terrible path than trying to work our way through some of these problems, many of which actually could, you know, subsidize huge investment in renewables and distribution and a whole bunch of other jobs and creation around these things that come with making investments in big sort of audacious ideas.

52:44Georgie Healy: This is unfair because it's not your background. What is your thought on AI submarines, like defence and it's just a topic that seems to have really blown up lately. Yeah, look, I don't have any expertise on the sort of deep technology side of things. It does strike me as there's a set of sort of industries where Australia is a little bit sort of Goldilocks in that we're big enough to matter and have the right sort of infrastructure and rule of law and stability to sort of be a mini version of America or Europe or whatever you want to describe, but actually just much simpler in that you can move faster and cut through a lot of the sort of bureaucracy and the institutions that are there to sort of protect the way, whether it's the military apparatus or whatever.

53:37And so it's not surprising to me that there'll be a handful of these industries that Australia actually can leapfrog ahead because we have great talent, we have capital that can be put to work against these things, and we have a sort of semi-structural advantage relative to some of these bigger markets, which just move much more slowly and then release them to the world. And so without sort of being deeply familiar with the technology, it doesn't surprise me.

54:04Georgie Healy: I'm deeply familiar that they're square. For some reason, these AI subs are square. Okay, so there's three things Australia should play in. It's not frontier models. What would the three things be? That's good. So I think the data centers is a clear one. I think there's no reason we can't be one of the leaders in the application of these technologies, which is how fast can you take what's coming out of these labs and push it through the real world into the economy. And it's obviously what we're trying to do with Dragonfly, but you can think about that at a government level. You can think about some of our largest organizations.

54:42I think for many of the same reasons, we're not as stuck to hundreds of years of legacy in the way that Europe and America and stuff are. And so we should be able to move much faster. And then I think the next frontier around physical AI, there's a huge case to me. made that we can and should play a huge role in that given everything from sort of agriculture to mining, construction, these sort of heavy industries that we've built quite sophisticated capabilities in, AI is going to be radically transformative to many of these. And Australia has some of the largest, most established organisations across those.

55:24And so I think there's a real opportunity to double down in what will be the next frontier of sort of AI development. And so those would be my three.

55:32Georgie Healy: I love them. Are you ready for rapid fire? One minute questions to finish. What keeps you up at night? Look, I think there's like a crappy version of that, which is like not moving fast enough. The answer is much more nuanced than that, which is it's not just moving, but it's actually getting in the right position so that we're able to capitalize on this really unique moment in time. And I sort of think about it like a wave, which is like, you know, the wave's coming. You can see the wave. You can paddle as fast as you want, but if you paddle in the wrong direction, it's actually going to pick you up and dump you on the beach.

56:21And so it's not only the paddling fast, but paddling fast in the right direction. and I feel like that's very much this moment in time that energy does not equal strategy and there's a lot of moving pieces and fundamental truths or truths that have existed for the last decade or so that I think will no longer be true and so you do need to go back to sort of first principles and be like what do we really believe? How do we believe this will play out? And if that's true, where do we want to be in the field when this comes? And so that's like a lot to wrestle with before going to sleep, but that's definitely what keeps me up.

56:59Georgie Healy: What time do you go to bed? And also a very Bridgewater response to you. That is much longer than a minute, Ben. Thank you. Queenslander. Who are the people most at risk of job disruption? What should they do? It's a good question. You usually see this come out as like lists of jobs that are going to be replaced or not replaced. I actually just don't think it cuts that way. I think what AI is really changing is people with agency to go and create and build and do something different are going to be extraordinary beneficiaries of this, whether you're a doctor, whether you're a mathematician, whether you're any construction worker, you're going to be hugely beneficial for this because there's just this inflection point that allows you to scale your capabilities in ways you never could.

57:50and if you're sort of predisposed to just sort of putting your head down and like doing your job and not really rocking the boat and not really asking questions I think you're going to very quickly be commoditized out and so to me it's much less about which jobs they're all going to change pretty drastically it's really about how people approach those circumstances which is going to change the outcomes. Reminds me have you been to the dentist lately?

58:18Georgie Healy: My news is AI. Yeah, they should. Have you? I have not. And maybe I need a new dentist. Oh, this was fantastic because he even showed on the screen. He asked permission, but he had a Rode microphone. I was like, okay, content girly. And he was like explaining exactly what he was doing as he was like going through each individual tooth. I could see it transcribed. I learned a lot as a patient. Yeah. Fantastic. Exactly. And how the last 20 years before that, that experience had basically been exactly the same. And so that's like a perfect example where we're just hitting this inflection point, whereas a lot of these legacy industries hadn't really changed, are going to fundamentally change over a really small period of time.

59:00Georgie Healy: Yeah. It feels like the last time I went nothing and now it's all AI. Incredible. Is there anything you believed about AI two years ago? You know, you've been in AI for over 10 years technically, that now you fundamentally are like, oof, I got that wrong. I think the technology has developed faster than I imagined and that the pull through has been much slower than I imagined. That I sort of thought the technology would come up a little bit slower, like the leaps and bounds we're still seeing now. It was kind of crazy last year as we were talking about, have we hit a wall? The ceiling, yeah. And it's, I think, pretty clear that there's not any wall on the horizon.

59:45But when you actually look inside these businesses, nothing's changed. And I think that, like in hindsight, it was kind of obvious. But at the time, I certainly would, if you maybe bet, I would have bet that there would have been more sort of real world impact. And so I think that's probably one thing that's definitely evolved and, you know, it's part of why we're doing what we're doing. I was speaking to someone yesterday about you can show someone how amazing AI is.

1:00:12Georgie Healy: They still won't use it if they don't want to. and that weirds me out. That weirds me out. Yeah. Listen to the show. Last question. What does an Australian services company look like in five years if they didn't listen to this podcast?

1:00:32Georgie Healy: Or speak to you? I don't think there's some like tsunami event that is like, it just wipes all these companies out. Like, I just don't think it's going to sort of transpire in that way. I do think this just slowly but surely going to fall further and further behind, which is, you know, their ability to serve their customers is going to fall further and further behind sort of state of the art. I think their employees are going to be less and less empowered to go be their best people. That means the best people are going to leave. That's going to then mean that, like, the service drops even further.

1:01:11And so it's going to be this like slow erosion of competitive advantage that will sort of play out over a period of time. But once that's happened, it's kind of impossible to catch back up again. It's like pretty hard to attract great people into a sinking ship. You don't, you know, you're sort of losing market share. And so you can't invest in the same way you could. And so while I don't think it's too late, there's definitely a window of time where if you don't sort of get on board and start moving, it's going to be really hard to catch up.

1:01:43Georgie Healy: Beautifully said. How do people find you? How do they discover Dragonfly? Dragonfly.com.au and Ben at dragonfly.com.au. Love your blog. Love what you're doing. Thank you for being on the show. Thanks for having me. Thank you so much for listening to In the Blink of AI. If you want to go deeper on anything we've spoken about today. I write a weekly substat called Attention is All I Need. Yes, it's hilarious. It's a pun. And essentially, I go into AI rants, tech news, events I'm going to, and more. It's bite-sized, and I hear it's awesome. The link is in the show notes below.