In short
Podcast Episode Notes: Dust’s Gabriel Hubert and Stanislas Polu: Getting the Most From AI With Multiple Custom Agents
Episode Summary In this episode of *Training Data*, hosts Konstantine Buhler and Pat Grady interview Gabriel Hubert and Stanislas Polu, the co-founders of Dust. The conversation revolves around their belief in the integration of multiple AI models, unlocking AI's potential through proprietary data, and the vital role of human capabilities in the AI landscape.
Key Topics Discussed
- Introduction
- Brief introduction of the host and guests.
- Dust's founding vision that one AI model will not suffice for all use cases.
- One Model Will Not Rule Them All (02:16)
- The co-founders argue that multiple AI models will be necessary to cater to different use cases, asserting that integrating models will maximize AI assistants' value.
- Reasoning Breakthroughs (07:15)
- Focus on the need for significant advancements in AI reasoning capabilities, which have been relatively stagnant.
- Discussion on whether current models can achieve higher reasoning or if breakthroughs are needed.
- Trends in AI Models (11:15)
- Acknowledgment of the emerging competition among AI models and the importance of being able to switch models based on specific requirements.
- The Future of the Open Source Ecosystem (13:32)
- Exploration of the potential for open-source models to either surpass or lag behind proprietary models.
- Discussion on how the evolving model landscape could impact business and tech sectors.
- Model Quality and Performance (16:16)
- Insights into what makes certain models perform better than others and the implications for users and businesses.
- "No GPUs Before PMF" (21:44)
- Emphasis on the approach of not investing heavily in hardware until product-market fit (PMF) is established.
- Dust in Action (27:24)
- Real-world applications of Dust’s AI helpers, showcasing its flexibility and adaptability across industries.
- Finding "The Makers" (37:40)
- Discussion on identifying innovative users within organizations who are eager to explore and implement AI solutions.
- Core Beliefs of Dust (42:36)
- Overview of Dust's foundational beliefs, including focusing on product development, enhancing human capabilities, and maintaining human oversight in AI.
- Second-Time Founders (50:03)
- Reflections on the lessons learned from their previous entrepreneurial experiences and how these inform their current work with Dust.
- Lightning Round (56:15)
- Quick-fire questions covering predictions, admiration for influential figures in AI, and thoughts on the French AI ecosystem.
Key Takeaways
- Multi-Model Integration: The future of AI lies in the ability to integrate various models rather than relying on a singular solution.
- Human Augmentation: AI should enhance rather than replace human capabilities, ensuring that human insight remains integral to decision-making processes.
- Data Privacy: Proprietary data management is crucial for leveraging AI effectively while maintaining user trust and security.
- Open Source vs. Proprietary Models: The dynamic between open-source and proprietary models continues to evolve, with the potential for either to dominate based on technological advancements and accessibility.
- Enterprise Adaptation: Organizations need to embrace a culture of experimentation and adaptability to fully utilize the potential of AI, fostering an environment where users can explore and innovate.
Conclusion The discussion emphasizes the transformative potential of AI when effectively integrated into various workflows, with a strong focus on human collaboration. Dust's approach combines innovative technology with a commitment to enhancing workplace productivity through tailored AI solutions.
---
*Note: This summary provides an overview of the discussions and insights shared during the podcast episode featuring the co-founders of Dust.*
Written by AI. May contain mistakes. Listen to the episode to check what was said.
Transcript
Automatic transcript. May contain errors.0:00We've asked the entire world to move from calculator technology, punch the same keys, you'll get the same result, to stochastic technology. Ask the same question, you'll get a slightly different result. This has not happened. This is the biggest shift in the use of the tools that we have since the advent of the computer. We're asking an entire cohort of the workforce to move to a stochastic mindset. And the only way you get that is by having a risk reward ratio that you're comfortable enough. It's like, you know what? I'm not asking it to be right 100 % of the time. I'm asking it, you've me a draft, that saves me time, many, many, many times over.
0:33And that distribution of ROI is something that I'm comfortable exploring with and it's trading on. And I think that that is really one of the predictors that we see in people who've tried to add GPT, or in people who are just curious with new technology is they expect that some of it's going to be a bit broken, but the upside scenario to them is so clear and so 10x that they're willing to make that trade off or that local risk to get things started.
1:11Welcome to Training Data. This week we welcome Gabriel Hubert and Stanislaus Polu, the co -founders of Dust, a unified product to build, share, and deploy personalized AI assistance at work. Founded in early 2023, after spending years at Stripe and OpenAI, Second Time Founders Gabe and Stan started dust with the view that one model will not rule them all, and that multi -model integration will be key to getting the most value out of AI systems. They were early to be convinced that access to the proprietary data you have in Data Silos will be key to unlocking the full power of AI, and they know that you want to keep that data private.
1:51it. We've worked together for 18 months and their predictions have been consistently pressioned. So today we decided to ask them about those predictions. We'll get into their perspective on how they see the model landscape evolving, on the importance of product focus over building proprietary models, and on how AI can augment rather than replace human capabilities. Stan Gabriel, welcome to Trading Data. Thank you. Glad to be here. Yeah, thanks Constantine. Super happy to be here. Guys, first thing that I want to ask is you started this company in early 2023. At the time, it seemed like one model might rule them all.
2:31And that model at the time was, they used GBG 3 .5, I don't know if four had yet come out, but that was way ahead of the curve and people were super blown away. You guys came out with a pretty contrarian view that there actually would be many models and that the abilities stood to those together and do advanced workflows on top of that would be important. So far you've been completely right. How did you get the confidence to make that decision a year and a half ago? Yeah, I think on the model parts, it was clear that many labs were already emerging. It was not clear from the general audience, but for the people that knew the dynamics of the market, it was called many labs who are emerging.
3:12And I think it was kind of natural to us that there would be competition in that space and as a result, that would be valuing and enabling people to quickly switch from one model to another to get the best value depending on their use cases. Yeah, and I think from the user standpoint, the point on being able to quickly evaluate and compare is obviously important. Looking ahead or already at some of the conversations we're having, it seems that the levels of scrutiny, security, sensitivity of the data that's being processed may also influence some different use cases. And so we're excitingly seeing people thinking about running smaller models on device for some use cases.
3:53And you can imagine a world where you want to be able to switch between an API call to a frontier model for something that's less sensitive, absolutely crucial to get like cutting edge reasoning capabilities for. And some smaller classification or summarization efforts that could be done locally, while the interface that you use for your agent or your assistant remains the same. And that switching requires the ability to have a layer on top of the models. You guys have been right about this every time, as you've called this out. And so many of your predictions over the past couple of years of partnership have been non -obvious and then correct.
4:31I think this is still not obvious. As in, there will be many models. You'll have some local models. You'll have some API call. And then you actually, as a customer, want to choose between them or want to have some control. First of all, why do you think that will be, as in why will there be multiple models? Secondly, why doesn't that get abstracted away by some sort of router mechanism, some hyperbizery layer, and does that happen? And would you be that hyperbizery layer? Yeah, help me understand that. I think there's really two modes of operation in FreeSync a bit of future. So it's a bi -modal distribution, basically, of the future.
5:12There's one where the technology, as it stands today, keeps progressing rapidly. In which case, there's still going to be competition from rather big labs, because there's a way in critical need for GPUs to build those louder and louder models, because the only way we know to get those model better today is mostly by scale. In that world, this kind of dynamic of being able to switch to the best model at time T will remain true for a long time, I guess, until we reach whatever it is. that is at the end of that dynamic. And then there's the hypothesis and we can talk about that later in more details that the hypothesis of maybe the technology plateauing.
5:49And in which case, it's not going to be one model. It's going to be a Gaussian model and eventually everybody will get this the model and eventually on your MacBook M6, you'll be able to train a GPT -6 in a few hours in a couple years. And then the kind of router, the router need those kind of disappear is because the technology is really computerized in terms of just producing the tokens and every company will have that own model. We would have our own model in that world. Well, we got to push you on that. So you're building a business where you sort of win, regardless of which one of those worlds we go into.
6:24Which one of those worlds do you think we're going into? This one is definitely tricky. I mean, it's interesting because so in terms of capabilities of the models we've seen or had the perception that the question was moving very quickly over the past two years, which is in larger context, support for audio, support for image and stuff. But at the same time, the one core thing that matters for changing the world is the resonating capabilities of those models, right? And the current resonating capabilities of those models has been actually pretty flat over the past two years. They are at the level of GT4 as the end of its training, which is roughly slightly over two years ago if I remember correctly for the end of the internal training of the Pnei.
7:09And so that means that over the past two years, in terms of reasoning capabilities, it's been somewhat flat. Well, so hang on. So there's the Kevin Scott point of view, which is there's actually exponential progress, but you only get to sample that progress every so often. And so in the absence of a recent sample, people interpret it as having been flat, when in fact there's just sample bias, you can't see it. So do you, do you, do you subscribe, is right, you think there's actually exponential progress we just haven't gotten to see it yet? Or do you think it's actually like asymptoting and reasoning breakthroughs have not progressed at the rate one might hope?
7:41As far as I'm concerned, I have a strong feeling that it's it hasn't been moving as fast as I would have expected in my most optimistic views of the technology and so that's why I'm I'm I'm lowering myself to ask the question any or simply consider the difference scenarios. What I think only are predictions for 2024 also is that we would have a major reasoning breakthrough. Do you think it's coming? Yeah, it's going to be a tough one because this one hasn't come for sure, and even GPT -5 or GPT -N plus one or Crude N plus one, it doesn't matter who cracks that first, hasn't come yet. And there's many reasons to believe, it might not be a core technological limitation.
8:24You can make many hypotheses as to why it might maybe the case that it takes time. The scale of the clusters required to train the next duration of model is humongous, and it involves a lot of complexity from an infrastructure and really programming standpoints, because GPU fails when you scale to that many GPUs, per cluster, they fail pretty much all the time. All the training is very synchronous across a cluster, and so it may just be the case that's scaling up to the next order of magnitude of GPUs needed is just very, very, very hard. And that wouldn't be kind of a inherent limitation. It's just a phase where we learn how to go from red one to red five, but for GPUs basically.
9:05Stan, you were at OpenAI at a pretty critical point in time. So people know you from the dust experience, but one thing that I have to be remember about Stan is you were a critical researcher at OpenAI from 2019 through late 2022. you got a bunch of wonderful publications. Some of them relate to mathematics and AI. You worked on these with Ilya Sitzkiver and the crew at OpenAI. Do you think that mathematics will be essential to this type of reasoning breakthrough or is it orthogonal? That's something that we're actually going to learn on textual language data? I remember quite convinced that it's a great environment to study and it was a thesis that we added time with Guillem Lamp, then funded Mistral, he was working at Fair on exactly the same subjects and our motivation was exactly, it was really shared as time we re -wear frenemies competing in the workspace, three friends by the ideas.
10:05I think the idea there was that mathematics and in particular in its form of formal mathematics that gives you perfect verification is a very unique environment study reasoning capabilities and to push reasoning capabilities because you have a verifier so you're not constrained by being able to verify the prediction of the model that an informal setup would require humans checking them to some extent. And so that very bit is probably something that has to unlock something at some point. You know, it doesn't yet for many reasons, but at some point it shouldn't lock so I'm and remain extremely bullish on the mass and formal mass and LM studies.
10:48Yeah, remember one of the ways you were presenting as me when I was still very much ramping up was your maths is the door to software, software is also the rest and started with some of the critical systems that were the very only ones to have been hand proven and hand verified as an example of how much more costly it was to do by hand than do it by machine. And an indication of the future gains we could expect from being able to extend that and democratize that. You guys see a lot of action through the dust API calls. When you build a dust assistant, you're able to choose what type of underlying model to use.
11:22You're able to call many different models. Me as a user, I often call not just a Cod3, but I call GPT4 and I call the dust assistant, and I call in my custom assistance, I select one of many options. What have you guys seen in terms of trends? What's performing really well? I've personally been super impressed by the ontropic models as of late But you guys have a much closer review of that. I think the I mean, so a word of caveat on on trends, you know You're gonna have the usual cognitive biases the grass is always greener people are gonna want to switch Just to see what it looks like on the other side And so when you're observing those switches, you're not necessarily observing a conviction that the bottle on the other side is better you're observing the commission people want to try.
12:10But it is true, we've gotten great feedback on Claude's latest sonnet release. And empirically, we're seeing some stickiness on that model in our user base. I think that word on the street is, for some coding application, Kurt Strailer is actually performing very, very well. We haven't yet made it available through dust. but what it's just to do. Ah, there we go, sorry. See, this is the thing you get for renecmebrancesco and waking up to do a recording at seven o 'clock in the morning. So yeah, Coach Stroudle apparently is really interesting on some cutting capabilities. And then you have to mix it in with the actual experience that people are getting.
12:53So reasoning cannot be fully made independent from latency. Latency at some points last year could be basically a way to tell the time in San Francisco, you could see leads and see literally in the API as people waking up on the West Coast. So people have use cases that may be more or less tolerant of those. We cover the Gemini models and Throbics models OpenAI as an investor right now. And we have seen some interest in moving away from the default, which when we first launched were OpenAI's models, not to say that 4 -O isn't performing very well. Over the past year, there's been a lot of enthusiasm about open source models.
13:36And it's actually one of your predictions. Stan, you have these great predictions every year about AI. I always really enjoy reading them. One of them was that at some point this year, an open source model, the brief lead for LLM quality. That doesn't seem to have happened yet. And it also seems like the enthusiasm around, not the enthusiasm around, but rather the the lead slash acceleration of the open source models in comparison to the closed source models has maybe slowed down a little bit, maybe back to that Kevin Scott point about we're sampling it discrete times, as opposed to continuous times, we just haven't seen it yet.
14:11But where do you think the open source ecosystem is gonna go? Will it actually at some point surpass the closed source ecosystem? I mean, that remains that, that, that, that echoes with what we say earlier, it's really in that by -model distribution, there's one distribution where open source goes nowhere and there's one distribution where open source wins the whole thing, right? Because if the technology plateaus open source obviously catches up and eventually everybody can train there, their high quality model themselves and at that point there is no value in going for a proprietary model. So I think there's a scenario where open source really is the winner at the end, which would be a fun turn of event obviously.
14:55And then in the current dynamic, it's true that OpenSus has been lagging behind so far. Obviously there's I think the one that has to be called out is really Facebook or Meta I thought because they have what it takes to try next -gen model and so far it's been releasing every model very openly. And so that's exciting to see what will come out of them in those next four months to maybe make the prediction true. The caveat to that is that assuming the best model are the largest, which is a somewhat safe assumption yet it can be discussed. It means that that model will be humongous to some extent.
15:39And so that means that even if it's open source, nobody will be able to make it run, right? It'll just cost too much money. You'll need AGB is just to do in France. And so that will really trump the usage of those models, even if they're better in the current state of affairs in terms of costs of running them. It's a point for a consumption that's interesting because that means that you might still have a world where there's a lot of API -based inference, demand for API -based inference, regardless of whether the model on the other end is controlled, hosted, open weights, whatever. and just because of the technical abilities to fulfill that.
16:16One of your founding assumptions kind of related to model quality and model performance, and this goes back almost two years now, was that even as of two years ago, the models were powerful enough and potentially economically viable enough that you could unlock a huge range of unique and compelling applications on top, and that the bottleneck even at that point was not necessarily model quality so much as product and engineering that can happen on top of the model. I don't know if that's a consensus point of view today. You know, we still hear a lot of people who are sort of waiting for the models to get better.
16:53For what it's worth, we happen to agree with you, but the question is, what did you see in 2022 that gave you that point of view? And if we fast forward to today, what has your lived experience been, deploying this stuff into the enterprise in terms of where are the product and engineering unlocks? that need to happen to bring this up to fruition. My trigger point for for living OpenAI was seeing and playing with GP4 and it is it was coming from two very contradictory motivations. The first was I said GP4, it is crazy useful. Nobody knows about it, nobody can use it yet, and still it exists. And literally it's almost already in the API.
17:37I mean, at the time, it was 2p3 .5 in the API, which was kind of a slightly smaller version of GP4, become the same trained data. It was a crazy good follow, which was basically codex, the base model. And it was much better than ChatGPD. It was available in the API. And yet, the AR of OpenAI was ridiculously small at the time, like in existence, by all standards of what we see today. And so that was kind of the motivation. And that was mixed with the fact that I was starting to feel the, I mean, I had the intuition that it would be hard to. In vents. An artificial mathematician with the current technology.
18:25And so I was kind of seeing not a dead end, but a very long pass slow pass forward on what I was working on and at the same time was seeing the utility of those models already when you use them for your day -to -day tasks. So that was first motivation. And the very contradictory motivation that I shared with Gabriol at the time was if that technology goes all the way to H .I., it's the last train to build a company. So we better do it right now because otherwise next time it's going to be machines. And I absolutely didn't answer your question, but I like Gabriel, I'm sorry, I think what got me excited and when we did start brainstorming on the ways to deploy this raw capability in the world, where it made sense to dig was one insight on some of the limitations of the high -brown fine -tuning at the time.
19:21People were talking a lot about fine tuning, a lot of consultancy firms were selling a lot of slides that were essentially telling big companies to spend a lot of money fine tuning. And the two things that cut it for me was Dan saying, you know, one, it's expensive and you do it regularly and nobody knows that they'll have to do it regularly. And two, it's really not the right idea for most of the things people are excited to fine tune on. And in particular, fine tuning on your company's data is a bad idea, as opposed to maybe sometimes fine tuning on some specific tasks where you can see gains.
19:53But the idea that bringing the context of a company, which is obviously every real company's obsession, like how does this work for me? How do I get it to work the way I like it to work? Was going to happen with technologies that weren't just changing the model itself, but rather controlling the data it has access to, controlling the data any of its users have access to. And those are somewhat hybrid models between New World and Old World. The very Old World version of it is, you know, the keyholders are still the same. The CSOs, the one deciding how new technologies exposed to members of a company, the guardrails that are in place, the observability that's available to the teams to measure its impact and any data leaks.
20:32Those are old software problems, but they still need to be rolled out on very new interfaces, because the interfaces now are these, you know, assistants, these agents. And then some of the new problems are around access controls. Does access controls look and feel the same in a world where you have half of the actions done by non -humans? Now, I might want to have access to a file. That's like 2020. Like, do I have access to the file? Yes or no? In 2024, it's like, well, maybe an assistant might have access to the file and can give me a summary of it that leaves out some of the critical information I should not have access to, but still gives me access to some of the decision points that are important for me to move on with my job.
21:13And that set of primitives, that set of nuances, just doesn't really exist in how documents are stored today. So if you think about deploying the capability in a real world environment, where people are still going to have to phase those controls and those guardrails, the product layer is actually very thick. The application layer to build the logic and the usability to ensure performance but also adoption is quite thick. And that was the, I think that was the go to say, all right, there's a lot to do here when I get started. Maybe you can dig into that because when we intersected in you to 2023, you won Q2 2023, a lot of people were still starting this foundation model companies.
21:54And you guys had a very specific opinion, which is the future is application layer. And there's going to be a lot going on under the hood, and we're just gonna be an abstraction layer on top of that and let things happen as it see as it happens We're going to succeed in any case by building something that people actually used and love first. How'd you have the conviction for that? secondly How has that been playing out? What has been the hard part about it? You mentioned the CSOs and the enterprise and enterprise deployments You guys have been way ahead of the curve on Ragn I mean ever was talking about fine tuning, but you guys have done so much in terms of of retrieving, it was just before it was even called that, really.
22:33Retrieving and actually making smart decisions around information, walk us through the step -by -step of from the idea of application layer to where you are today. You can imagine the application layer conviction existing in a world where you still decide to build a frontier model. The reason we split that too is one, it seemed like a lot of money for a lot of risk. And I mean a lot of money for a lot of risk to try and develop a frontier model or an equivalent to a frontier model, and also make a bet on the way it was going to be distributed. And it's, so our internal slogan was no GPUs before PMF.
23:09We don't see the value in training our own model until we actually know which use cases it's going to get deployed on. And there are much cheaper ways to explore and confirm which use cases are actually going to make most of value and generate most of the engagement. The second reason was really about this data contradiction, like the fact that the cut -off dates for training on internet data are hard to set continuously. The fact that you can't actually get an internal understanding of what happened last week in a frontier model means that fine tuning is a hard problem, that it is not a solved problem at scale.
23:48And so if you walk from that conviction backwards, that means that there are many cases where it's not solved. So another technology has to be the one to deliver most of the games. And extracting a small piece of context from documents where it lives, feeding it into the scenario, the workflow that you need help for. The one trend that seemed interesting was that actually many decisions require limited amounts of context and information to be greatly improved. So the context windows at the time that were as small were already compatible with some scenarios of saying let's just bring the information in.
24:27And what we've seen over the last year of course is the increase in size of those context windows which just makes it easier to expose all the right data, no more than the right data hopefully, to the reasoning capabilities of the frontier model. And what we've experienced is first of all it takes time for people to understand those distinctions. It's hard and you have to get yourself out of your own bubble regularly to realize that it's true. The world, the future isn't quite evenly distributed yet. And people have varying assumptions on what it means to roll out AI internally or roll out the capabilities of these frontier models on their workflows.
25:06And you have to walk them back on what they really care about, which is always very simple things. I want to work faster. I want to know the stuff that I'm missing out on, I want to be more productive or more efficient in some tasks that I find repetitive. And then only bring the explanation of what technology is going to solve that when it's absolutely necessary, because people will worry about their experience and how they feel about it more than how it's working under the hood, 99 % the time. The big insight that's happened and that I think we're leaning into, we have been for a while and it's great to see some of the market also doing that is, people are actually really good at recognizing which tool they need in the toolbox.
25:46I think we've not respected users enough in saying you need a single user that does absolutely everything. And the routing problem should be completely abstracted from you. You should ask this question to the one Oracle and the Oracle will reply. People are pretty comfortable telling a screwdriver from a hammer. And when they want to get to work and they need a screwdriver, they're very, very disappointed with one that gets a hammer and it sounds like a hammer response. And so specializing agent, specializing assistants and making that easy to do, design, deploy, monitor, iterate on, improve, all those verbs that require service.
26:18It was quickly apparent to us that people were very comfortable with that. And so the number one question that made us feel like we had an insight to hang on to an alien in on was, everybody asking us about dust was obsessed with the top use case. And it's like, what are people using it most for? What is the top use case across companies? And I can almost see the Amazon eyes trying to decide which diapers .com they're going to verticalize and integrate. Which verticalize use case we now just build as a specialized version of this. But I think the full story is fragmentation. I think the story is like giving the tools to a team or to a company to see opportunities for workflows to be improved on, augmented, and understanding the Lego bricks that are going to help them do that.
Read the full transcript
27:03So rather than encapsulate the technological breaks that are useful and abstract them away from users, exposing them at the right level gives people a ton more autonomy and ready for the ability to design things that we had never thought of. Some of the scenarios that would come up, we literally cannot imagine that sounds. That idea makes sense like the fragmentation and providing people with a Lego blocks to see what sort of use cases emerge. just to make it a little bit real though, can you share a couple of use cases that you've seen in your customer base that have been unique or surprising or particularly valuable, just something to make it a little more tangible?
27:39There's obviously a ton that people are thinking about. The category of obvious use cases that have been interestingly and quickly deployed are enablement of sales teams, support teams, marketing teams. And that is essentially context retrieval and content generation. So I need to answer a ticket. You know, I need to understand what the answer to the ticket is and generate a draft to the ticket. I need to talk to a customer. I need to understand which vertical they're in and how our product solves their problems and draft and you may not follow up on their objections. I need to prepare a blog post to show how we're differentiated from the market.
28:16Again, like I'm going to go and plow into what makes us special and generate with our tone of voice. Those were pretty obvious and quite expected. What I've been excited about is to see two types of things, one very individual assistance, personal coaches. People generally actually quite young people in their first years of career asking for advice on a weekly, on a daily basis. How did I do today versus my goals where do you think I should focus my attention in the coming days? Can you actually break down my interactions on Slack and in notion over the past couple of days and say where I could have been more precise?
28:50I'm getting the feedback that I'm sometimes talking to theoretically. Can you point out the ways in which I can improve on that in these two notes that I'm about to send? And so that's exciting because our bet was, you know, we want to make everybody a builder. We want to make everybody able to see that it's not that hard to get started. And by reducing the activation energy there to see the small gains immediately, rather than wait for the next model or the next version that's going to really solve everything for them. And personally, this case has been great for that. The second family of use cases that I'm excited by are essentially cross -functional.
29:24So where the data silos exist because the functions don't speak the same, they speak the same language, but they don't speak the same language. And so understanding what's happened in the code base when you don't know how to code is powerful. Having an assistant translate into plain English, what the last pull request that's been merged does is powerful. It's powerful to people that were blocked in their work, didn't know who they should bug to actually get an update, so marketing to engineering, sales to engineering. The other scenarios already, extracting technical information from a long sales call is powerful because it means that the engineer doesn't need the abstraction of a PMM or a PM to get nuggets from the last call with a key account.
30:09They can just actually focus the attention of an assistant on that type of content, on their own project and get those updates. So I'd say that's the family of assistants that we're excited by because they really represent, I think the future of how we'd love fast -moving, well -performing companies to work, where the data that is useful to you and the decisions you should make is always accessible. You don't need to worry about which function to decide it on it or create it, you can access it. And that fluidity of information flowing through the company helps you make better and faster decisions day and day out.
30:44Yeah, any other examples that I'm missing, Stan, that you think you're excited about? No, I think what I wanted to add is the fact that, as you said, the usage is extremely fragmented. We see over and over the same scenario, and so we have data to back that kind of a proposition, is as we built dust as a sandbox, which is makes it extremely powerful and extremely flexible, but also has the complexity of making activation of our users are not trivial because when you have an horizontal sandbox like products, you're like, yes, but forward. And so generally the pilot phase that goes with our users starts by clearly identify two cases.
31:25So they really kind of try to answer the question, what are the use cases that should care about for my company and try to identify a couple of them. And we always see the same pattern. We see first use cases get deployed, usage starts. We try to move literally to another use case. Second use case gets deployed, usage picks up a little bit more. And then we generally go through a phase where the usage is kind of flat, increasing slowly. And eventually it reaches kind of a critical mass of usage. And all of the sudden, Skyrockets do something like 70 % of the company. And that's kind of the pattern of kind of activation of our users.
32:01And the Skyrockets do 70 % the usage picks up the time. The original least case that were identified by the stakeholders become just anecdotical compared to the rest of the usage. And that's where we we feel like does provides out value. And it's very hard to know for us what are all those use case because for we have examples of company with a few hundreds of people and a few hundred assistants. And so it's just it's just hard to answer the question, what are the best use cases like? Those are great examples. And that calls to mind an analogy that I would like to try out on you guys, and you may tuk on this analogy, but this is what just showed up in my brain, which was a lot of those use cases you described, you could imagine some sort of vertical application being built around those use cases.
32:47And the analogy that comes to mind is, there are gazillion vertical applications, and yet where does a lot of work happen? Spreadsheets. Why does it happen in spreadsheets? Everybody knows how to use a spreadsheet. They're there. They're flexible. You can customize them to your heart's content. And so the knowledge that I'm wondering about is this almost like the spreadsheet of the future? You know, some of these applications may get peeled off at a vertical specific applications, but even then people are still gonna come back to the personal agent because it's just, it's there, it's available, it has access to your data, it's familiar, you know how to use it.
33:23You can build what you want quickly and simply and effectively. Like is that a reasonable analogy for what this kind of It's an amazing analogy for another thing that I'm thinking about, which is it took me the longest time to get Stan to spreadsheets when we started working together. And this is way back when this is, this is like, I don't know if it was 20 years ago, 15 years ago. And then at one point Stan uses it for something and is like, oh wow, this is kind of a cool, replant interface where you can just get the results of your functions in real time. And I was like, yeah, that's now the worst thing you say.
33:55Here's like, it's a cool, replant interface for non -engineers. I get it now. And yeah, I think it's also interesting for that. the experimentation cost is very, very low. You think about the way in which some of our customers try and describe the gains that they're experiencing or that they're seeing and their excitement for the future is some functions we've had 80 % productivity gains. Some functions we're seeing, 5 % productivity gains and we're not even sure that we're measuring them right. But we're seeing gains when the specialization of the assistant is close enough to the actual workflow that is able to augment.
34:30The distribution problem of that with a verticalized, a verticalized set of assistance is almost impossible to solve. How are you going to get that deep into that function at a time where budgets are tight decision -making on which technology is going to be a fit is sometimes complicated when sometimes that's where the performance gains are the most obvious. One of our users has seen like 8 ,000 hours a year shaved off two workflows for an expansion into a country where they decided not to have a full -time team. And so basically, sparingly some of the boring details, but like the ability to review websites, compare them to incorporation documents in a foreign language, have a policy checker that was making a certain number of checkpoints very clear to the agents that were reviewing the accounts, all in a language and in a geography that none of these people were yet familiar with because they were really exploring the country.
35:24And immediate gains, like very, very easy iteration on the first version of the assistant, two weeks to launch it into production, roll it out to three human agents that were then assisted by these assistants, and their CTO sharing, like, you know, we're seeing a north of 600 hours a month. I'm thinking our pricing's terrible, but what I'm excited by is that that case could not have been explored or discovered with a verticalized sales motion. Because I just don't know how you get to that fairly junior person in a specific team and actually are able to pitch them and deploy that quickly. Whereas if you have that common infrastructure that people understand the breaks of, not everybody knows how to do some products, not everybody knows how to do a pivot table, but everybody understands that they can just play around with the basic things and probably get help from somebody close to them.
36:17That's the other thing we've seen. the map of builders within companies, this heat map of people. What some means about it is that it's people who are just excited about iterating, exploring, and testing new stuff, which I think correlates well to high performance or high potential in the future. It's like, dust is heat seeking for potential and talents across your Palestinians, because the people using it the most, are people who are the most comfortable saying, I don't feel threatened by something that's gonna take the boring and repetitive side of my job away from me. I'm excited to have that go away and focus on the high value test.
36:51I think for this first six months, I was one of the loudest voices saying, what is that main use case? Did you guys heard many, many times? And then eventually I realized, like this is a primitive, we're talking about spreadsheets. You could talk about, frankly, a word document. You could talk about office suite. When I interface with dust, I think about it like slack. Except I'm not slacking my colleagues, I'm slacking assistants. And they actually do this kind of work for me. And I can show them the kind of work. So it feels, Pat, to your point, something like a spreadsheet meets the ergonomics of a slack as it It's brought to me as opposed to I have to go to it And that that is it took me a while to get there and now I see how the fragmentation is the power of what you're going after Well, thank you, bro I have a quick question on sort of the psychographic of your user because you're You're common that it's like heat seeking for the people who are sort of ambitious and innovative and stuff like that I don't know if you have a name for them, but let's call them the makers, the people who are not afraid to try new things and try to build stuff.
37:58Have you come up with a systematic way to find those people or do they tend to find you through word of mouth or some other thing? Because that's not LinkedIn profiles. Don't say, you know, Gabriel, maker, right? Like, I think it's a super interesting question at a couple of levels, but our mission is dual, right? So the things that predict a great outcome with dust, I'm coming out of a core and trying to think about what was most powerful about this call I had yesterday with the Chief People and Systems Officer of the company that could not stop interrupting the five minutes into my pictures.
38:30Yes, I did the talk on this. Yes, I've already read about this. I've got a blog post on this. Okay, when can I demo? Where do I put my credit card? That's calling you next week. And it's the top -down motion is enthusiasm and optimism about this technology changing most things for most people who spend most of their days in front of a computer. You need that. That's a necessary condition, because I think it unlocks three things. One, it unlocks the belief in a horizontal platform for exploration, the ability for security to be in the support of business rather than a blocker. And genuinely, sometimes, example setting.
39:05Like, we have founders and leadership teams. They're just like, how have you augmented your own workflows last week? And leadership meetings are being asked, they're doing off -sites, It's about like how are you going to get better at answering to some of your team's queries faster with us? So once you have that, then you have the right sandbox. I'd say that the right petri dish. I don't think we fully cracked the builder identification. So right now it's more like bait. It's like the products is incredibly easy to use. Anybody can create an assistant, even if they have not been labeled a builder by their organization.
39:38And it's just the sharing capabilities of their assistant that are somewhat throttled. But we can see from the way in which people explore the product, create assistance for themselves, share them with their teammates in a limited way, a great predictor of that type of personality. And if you ask me to look at LinkedIn and predict who are going to be in that family, I'd say the number one discriminator is somewhat to a degree. It's a bit ages, but like people who are maybe earlier on in their careers, who have a mix of tasks that they obviously know they can get an assistant to help with. So they have use case one just laid out for them, people who have repetitive tasks, and people who have scripted their way out of a lot of repetitive things before.
40:21Just to be explicit, we had the conversation, I think it's okay to say, it is people under 25. We were saying yesterday the power users, the people that are using this all the time at the companies are the people under 25 because they aren't set in their ways, just to be explicit. And that doesn't mean everyone. You can be 70 and constantly innovating in a new way. But in general, they don't have the pattern that they've been set to. And by the way, that's true of a lot of the next generation of productivity. Notion, which Pat works really closely with. That is a under 25 power law type business.
40:54And you know, the teammates here under 25 keep pushing me to transfer over to Notion. And it's just a different type of thinking. It feels like a very similar motion at dust. Yeah, I think that the one thing we had, the we have, which is useful, is that the immense speed of see success of ChatGPT as a now obviously world famous product has made it really easy to set up pilots by just telling teams, do you know what, send a survey out? Ask people how often they've used ChatGPT for personal use in last seven days, like rank by descending order and that's your pilot team. That's the people you want to have poke holes at, kick ties, because we've asked the entire world to move from calculator technology, punch the same keys, you'll get the same result.
41:45To stochastic technology, ask the same question, you'll get a slightly different result. This has not happened. This is the biggest shift in the use of the tools that we have since the advent of the computer. We're asking an entire cohort of the workforce to move to a stochastic mindset. And the only way you get that is by having a risk reward ratio that you're comfortable enough. You know what? I'm not asking it to be right 100 % of the time. I'm asking it to give me a draft that saves me time. Many, many, many times over. And that distribution of ROI is something that I'm comfortable exploring with and it's rating on.
42:17And I think that that is really one of the predictors that we see in people who've tried chat GPT or in people who are just curious with new technology is they expect that some of it's going to be a bit broken. but the upside scenario to them is so clear and so 10x that they're willing to make that trade -off or that local risk to get things started. So you guys have a lot of very strongly helped beliefs, internally and externally, and the good news is you've consistently been right about the strongly helped beliefs. You've named a few of them. I mean, you've talked about this shift from deterministic to stochastic way before it was mainstream.
42:52You talked about rasterization and vectorization. I think about that that can be unpacked if you'd like. It certainly would need big unpacked on the show. If we go down that rabbit hole, you talked about no GPUs versus PMF, right? Can you just walk through some of the beliefs that dust lives by? It can either be philosophical as a couple of these are or tactical, like the no GPUs before PMF. Yeah, the first one is really the continued belief that focusing on products is the right thing to do because it really feels to me like we are only scratching the surface of what we can do with those models.
43:34Right now we are starting from the conversational interface so that's why you use the Slack analogy and I really truly believe that that analogy, the Slack analogy, will not sustain in time because the way we interact with that technology will change is started with the conversation interface, but it will hand in a very different place in the machine. Basically, those models are kind of the CPUs of the computer, the APIs, and the tokens are really the bash interface. What we're doing right now is merely inventing bash scripts, and we have yet to invent the GUI, we have yet to invent multi -processing, and we have yet to invent some new things.
44:14we are really at the very beginning of what we can do from a product standpoint with step technology, whether it evolves or whether it stays like it is. One word that I think is going to be important and I feel recent news has actually helped confirm or is an interesting new drop in the bucket for is one of our product models is augmenting humans not replacing them. And it's not just a naive version of saying like we're not here to get people fired. It's really that we think there is a tremendous upside in giving people who will still have a job in five to ten years time, the best possible exoskeleton, and that it's a very different kind of company and kind of product conversation to be like, all right, how many dollars are we going to take away from your op -ex line next year versus this is the number of latent opportunities that you are not able to explore as a business because your people are dragged down in pushing like, stale slideware around or not even knowing what dependencies they have on the rest of the company.
45:18This is how much friction you've imposed on the smart people you've spent so much money hiring because half of their day or part of their week is spent doing things that we should literally not be talking about in 2024. So that's one. And the thing that comes back to the... It's the trooper. You've been saying that from the beginning, Gabriel. And in the beginning, you didn't use the word productivity. Like, you didn't want to use the word productivity. I want to know if that shifted and if so, the nuance around why you chose not to. I think productivity, there's two terms that I was hesitant on.
45:49Productivity to me sometimes feels like an optimization when there's two ways to be productive. There's doing the same things faster and there's doing just better things. And I think the mixed effect of productivity is enshrined in effort versus impact. At the end of the day, your boss is never going to be mad if you spent no time doing the things you were assigned to do but brought in the biggest deal for the company. Nobody's actually going to make any comments on that being the bad decision because I think the more you grow in your career and the more you're close to the leadership of the company and the more you realize it's not about the effort, it's really about the impact.
46:23And the impact comes in sometimes unplanned, hyperplanaried completely like left field ways where it's like, of course we need to focus on this and it's current hindsight but you need to free up time -space energy and mental cognitive space for that. The other one was Enterprise Search. I just feel like Enterprise Search is one that we didn't want to put on the website because retrieval of information is obviously a use case that people are very excited about very quickly. But we're just very convinced that looking for the document is a step that people are not particularly passionate about. Nobody wakes up in the morning and is like, I'm so happy that I'm going to get just get the right document the first time around when I do the search.
47:00People just want to get that job done, and it just so happens that using context from three different documents across seven data silos helped them get it done faster or better. And so I think the search bit is just, it's never the job to be done. Nobody really wants to search. They want to complete. They want to prove. They want to test. But the search bit is a step that we think will get abstracted and go back to Stan's point. I think that the interfaces and the experiences we have with this technology will sort have really tried to forget about what the original data source was quite fast potentially, once we've gone over the trust hurdles that exist today.
47:36The thing that this all comes back to is collaboration, collaboration between human and non -human agents. And I think projects by Anthropic are an amazing example here. We thought about co -edition last summer, we have an amazing intern from MIT with us last summer, and who spent their time working on a co -edition interface. How do you chat to an assistant to make something that you're thinking about better, whether it's an app or a project or a document or a script? And this is something that obviously the recent release by Anthropic has made very palpable to many more people. That is to me the interface and the interaction that we need to get right.
48:19And that will be in the future. So we say augmentation and we'll stick to it because I think it really helps us focus on the interfaces that help humans and non -humans make progress faster. It's gonna be about proposals. How do I get to have a human in the loop with a proposal that's written just in the right way to decide if we swipe left or swipe right on it? It's gonna be co -edition. How do I have the language of the human in front of the assistant be as easy to interpret and as you know, full proof as possible for the final project to move into its final form as quickly as possible. And so you need that interface, that interaction between the agent and the human.
49:02And you forget that when you replace too quickly. When you're focused on just replacing and removing, you've built something that is fire and forget essentially. And you'll see the gains, you'll see the dollar gains. But if you've automated 100 % of your customer support tickets, you still need the insights from what people are pissed off about. You still need to understand and have your finger on the pulse of why people are stuck. Otherwise, you're slowing down your product development efforts. And product development efforts today live and die by some of the comments that are coming in from support tickets.
49:35And so how you've made that problem go away and become like, actually, maybe cheaper, sure, but also virtual and harder to connect to, is not, I think, a super long -term view of how your product and business is going to serve your customers best. Because you still need to think about the ultimate interfaces that are going to enable the decision -making to make it better and strategic and the best option for your customers in the future. So keeping the human and the loop always. I mean, it is, human lives one way to stay at, but it is driven, this human driven. like the whole point of all of this technology that we are building is to serve humans better.
50:13And as soon as you remove that, you've made a terrible mistake because someone else was not going to do that and they're going to actually have a better experience with customers and employees and stakeholders. And then they're going to win. Obviously, the scenarios in which you're going to catch me and you're going to be like, this one, we know that humans get it wrong way more and so we should obviously replace it. And this is a complex and nuanced problem. So I'm sure there's certain areas of it where pure replacement has fully understood non -external, like with no -negative external value.
50:48But I'd venture that we're pretty poor at modeling where value is created and how it's funneled through the parts of our company today. And economists have been graded showing that when you don't price negative externalities well, we end up in a messy situation. And so this is the question that I post to leaders who are asking, what should I automate first? I'm like, well, I don't know, which parts of the company do you worry about the most? And often I just find that CEOs are panicked about what their customers say on support tickets. And so making that problem go away, making that problem less visible, might be great for some obnox conversations and your stop price could have unforeseen consequences if you haven't funneled it through in the right places.
51:27But also, I think there's so much more to do than to shave 3 % off your balance sheet. The spectrum of opportunity that you're giving your team, if there's technologies in their hands and if they're able to come up with ideas, is broader than just firing people out of their job. I'm not saying you shouldn't do that. I think I don't want dust to be perceived as naive in this ecosystem where the disruptive of nature of this technology is going to take some people's jobs away because those jobs were currently being done by humans for lack of a better alternative. I think in certain situations you could see those jobs as having been created because we were waiting for the robots, having been framed in a way that was because we were waiting for the robots.
52:13But I don't know that that's what leaders of companies are excited by. I think that the upside, the future, the way in which we need to be resilient, anti -fragile for what's to come and what our competition is going to come up in. Those are the ways in which energy and support I feel should be fueled to support teams. You guys, second time founders, you started your first company over 10 years ago. You were an early acquisition of Stripe. You guys were there super early on. What have you learned and done differently this time as second -band founders? I think really understanding that a few explosive bets are more likely to get you anywhere meaningful than over optimizing too early on on something that is still meaningless in the market.
53:02That's one thing that I think we think about differently. So like exploring versus exploiting and all those frameworks. That's one. I think the transparency that you get the trust and empowerment that you give to your team is, I don't think we were against it. It's more that we were clueless about how much more empowering you could be. So the idea, one of the best words from my stripy is was paper trail. And it was, you had two people in a card or have a conversation and then one of them would take the time to just write a paper trail in Slack or in a document. So you know what, we just had this exchange and we've moved the needle in this direction.
53:43And it saved end other humans, the time and effort to go in a meeting room or figure out that this decision has been made. And it feeds a graph network of trust and respect for your co -workers, that is, I think, second to none in how you can then just achieve more as a team. So, culturally, you need to sort of push that to begin with, because especially people who are earlier in their career will not always feel comfortable with how information should be shared. So I think that's one where we're examples and point. Big markets that you really believe in for a long time. We love technology when we started our first company like 12, 30 years ago that's like, this is great.
54:24This is amazing. These are QR codes. Everybody's going to use them. And it's like, no, we have to wait for a pandemic to sell QR codes. Okay, we'll do that next time. And so like, rolling falling in love with the technology and not really fundamentally understanding how big the business could be if it's successful and asking that question early in Unabashedly is one thing that I feel is different. So what do we kept? Our experience together. I think it's an advantage to having built a company with a person because you've explored everything. You've explored the beauty, the terrible, the joy, the pain, and you know pretty much the entire API in and out.
55:01And so that makes the animals a much more efficient co -funding, I mean co -founder interaction and co -operation. I think it's a really big and fair advantage. I think the biggest one that I think is completely different from me and that Kebra mentioned is about empowering people. It's really as a founder, it's not you. I mean, it's not to you early and it's to you to build them to build the initial spark. But then for the sake of the company, you are not the one that has to build. the other one that has to make, create an environment for people to be in public, to build those things, and explore, and create new stuff.
55:45And the best value you can give is, I don't like to use that word, that what neither shick was coming to mind. It's not necessarily the evil shitties, really guidance, and trying to create an environment where every is as the chance to do what they want. But yes, in the guided environments where it's everything works as a whole, but that wouldn't be the biggest difference in something that we learned about the electronic striped at these festivals. So guys, let's move to a lightning round. We've got a couple questions for you. All right, lightning round. Question number one, Stan, you share these predictions for where the world of AI is going on Twitter from time to time.
56:22At this moment, what is your top contrarian prediction for where the world of AI is going? And don't give me this by modal a little bit of this little bit of that. Let's hear a point of view. What's your top contrarian prediction for where the world of AI is going? I see it.
56:44It's the lightnings, I have to answer something. It's going to be tough. I think we're on a very, very, very, very tough period. How so? The excitement will go down and maybe it'll take times to get to the next stage of the technology. There's tremendous value to create, but people will not sit yet and it'll take a long time for it to diffuse through society. So there is massive amount of value to create, but it's going to be, we might have tough times in promise. Alright, short term pessimist, long term optimist. I'll tell you that. Alright, Lightning Round question number two. And this is for both of you.
57:20Who do you admire most in the world of AI? Ilya is just incredible. I've had the chance to walk with him. He's my favorite people in AI. He's extremely smart, but he's not a genius builder. He's a genius leader. He's just a visionary. And I think that's incredible. Kaparti, I know him. I actually don't know him, but I admire him a lot. And in terms of pure genius in AI, I think it's Shimon and Jakub at Hoven AI. They have crazy last names all that people look at. But Shimon and Iaku are. I'm impressed by those who've been around for a while and are good. They're acting as good resistance and condensator elements in the system.
58:05They're just providing the friction to remain optimistic but cautiously so. And to me, one of the first, I can't remember if it was a tweet or a podcast or an article, but the hearing younger Karen should be like, you know, we can make pretty good decisions with a glass of water and a sandwich. And these things require power station -sized data sources and are not making great decisions on some things. So we we feel something is missing. And it's like elegant that he putting that back into into into perspective has been interesting to me. I guess it's hard to not cave to the hype, I think. And so in some ways, pushing for a simple ideal like being open, which I think Yann account is doing quite aggressively, despite that not always probably being the easiest decision.
59:02And also saying, you know, we probably haven't solved everything all the time. is nice. And from my personal experience, the researchers that have worked for or with him have learned and taken from that quite a bit. And so that that, and it's not French, but you know, some touch of modesty, touch of temperance. I've appreciated it in my discovery of the generative side of artificial intelligence. Like after 10 years of just doing your prediction and classification from fraud and risk and onboarding its stripe and healthcare claims management and things like that. It's nice to feel like there's some people who've seen a lot, done a lot and are just questioning rather than affirming.
59:54All right, so that brings me to the third and final lightning round question. You chose a for your most admired gay real. And dust is proudly made in France. Paris has been in an epicenter, certainly an epicenter for all things AI. Your take on the Parisian ecosystem, and what do you want to say for the French founders listening to this podcast? Other than I'm starting with English, it's their fault not ours. Yeah, I think the French system is awesome because we compared to where it was 12 years or 15 years ago, it was our first company. No, we have tenants because there's been a generation of scallops that went through the market and train all that talents and most recently that kind of explosion of AI talent as well, which is super exciting.
1:00:46So I say it creates a pool of tenants and with the right conditions to create the incredible companies. Obviously, it's not, I mean, tackling the US market from France is a challenge. And so that's the thing to be beginning to work on, of course. Yeah, I think there's, if you have ambition, there's a lot more to do. And then as long as you're not naive, where there are still some realities. You can fight some aspects of narratives. You can't fight gravity. Or at least you shouldn't. You should probably work with gravity way more than you should fight it. But there's a ton more we can do. And I think we have to behave a little more like tech countries like Israel, I think, in mixing Ruthis Ambition, a recognition for where talent is and how it's already connected and has high trust's connective tissue, which I think is a great catalyst and accelerant in making great companies happen.
1:01:47But a recognition for where the markets are, where people are buying, where people are paying and how quickly people are making decisions on shifting new technologies, especially in that space. I think the biggest advice is as a French funder, if you've always been friends, you have that feeling that something magical must be happening in US. Something special that was being something special about those people. Well, I'll tell you, I've been at Strife, I've been at OpenAI, I'm working with Sikko Yaw. These are all our normal humans. You don't have any magical capabilities. it is just like us.
1:02:21And it's very important to be ambitious and believe strongly that you can make it, you can do it wherever it is from France versus the US. Wonderful. That's a good place to end it. Thank you, gentlemen. Thank you, guys.
From the publisher
Founded in early 2023 after spending years at Stripe and OpenAI, Gabriel Hubert and Stanislas Polu started Dust with the view that one model will not rule them all, and that multi-model integration will be key to getting the most value out of AI assistants. In this episode we’ll hear why they believe the proprietary data you have in silos will be key to unlocking the full power of AI, get their perspective on the evolving model landscape, and how AI can augment rather than replace human capabilities.
Hosted by: Konstantine Buhler and Pat Grady, Sequoia Capital
00:00 - Introduction
02:16 - One model will not rule them all
07:15 - Reasoning breakthroughs
11:15 - Trends in AI models
13:32 - The future of the open source ecosystem
16:16 - Model quality and performance
21:44 - “No GPUs before PMF”
27:24 - Dust in action
37:40 - How do you find “the makers”
42:36 - The beliefs Dust lives by
50:03 - Keeping the human in the loop
52:33 - Second time founders
56:15 - Lightning round




