In short
Podcast Notes: Relentless - Episode with Ali Ansari
Episode Overview
- Title: How micro1 grew from $4M to $200M revenue in a year
- Guest: Ali Ansari, Founder and CEO of MicroOne
- Focus: Discusses the rapid growth of MicroOne, a startup in the AI training data/human intelligence space, hiring practices, challenges faced, and the future of AI development.
---
Key Themes and Takeaways
Founder's Philosophy
- Injecting Risk: Ali emphasizes the need for founders to introduce risk into their companies to explore bold moves. This is crucial as it creates potential for significant rewards.
Focus Areas of Leadership
- Hiring: Critical to scaling quickly, Ali discusses the importance of recruiting the right talent efficiently.
- Product Development: Focus on building a product that meets market demand and evolves with user needs.
- Aligning Incentives: Strong emphasis on aligning short-term and long-term incentives for the team, which is vital in a rapidly changing industry.
Growth Journey
- Initial Model and Pivot: Started as a recruitment tool for tech talent before pivoting to focus on collecting human data for AI model training. This pivot was driven by discovering high demand from clients needing expert data.
Human-Centric Approach
- Expert Satisfaction: Ali stresses the importance of creating a positive experience for experts contributing data, using a "Happiness Index" to ensure their well-being and engagement with the platform.
- Building a New Job Sector: By focusing on human data, MicroOne is creating new job opportunities for experts across various fields.
Data Collection for AI
- Constantly Updated Models: Discussion on the need for high-quality, continuously updated data for AI models to improve accuracy and capabilities.
- Long-Horizon Tasks: The company looks to tackle complex tasks that require multiple steps, which current models struggle with.
Scalability Challenges
- Operational Complexity: As the company grew, scaling operations and maintaining quality service became a challenge. This involved ensuring the recruitment and training of experts was efficient and effective.
- Hiring Surge: Details on the rapid need to hire hundreds of specialized experts in short timeframes, highlighting operational strategies used to meet client demands.
---
Key Insights from Ali Ansari
- On Recruitment:
- Early heavy reliance on AI recruitment tools to manage hiring processes effectively.
- Importance of quickly adapting to client needs and demands in a rapidly changing market.
- On Product Development:
- Transitioning from a recruitment tool to a comprehensive human data collection service, emphasizing the need to evolve based on feedback and market requirements.
- On Incentive Structuring:
- Balancing short-term and long-term incentives, including unique bonuses for achieving extraordinary results, which helps keep teams motivated and aligned with company goals.
- On Creating Human-Centric AI:
- Ali envisions a future where AI is developed with human input, leading to a more sustainable and productive job sector.
- On Overcoming Challenges:
- Reflects on personal experiences and challenges faced during the company's growth, including the mental and emotional toll of significant operational decisions.
---
Conclusion Ali Ansari's insights into managing rapid growth at MicroOne reveal the complexities of navigating the fast-paced AI industry. The emphasis on human-centric approaches, risk-taking, and aligning incentives provides a framework for successful startup growth. His journey illustrates the challenges and triumphs faced by founders in the tech space, making this episode an insightful resource for aspiring entrepreneurs in similar domains.
Written by AI. May contain mistakes. Listen to the episode to check what was said.
Chapters
Tap a time to open that second in VOThe Role of Risk in Founding
0:00 to 0:42
Learn how risk-taking is essential for founders in growing a company.
“I came to the realization that the founders job is to inject as much risk as they can into the company because really no one else will.”
AI Model Development Insights
0:42 to 1:06
Discover the evolving landscape of AI models and their development.
“Today, I have the pleasure of sitting down with Ali Ansari.”
From Recruitment Tool to AI Screener
1:06 to 2:15
Understand the transition from a recruitment tool to an AI-enhanced product.
“Well, first of all, it's good to be here.”
The Early Days of MicroOne
2:15 to 3:46
Explore the initial concept and growth journey of MicroOne.
“then results in a reward model, which then connects to their policy model to improve it.”
Pivoting Towards Human Data
3:46 to 5:40
Learn about the strategic pivot towards human data in AI training.
“So this was the first version of Micro One.”
Creating a Human-Centric AI Experience
5:40 to 7:54
Discover how MicroOne prioritizes user experience in AI model training.
“And how did you actually decide to make that decision?”
Measuring Happiness in AI Trainers
7:54 to 11:00
See how MicroOne tracks and enhances the happiness of its trainers.
“But I think the way you do that is you create an exceptional experience for the humans that are actually resulting in these alignments.”
The Future of Jobs in AI Training
11:00 to 13:20
Explore the emergence of new job sectors in AI and the importance of job satisfaction.
“But the main thing is we have a form called the Are You Happy form, like literally.”
Robotics and Data Generation Challenges
13:20 to 14:00
Understand the challenges of creating datasets for robotics training.
“And so this idea of like having your skills match, but also having your be satisfied on the job is like the most important thing for us.”
Navigating the Robotics Data Landscape
14:00 to 15:00
Learn about the challenges and strategies in developing data for robotics.
“Yeah, so robotics is definitely a data vertical that we're thinking a lot about.”
Show all 44 chapters
Building Diverse Data Sets for Robotics
15:00 to 16:18
Discover the innovative methods used to collect everyday data for robotics training.
“And we're using those videos to annotate them for VLA models.”
The Challenges of Rapid Hiring in Robotics
16:18 to 18:11
Explore the complexities of hiring en masse for robotics and AI fields.
“So I think there's two kind of broad categories of robotics data.”
Operational Excellence in Human Data Services
18:11 to 20:52
Understand how operational strategies affect service quality in human data companies.
“I mean, the other way to do it would be you have to hire, it becomes a chicken and egg problem because you have to hire, you know, hundreds of doctors to interview hundreds of other doctors.”
Fostering Agency and Risk-Taking in Team Members
20:52 to 24:16
Learn how to cultivate agency and encourage risk-taking within a team.
“and you have to hire these exceptional, what's called SPLs, strategic project leads that help kind of manage these pipelines And if the hire is not a good hire, it kind of affects the relationship a good amount.”
Assessing Decision-Making Risks
24:16 to 28:00
Gain insights into how to evaluate risks associated with decision-making processes.
“I won't name him just because he's on a very confidential client.”
The Power of Bold Decisions in Business
28:00 to 28:49
Explore how making bold decisions led to a significant revenue increase.
“but I wish we've done this a lot earlier.”
Designing Incentives for Long-Term Success
28:50 to 29:47
Learn how aligning incentives can drive long-term value and growth.
“And there's been a lot of those as well.”
Balancing Short-Term and Long-Term Incentives
29:48 to 33:05
Discover the importance of both short-term and long-term incentives for team motivation.
“It's almost like you have to come up with random actions.”
Innovative Compensation Structures in Startups
33:06 to 35:00
Understand how unique compensation strategies can drive performance.
“I'd be curious to know, like, how did you come to this conclusion?”
Sustainably Hardcore: Creating a Balanced Work Culture
35:01 to 36:19
Examine how to sustain intense work culture without burning out the team.
“I think this idea of actually caring for your team's happiness, similar to how we do with our experts.”
Leading by Example: The Role of the Founder
36:20 to 38:08
Learn how founders can inspire their teams through hard work and shared experiences.
“And it sounds a bit soft, but we actually have our team, I would bet we have our team work more weekends than most teams because we don't enforce it and we try to inspire it.”
Overcoming Adversity: A Story of Resilience
38:09 to 42:00
Hear a personal story of facing a major business challenge and the lessons learned.
“But how do you kind of design your own life so that you are creating that natural feeling inside of people?”
Navigating Tough Times: The Layoff Decision
42:00 to 43:20
Learn about the emotional and strategic impact of significant layoffs on company culture.
“And I, um, I mean, it was, it was, it was as, as painful as it gets.”
Lessons from Airbnb: Focusing on Core Offerings
43:20 to 45:40
Discover how crises can lead to focusing on essential business strategies.
“This kind of reminds me, I think during COVID, Airbnb's revenue over the course of something like eight weeks dropped by 80%.”
Embracing Risk: The CEO's Dilemma
45:40 to 49:50
Understand the balance between risk-taking and fear in leadership decisions.
“And I decided that I will force myself to have the same level of risk as before.”
Intuition vs. Analysis: Decision Making Styles
49:50 to 53:00
Examine the differences between intuitive and analytical decision-making in fast-paced environments.
“case scenario, anything that you do has the worst case scenario that is really bad.”
The Role of KPIs in Rapid Growth
53:00 to 55:50
Learn how to effectively use KPIs during periods of rapid company growth.
“And for a company that is growing fast, those KPIs will likely have to change pretty much right away, like within a week, you have to keep changing them.”
Reflections on Unprecedented Growth
55:50 to 56:00
Gain insights into the challenges and emotions experienced during explosive business growth.
Navigating Rapid Growth Challenges
56:00 to 57:40
Learn how to manage stress and decision-making in an intense growth environment.
“where their KPIs actually don't really change quarter over quarter.”
Building Relationships Over Sales
57:40 to 1:01:00
Discover the importance of relationship-building in sales and client interactions.
“this and it's like the most stressful thing because you know when I'm in a certain thread and I read the thread for like 10 minutes in Slack.”
Scaling Data Collection and Team Expansion
1:01:00 to 1:05:08
Understand the strategies for scaling data collection processes and team growth.
“It's a really hard balance, especially when you raise some money.”
Hiring Strategies in Rapidly Growing Companies
1:05:08 to 1:10:00
Explore effective hiring practices to maintain a lean team while scaling.
“Like, what did that look like internally?”
Hiring Philosophy and Culture at Micro One
1:10:00 to 1:11:30
Learn how Micro One approaches hiring and its impact on company culture.
“about 60, 70, and then now we're about, you know, 80 or so.”
Flexibility in Hiring During Growth
1:11:30 to 1:12:50
Discover the balance between hiring and maintaining a lean team during growth.
“started to hire, you know, the majority of the kind of 40, 50 people that we added in 2025 were actually in the last like quarter or so of the year.”
Identifying and Addressing Constraints
1:12:50 to 1:14:20
Understand how Micro One evaluates the need for new hires versus optimizing existing processes.
“Spent about a week with the engineering team to kind of automate this function, which of course freed up this team's time to do much better things.”
Challenges of Planning in Rapid Growth
1:14:20 to 1:15:50
Explore the difficulties of long-term planning in a rapidly growing company.
“We try to do a little bit of planning and then it just ends up being, you know, we have to kind of replan similar to how the KPIs have to be kind of readjusted so many times.”
Leveraging Profitability for Future Growth
1:15:50 to 1:17:40
Learn how profitability influences business decisions and future investments.
“Um, so, you know, feel obviously feels really good to be in this position and be able to kind of determine our own, on our faith and not, not be able to, uh, if we, if we don't want to not have to raise money.”
The Future of Human Data in AI
1:17:40 to 1:19:30
Understand why human data will remain valuable in the evolving AI landscape.
“So, you know, we'll, we'll sort of, we'll look at it as a bit of a bit of a side aim, but, but not like a full focus.”
The Last Mile in AI and Its Implications
1:19:30 to 1:24:01
Discover the significance of the 'last mile' in AI and its impact on recruitment.
“Why can human data just be like a trillion dollar industry long term?”
Unlocking New Capabilities with AI
1:24:01 to 1:25:44
Learn how structured human judgment and synthetic data can unlock new capabilities in various domains.
“The third thing is as synthetic data becomes more and more relevant and useful, what that results in is every human data point becomes a lot more valuable.”
Economic Value of Structured Work
1:25:44 to 1:27:19
Explore the economic implications of structured versus unstructured data and work in industries like law.
“Lawyers, what they do in their job is they create basically unstructured data for their law firm all day, right?”
Challenges in Task Execution for AI
1:27:19 to 1:32:40
Understand the difficulties AI faces with multi-step tasks and the need for improved foundational models.
“of their time on this idea of human data.”
The Future of Enterprise AI Adoption
1:32:40 to 1:35:28
Discuss the slow adoption of AI in enterprises and the importance of contextual evaluations for successful implementation.
“And, and then, so, so there's like a bunch of questions to be answered in that, in that conversation.”
Personal Reflection on Family Sacrifice
1:35:28 to 1:36:48
Hear a heartfelt reflection on the sacrifices made by the speaker's parents in pursuit of a better life.
“What's the hardest thing you've overcome?”
Transcript
Automatic transcript. May contain errors.0:00I came to the realization that the founders job is to inject as much risk as they can into the company because really no one else will. Like upside risk? Bold moves that have pretty bad downside also. But if it works, it works well. What I focus pretty much my entire time on is three things. One is hiring, two is product, and three is aligning incentives. You have to align incentives very long term. When you're in a space that is growing so fast and three months can literally double your run rate, you actually do need short term incentives. Our recruitment team sometimes gets these like absurd bonuses if they hire like a thousand people.
0:34You know, sometimes we have a customer that is about to sign, I might tell them like, hey, if this closes, you'll double your equity. Today, I have the pleasure of sitting down with Ali Ansari. He is the founder and CEO of MicroOne. Let's start off with, I think a lot of the models today are kind of like specific versions, like GPT, you know, four or five, so on. But eventually, we're going to have like these constantly updated models. You specifically are trying to create like a super specific high quality data for constantly improving models all the time. Can you just talk about that? Yeah, absolutely.
1:06Well, first of all, it's good to be here. Thanks for having me, Ty. So I think the way that AI labs are improving their models is by picking domains to improve on and creating reward models within those domains through this notion of RL environments and connecting their policy model, which is the model that kind of serves the customers, and improving in that domain of choice. and some domains are emergent, which means as you improve in that domain, coding is one example, there's a lot of kind of other functionalities that come about that are beyond coding capabilities. But the truth is most domains are actually not so emergent.
1:51If you improve in any given domain, you'll just improve in that domain. And so what this means is that labs are having to essentially pick a very wide range of domains, finance, medical, legal, and very long tail of hundreds of other domains to build general intelligence. And the way that they do so is they create these expert level kind of data sets that then results in a reward model, which then connects to their policy model to improve it. So that's kind of the structure where researchers come up with these hypotheses of like, hey, I think this data structure is going to work. I think hopefully it will be emergent, but in most cases it won't be.
2:33And then they kind of gather that data by having a bunch of experts create the net new data that's required to improve the capabilities. You started off with just a recruiting tool for great talent. Do you want to just talk about like the early days and what the initial company idea was and then how you transitioned to the new business? Yeah. So when I was at Berkeley, I had a software development agency. Nothing special. It was very service-oriented, built websites and apps for other companies. And one of the main things we had to do is when projects would come in, I had to vet engineers and assign them to the project.
3:10So a lot of my days was spent basically interviewing engineers. So I developed this tool, this AI screener with one of the early GPTs that essentially helped me screen these engineers. and this system would essentially talk to them and have a conversation about React, Node, a bunch of other tech stacks. And then it would give me a report on how they did in those frameworks. And then the ones that did well, I would talk to them and basically save a bunch of time with interviews. And so this internal tool turned out to be the product that kind of came outside of that agency. And then that was the first version of Micro One, which we basically started to sell this you know first was AI screener but then it was this kind of end-to-end recruitment engine to other companies as a software where they would subscribe to it they would also be able to pre-vet talent really easily and then we also had this marketplace built that allowed us to essentially have a bunch of pre-vetted engineers and a bunch of product people that startups would hire from directly.
4:15So this was the first version of Micro One. And we, you know, within a year or two into building this, which was a good business. I mean, it was growing pretty fast and it was a pretty fun product to build. You know, and we realized that there's a data provider that became a customer of ours. And they essentially started to hire like hundreds of engineers from us. And we, you know, within like three weeks, it was like 700 engineers hired. And we were, you know, it was like myself and our CRO, Will, we were sitting and we're like, man, what is this company building? What the fuck is going on? Yeah, they're like really hiring a lot of engineers, like really fast.
4:55They must be building some crazy software. And it turns out, you know, this was the human data space. They were helping a lab train models on coding. So they were hiring engineers. And we were kind of entering the era, and this was like a few years ago, We were entering the era of experts that had to be hired to help with this human in the loop kind of model training. And long story short, we decided this right here is the best application of what we've built, which was the AI recruiter. And so we just went all in. It actually took a bit of time for us to go all in. I wish we had made this decision actually a bit sooner, but long story short, we ended up going all in into the human data space.
5:40And now it's the only focus. And how did you actually decide to make that decision? Because you're working on something, you know, if you're working on something for a year and a half or two years, you're kind of invested in that. What was going through your mind at the time on deciding to move and basically pivot the company towards this? Yeah. So, I mean, first of all, the amount of hires that companies in the space were doing were orders of magnitude higher than anything we've experienced before. So we were like, OK, this is definitely a great customer base. That was the first thing. The second thing was the reason why these customers came to us was because the product that we had built initially actually solved this bottleneck that they had, which is, again, recruiting experts for model training.
6:23And so it turns out the product was, even in its state a long time ago, was actually very useful already for these type of customers. And so, you know, we sort of, I don't even like to use the word pivot that much. It's more of like an iteration on a market focus. And the product itself was actually very similar to what it was even before this iteration. It was like an evolution? Yeah, it was more exactly an evolution. And of course, what that evolution meant is we continue to focus on the AI recruiter piece of our overall infrastructure as I would argue still the most important part. Because, again, still we deeply source and vet these experts.
7:04But now there's other parts of the product like data platform and performance management and we're really owning the kind of data pipelines end to end. So there's a lot more once we've done this evolution all in. But really the initial state of the product was in a kind of great place to serve this demand. You are very like focused on this idea that humans are going to basically be valuable kind of indefinitely. How have you kind of thought about designing this philosophy of like a human centric approach and making sure that the people that are on your platform are like having a great time? This is by far the number one focus we have, which is we want to make sure that the future of AI is as human as it gets.
7:46And the way to do so is, of course, they're aligning the models with humans, making sure the models are safe for humans and all of that. But I think the way you do that is you create an exceptional experience for the humans that are actually resulting in these alignments. The humans that are giving feedback to the models, creating the structured judgments that the models use to actually learn the experience they have and the way they're conveying their judgment as a result of their experience is what results in great models that are very much aligned with humans. So, you know, part of it is we want to make sure the models we built are great and safe for humanity.
8:34But the other part is we're in a position where we're able to create this massive job sector, this new job sector of experts in lots of different domains, you know, training AI. and you know now I think there's a maybe around a hundred thousand or maybe even more experts around the world and very large portion that in the US doing this job and a lot of times as their main thing actually and so as we as we create this new job sector which you know feels like an honor for us to be able to help create this job sector we need to make sure it's a really fun one and it's the right foundation yeah exactly it really a really fun one for the humans I'll be working in it.
9:13And what that means for us is, you know, we make sure that the experts that go through our process have a great recruitment experience. We build into our product this idea of maximizing the NPS score of experts as kind of one of the main things that our engineers focus on. We make sure they have an exceptional onboarding experience. And once they actually start on the job, we very closely track their, what we call happiness index, which are - Are you the first company to ever come up with a happiness index for trainers? I think so. We're actually building a model around this as well. We're calling it the N1 happiness model.
9:50And so, yeah, we're all into this. I think it's an important thing to do. One of the things I noticed is every part of your entire company, you're trying to be very analytical and figure out what are the key KPIs, almost, that you can track and measure and then improve. How did you initially come up with the human happiness index? and how do you actually measure whether or not people are happy? Initially, we came up with it because we realized that there's a lot of companies in the space that actually really undermine this. And of course, we have a lot of great competitors. Kudos to a lot of companies in the space that have done a pretty incredible job.
10:27But there are some that really don't care a lot about the experts. They really undermine their experience. And long term, this results in material impact to the company's performance, actually. So even if you take the completely kind of shareholder value approach, this matters, right? So that's the first thing. And then the second thing is, again, we want to serve our customers well. And the way we serve our customers well is by helping them train their models in the best way possible. And happy humans do that much better. So the way we track it is there's a bunch of things. But the main thing is we have a form called the Are You Happy form, like literally.
11:08And we ask them to rate their experience one to five on a bunch of different things. And we also have a bunch of kind of qualitative questions for them to fill out. And we use this in two ways. One is our project leads that are kind of owning these pipelines. they come up with a bunch of actions that help improve the happiness index. So one of those actions could be increasing the pay of folks that have told us that they are not happy with their pay. Or another one could be increasing the number of what we call HDMs, which are human data managers that are kind of helping the experts navigate this world, maybe increasing the count of them because there isn't enough support.
11:49Things like this. But the second thing is, which is what I'm really excited about, and it's actually a big focus of mine, is the M1 happiness model. We use the data from this form to predict the happiness of experts as they apply to a certain job. Essentially, when you apply to a job, of course, the main thing is we want to make sure the skills match. You need to be able to do the job well. If you're a lawyer and we have a pipeline for M &A, you need to have a lot of experience in M &A, and we deeply vet that. And so our AI match score, which basically looks at does a person fit the skills of the job, is right now entirely based on that.
12:29But what the M1 happiness model will do is it will take into account the probability that they will be happy on the job and reduce the match score if we believe they'll be unhappy and increase it if we believe they'll be happy. there's uh i can just imagine like uber give it routing rides and deciding what the driver pays or something based on how happy there could be yeah if someone i mean in case uber if someone likes you know water a lot maybe you increased by a little bit the the paths that that include water you know maybe maybe there's a little bit more happy drivers so that's uh i think this will be important because really the the goal of our research team at its core is uh of course to build these pipelines and help train models and so forth.
13:13But at its core, it's we want to help determine where humanity should spend its time. And of course, humanity spends most of its time on their jobs. And so this idea of like having your skills match, but also having your be satisfied on the job is like the most important thing for us. You talk about like robotics is going to be something that you're interested in, but you're not like hugely focused on it right now. But also, So I think there's just this great lack of awesome real world data where people are actually doing tasks. I was thinking about on the right over here. Imagine a chef making food.
13:50You'd probably want a bunch of data on chefs making a specific dish again and again and again in order to train a robot to do that well. How are you thinking about kind of creating an entire new data set out of nowhere and doing it in the right way? Yeah, so robotics is definitely a data vertical that we're thinking a lot about. I think the long term is that the physical world is obviously a lot harder to navigate than the laptop. And so, you know, you will have the data need will naturally be a lot more. And so, you know, we're starting to think about this a lot. We have a bunch of pipelines that we built.
14:26I think the interesting part, which makes it, you know, the difficulty for Robotics Lab is that there is no Internet for robotics models. Of course, you can argue that there's YouTube and these things, but it's not the same as LLM's being able to train on the whole internet. And so the first step is you have to create an internet equivalent for robotics. And so what that means is basically kind of very basic world navigation and manipulation abilities need to be distilled into robots. And so the pipeline we have right now is a pretty funny pipeline. We have about 3 ,000 people around the world in 50 different countries that are essentially putting a camera on their head and recording themselves do things in their house and recording their hands only without any personal identification in the videos.
15:22And we're using those videos to annotate them for VLA models. And then the idea is that this will be easily mapped to any robotic system and robots will be able to learn from this. And the key thing is maximizing diversity and really allowing these candidates all around the world to do whatever is kind of their usual day-to-day tasks. Their natural environment. Exactly. Their natural state of kind of living. They're going to do those tasks anyways. So now you might as well get paid for it by doing it for MicroOne and helping train a friendly robot that will help you maybe do them in the future.
16:05Interesting. Yeah. Yeah. So you're just focusing mainly on people just living their normal lives right now. How do you think about designing a specific data set for, let's say, culinary arts or something like that? Yeah. So I think there's two kind of broad categories of robotics data. First is household tasks. and I would say most kind of generalized humanoid companies are at least have some focus there. It seems to be kind of the majority of the focus. And the second is more so industrial and manufacturing and so forth. And we're doing a little bit less of that for now. But that's a pipeline that will probably kick off sometime in the future.
16:45Getting 700 people hired at one company in a matter of a couple of weeks. I imagine that's like a complete inflection point in your own mind. and then going through the transition and like growth yourself like what are the things that kind of went wrong or went right during the first couple months yeah so the the world of robotics and the world of generalist hiring is um very different because the volumes of of the talent we need to hire are much higher and of course like if you look at lm training where the volumes are quite high i mean they're they're hundreds sometimes you have to hire 300 doctors and in a week.
17:22And it's not like any doctor, it's like world-class surgeons in these countries that know these languages and so forth. And then sometimes we have to hire 500 lawyers in a few weeks. And so these, the volumes are already high in the LLM training space, but for robotics and more broadly for generalist hiring, where it's less so the very niche experts like doctors and lawyers, but more so, you know, voice experts, or maybe just kind of candidates generally, they oftentimes for those pipelines volumes go into thousands pretty quickly so so so the the intensity of um of it is is is quite insane insane and do you just go from basically like having no presence like let's say for doctors for example you've you've never hired a single doctor before and then you have to hire 300 in the next like month but actually do it well how the hell do you do that yeah so the way you do it is you you um you rely heavily on the ai recruitment engine.
18:19There's no other way to do it. I mean, the other way to do it would be you have to hire, it becomes a chicken and egg problem because you have to hire, you know, hundreds of doctors to interview hundreds of other doctors. And so like, you know, how do you hire those hundred doctors in the first place that know those specialties? So it's quite literally impossible or close to it without an agent that can, that knows exactly the very niche capabilities of that surgeon in, you know, whatever country you want to name. and so we rely heavily on the Micro One Zara agent. And our recruiters actually, they help design these environments, these interview environments where they're defining, based on the pipeline that the customer sends over, they're defining the exact skills that need to be vetted, and then Zara goes and does it.
19:04What was the first specific vertical that you went into when you started basically hiring a bunch of people to create training data? The first set of vertical was actually coding with that one company I told you about that was hiring hundreds of engineers. And then the second one, which was a really big inflection point for us for an actual AI lab was finance. And I remember we were in their office and this lab was telling us that they're struggling in this domain, which was much more subjective than others. And it was specifically business experts, quote unquote. It's a bit of a vague term. Hire a bunch of MBAs.
19:49Yeah, it was actually sort of like that. And I actually, I remember I told him like, hey, I think you should also hire some startup founders and not just MBAs. But it was basically a mix of MBAs and startup founders. It was like 30, 40 folks, ran a pilot, you know, did well. And then we kind of expanded in a bunch of different domains right away. But finance continues to be a very core focus of ours. So when you first started to see things take off, what kind of went wrong? Like what broke? The truth of this business is that it is very operational. You need to provide a world-class white glove service to your customers.
20:33and they, no matter how much pretending other human data companies like to do, your customers will not log into your product. You have to build products that will make your white glove service world-class. And so what that means is operations goes wrong and you have to hire these exceptional, what's called SPLs, strategic project leads that help kind of manage these pipelines And if the hire is not a good hire, it kind of affects the relationship a good amount. And so the scale up is like very fast with these customers. And, you know, our products, the products that we built allow us to scale up with the demand that exists.
21:23But really, there's still this limiting factors of hiring exceptional core team members. And you can't shy away from that. And you can't mess that up. And so that's really what continues to go wrong. But the way we kind of reduce that going wrong over time is by just continuing to productize our human data, offering as much as possible. And, you know, of course, building the recruitment engine, but also having a data platform that's very modular, that kind of handles any data structure, building a performance management tool that quantifies expert performance and data quality, velocity, HD, all these different metrics that allows the dependency on these core team hires to actually reduce, which will allow for even further kind of scalability.
22:16All the value of the company is going to be created from maybe even only a couple of relationships. I imagine that it's critically important and also incredibly difficult to basically build conviction and trust in a single individual to get that right. How do you do that? We look for two main things for making these hires happen. The first is the sheer agency that we can predict from interviews. and it's very hard to predict actually, but it's, you know, with the exercises that we send to candidates and the whole interview process, we try to assess their level of agency and really like how much they will care.
22:53And of course, part of that is you can't just, you cannot have exceptional humans care if they don't have the incentives to care. So part of that is actually our job to assure that someone that naturally does have agency continues to have agency. because if they're smart, they won't have agency if the incentives are not there. It's like the problem of you basically are great. And so you get hired at some big company and then you're neutered and you can't actually do anything. Exactly. And so if we create an environment like that, we actually can't hire exceptional folks. So at first, the agency starts from us internally.
23:26The incentive structure is the products we build, et cetera. But then, of course, the person has to innately have that. So once the incentive structures are there, they need to be able to kind of perform. The second thing is we actually look for folks that will take risk. I think, you know, naturally when folks are joining startups, they're a little bit higher likely to take risk. But if you're not starting your own company, naturally you'll just be a little bit more risk averse. so we try to look for people that um will be not scared of taking risk and and and really kind of mess up in fact in the first couple of months and and even if you mess up pretty bad like that's fine we actually try to celebrate mess ups we i'll give you one one story we had a we had one of our um spls that is now actually like in the senior leadership at our company um i won't name him i I won't name him just because he's on a very confidential client.
24:25But he actually had a pretty bad mess up in terms of promising a completely unrealistic timeline to a customer. And the customer was like, wow, they can really do things fast. This timeline is pretty incredible. And we realized within a couple of days that this timeline was like... Impossible. Completely impossible. And we had to make the decision on trying anyway. and we ended up like this got to like high, high, high level people at this company. And it was, you know, it was a pretty big mess up for us. And, and this person now runs this account completely. This person is the most senior person on this account.
25:08And, and that month, that person was the team member of the month. And of course it wasn't because he messed up. I mean, this would be because, you know, so we're a bit stupid to, to do all this because he messed up, But it was because he took the risk and came back from it in a really incredible way. And the customer actually built a lot of trust after we came back from this mess up. And this was one of the greatest things that happens to us in the company. It's kind of funny. There's this, I remember reading about like the optimal hotel stay. And it just so happens that actually the optimal hotel stay isn't that you go through the flow, you get there, everything goes right.
25:45It's actually you go through the flow you get there something goes wrong and it's a small thing But then the hotel just goes out of their way to correct it extremely fast And because of that it just builds trust instantly with the customer exactly except this time it was a big mistake. It was a small one, but But that's it. That's a good analogy. Yeah. How do you think about taking taking risks? There's some there's some risks that are Things that you can come back from and then there's others where it's this one-way door and once you're through it You can't come back. So how do you decide which one makes sense?
26:16yeah so this is of course uh you know jeff bezos is um this is philosophy of of have extremely high velocity on on two-way decisions and much lower velocity on one-way decisions and we um i think the way to do it is uh this is sort of the third pillar in how we hire which is the judgment and kind of overall intelligence of the person i mean they should they should be wanting to take risk They should have agency, but they should also have good judgment. And if something is like truly a one-way door, they should not take that risk. So that's the third thing that we assess for is kind of a baseline.
26:56And do you try to have it where if it is a one-way door, they figure that out quickly and then like come to you and you guys decide collectively whether or not to go through it? Exactly. And we try to do, you know, kind of a system where we limit bureaucracy as much as we can, And where team members can DM me easily. I mean, we have many thousands of experts in a different kind of workspace in Slack. And they can DM me at any time. And they do. And, you know, it's... One message from a thousand people becomes unmanageable pretty fast. So we make it that, like, if someone needs a quick opinion on a one-way decision, they can get that.
27:33They can get that very quickly. Yeah. What have been the biggest, like, one-way doors that you went through? and you basically looked at all the facts going into the decision and you decided to take the risk and then it worked? I think the biggest one is this idea of going all into data and being all in on data and not focusing on anything else. We decided this, I actually think we decided this a bit late. I wish, I mean, in retrospect, of course, it's easy to say, but I wish we've done this a lot earlier. But we did this, of course, we started to kind of be in the space much before this, but we decided to go all in on data about a year, year and a half ago.
Read the full transcript
28:14And when we did that, we 30X in revenue. Um, 2025, we 30X in revenue. And so, you know, the decision worked from like a small base either. It's from a, we started the year with roughly four or 5 million run rates. And then we, um, You know, ended with like roughly 150. And so that was a decision that worked. And I think we try to make a few of these bold decisions each year. And if it doesn't work, it's OK. There's a lot of great learnings in it. And there's been a lot of those as well. So one of the things I've noticed throughout researching you is this idea of incentives. And we talked a little bit about this beforehand.
28:59But one of the biggest things that Warren Buffett has been very focused on is he's basically just this massive incentive aligner, and he tries to figure out how can we structure incentives at each individual company that we control so that everyone is basically creating long-term value for the company and then just funneling as much cash up to Berkshire to reallocate as possible. And if you have the wrong incentives for something like insurance, you know, you'll write a bunch of insurance that doesn't actually make sense And there's this big spike and you've grown a bunch but then the problem is is three years four years later You've lost all this money because of it But because there's some you know executives that will turn over so quickly You can have a situation where person grows the company a bunch leaves gets a bit massive like basically pay And then the results or issues happen only after they've left how do you think about basically designing incentives so that everyone wins on the right time horizon what i focus pretty much my entire time on or at least i try to is three things one is hiring to his product and three is aligning incentives like i literally sit down i think about the incentives that everyone has and their bonus structures and their equity and everything else and i try to keep optimizing them and sometimes i'm sitting there and like there's not many actions to take.
30:17It's almost like you have to come up with random actions. But I try to think about this every single week for hours a week. And I think, as you said, you have to align incentives very long-term as the main priority through equity. And I'm very grateful to be a sole founder. So I'm able to give a bit more equity to the founding team and really everyone that kind of joins even now. So that's definitely part of it. But I think another part of it is it's actually important to align short-term incentives as well. And I think perhaps this isn't thought about enough. I think when you're in a space that is growing so fast and three months matter a lot and like three months can literally double your run rate, you actually do need short-term incentives.
31:08And so like, you know, I'll give you like two random examples. which is, you know, we have our recruitment team sometimes gets these like absurd bonuses if they hire like a thousand people. And it's like a recruiter has never hired a thousand people in like two weeks. That's not something that you train for. Yeah. So like if this like completely outlier event is happening, they should get a pretty massive bonus. Like that's that's totally fine. I think the second thing is there's also these other outlier events, which is sometimes we have a customer that is about to sign a really massive contract, let's say, and we might align incentives with them in some other ways as well.
31:51And there's one person that's a key person that's leading this. I might tell them, hey, if this closes and therefore the company changes forever, you'll double your equity. and that i think you know our our general counsel our cfo is like you know what the hell is that like oh how do you do what do you do that but but i think this stuff is um there's like more short-term incentives are actually also very important and especially ones that are designed that that incentivize you very much so short-term but then also long-term in this case of like if you double your equity because the company has changed forever because of the deal that you're leading, you now have more equity for the long term.
32:35So I think this balance is quite important. That's kind of interesting. It's a little bit like you do get that short-term bonus, but it's in this form of a long-term instrument. Exactly. And the short-term bonus is also vested the same way that the rest gets vested. So you get this, you know that you're about to double your equity and change a lot about your life if we succeed, but you still have that vesting and the vesting actually restarts for that top up. So that's the, yeah, I think that that's the key part of it. I'd be curious to know, like, how did you come to this conclusion? Because that's something that I haven't heard almost anyone else do.
33:13I've seen people give like cash compensation and stuff to people for pulling something off or just going above and beyond. But I've never heard of a company, founder in particular specifically structuring individual comp so that it basically helps massively assuming deals go right it can help massively I'm not sure I actually came up with it I think it's a bit of an absurd idea and I also have not heard of anybody else doing it I heard I heard Jensen from NVIDIA I think he does something like this when I heard that it was like very reassuring that I'm not like completely like insane but you were doing this for months or like even over a year before you heard about this from Jensen.
33:54I actually was, I was thinking like maybe this is a bit of a too insane of a thing to do. So I was searching, like hoping somebody else does this. Like that's like a great founder, obviously like Jensen. And I couldn't find anyone other than Jensen. I think it was like something similar. It wasn't exactly the same. So that was a bit reassuring. But I don't know. I don't know how I came up with that. I think I just kind of thought like, hey, if this happens, we will, our probability of long-term success really materially increases, but also the short-term enterprise value that gets added is like pretty immense.
34:26And let's have this person get, you know, some portion of that. And I think that's the second thing is like, we're, we're in a very special space, um, that is, that has resulted in a lot of really fast growing companies. Of course, you know, it's not just us, We have a lot of great competitors and they're also growing incredibly fast. And it's because of the just the immense demand there is for data. And so, you know, I think we're when you're in this sort of outlier state, you should do these outlier things. Has there been any other things that you like other actions that you take that other companies and other founders don't take that you think are massive unlocks?
35:08I think this idea of actually caring for your team's happiness, similar to how we do with our experts. And the term we like to use is we want to get to this mode of being sustainably hardcore as soon as we can. Sustainably hardcore? Yes. Because right now it's not so sustainable right now. I mean, it's pretty much everyone on the team does 13, 14 hour days and, you know, leadership does even more than that. And it's not like basically if you're awake, you're thinking about it. Exactly. Like literally every waking hour for almost the entire core team is work. And it's a great place to be. And even I like I mean, I work pretty much every second of the day, but I sometimes feel like I'm not working as much as some other team members.
35:58And that's like I feel very honored to be in that place, you know. So we have to keep that going for a long time. But we also have to keep in the back of our mind that at some point, hopefully in the next few years, we'll get to a more sustainably hardcore structure. And I think a big part of that, even now, is we actually don't enforce working weekends. And it sounds a bit soft, but we actually have our team, I would bet we have our team work more weekends than most teams because we don't enforce it and we try to inspire it. And the leadership works basically every weekend, late nights, so forth.
36:51And there are pipelines that really need you in the weekend. and so you will be and the incentives are there for you to be inspired to work weekends and do so every weekend and so we don't put these like arbitrary constraints of like forcing folks to put put certain number of hours like this idea of like 996 and so forth I actually don't buy that I think that's like ridiculous and sounds really lame I think you instead should go until 12 a.m not till 9 p.m because you've inspired it and not because you've forced it and we've heard a lot of I've heard from a lot of my founder friends that are that know about some other founders that that force this sort of thing and it results in a lot of really unhappy team members and that doesn't last how do you design things so that you do create this culture like I this this reminds me of almost like sleeping with the troops you basically are in the same tent as everyone else or not, and you're sleeping on the ground.
37:47And I think the best form motivation is just seeing whoever the leader is working. And, you know, if they are going through hell, typically, you can you can kind of sign people up to do the Ernest Shackleton, let's go travel into the great unknown and be cold and be wet. And probably there might be success at the end of it, maybe. And if there is, there's glory and everything. But how do you kind of design your own life so that you are creating that natural feeling inside of people? The way I look at it is the hours that the founder puts in is sort of the max range that the company will put in broadly.
38:27And of course, again, very grateful to be in a place where there actually is some team members that put in more. But generally, the max is what the founder puts in. So if you put in 12 hours a day on average that that's certainly the max that people will put in so I think the first thing is you you just have to grind really hard the second thing is um you have to be in the details and now I'm going through this phase of uh and so is the rest of the kind of leadership going through this phase of of balancing being in the details and like doing actually useful things for the company. But if you're outside of the details too much, folks that are making the day-to-day decisions that really matter for any pipeline we're working on or any recruitment funnel or whatever it is, you actually won't have enough context to give the right opinion on when things get stuck.
39:24And so you cannot be too abstract away from details. So I try to stay in the details as as much as I can. And I think there's a, you know, there's, there's a sense of respect that everyone has for each other because everyone's hands-on. Like we have our CFO join us and he's running payroll himself and he's answering payroll questions to experts himself. And we have our general counsel join and there's no other lawyers. She's doing everything. So this, this idea of like every leader needs to be very hands-on. And of course, in the long run, you have to kind of converge to, you know, maybe 20 % of your time is hands on.
39:58You can't realistically be hands on your whole, whole, whole time. But, but, but having that 20 % really be there and not really go below that is, is really important in the way that we function. Yeah. There's this line that I love, which is if you're going through hell, just keep going. What's been the biggest moment where you and the team felt like you were going through hell? There's, there's this one time where we had a massive customer that, this was a couple of years ago, that was almost 50 % of our revenue. And I'll keep the details a little vague, but we essentially lost this customer like this.
40:41And it had to do with some external factors. And I remember the moment that we lost this customer. I was in the elevator going up to pitch some investors. Perfect time. I was literally, this was during one of our early rounds. And there's momentum. And we were about to close the round in a huge manner. And I'm going and pitching this great firm. And it's a partner's pitch. So a bit nervous. It's not really a conversation. You've got to just kind of pitch the whole time. and I remember I look at my phone and there's this um this email that we've lost this customer like literally as the elevator opens and it's like like why is this like why does it happen like this why does it have to be like a movie scene like just and so I you know I I read that email and then I go in and I um pitch anyways and I'm like about to like faint during the pitch because we just like lost the company and so um but I put on a I put on a face anyways and I you know do the pitch and the pitch goes well but obviously the revenue is not the same anymore so we have to correct that um but I remember the you know I kind of I leave that pitch and I go and kind of start walking endlessly and I'm in the middle of Palo Alto and I just uh put my laptop on the ground somewhere the laptop was like open and like it's like just like on the sidewalk and I just like I just like start walking and I like the laptop just like left and I'm like walking around and just doing like random stuff.
42:13And it was a very painful moment. And I, um, I mean, it was, it was, it was as, as painful as it gets. Um, and I remember we had to lay off a bunch of people. Um, and we thought that we probably, we, we might not survive this. And we had, um, you know, we were very close to not being able to make payroll and all, you know, all the rest. And I remember telling myself, if we get through this, this would be a great story to tell. Glad we're saying it now. And it will really allow the team to have something to bond on in a way that's just really intense. And now in retrospect, I'm glad that it happened this way.
43:11and I wouldn't really change a thing about it. And of course, there's been a lot of other moments since, but we did pull through, thankfully, and now it's a moment that we think back on a lot. This kind of reminds me, I think during COVID, Airbnb's revenue over the course of something like eight weeks dropped by 80%. And there was like the headlines about like, is Airbnb going to survive? and I remember before COVID, Brian Chesky and Airbnb were trying to go in all these different directions and what ended up happening was because of that existential crisis. It allowed, you know, Brian to basically say, no, we're just going to focus on this one thing, which is the stays.
43:52And that's what they did for three or four years after that. And it kind of eliminated all this distraction. Did you have anything come from that? Like you guys make different decisions going forward? Yes. And by the way, I know exactly what you're talking about. I watched that podcast that Brian Chesky was talking about this. And I think that actually, that podcast had the most impact on how I think about product. Really? And product roadmaps and this idea of like having one roadmap that Brian Chesky himself approves every module for. And we try to do that as much as we can. I think it's like the way he's explaining is that each of these features affect millions of people that are having these experiences.
44:38and me approving them for like 30 seconds, it actually does not take a lot of time. And the design and engineering and the impact that each of those features will have is so large that I should spend time approving every single one of the modules I'll go into Airbnb. And I would argue Airbnb is like one of the most delightful experiences in terms of like a user experience interface in terms of an app, but also like in terms of the product itself. So that had a lot of impact on me. But to your question, I think, you know, when the situation happened, we I got in this mode of actually not wanting to take a risk for for a few weeks.
45:15I was I started to be a bit risk averse. And was it just like a state of fear? It was a state of fear because not to get to the details of like what happened here, but part of it was because of an action that that that we took. But it was mostly external. and in retrospect, we found out that it was actually entirely external. But we'll tell that story later. But there's a – so I got in this mode of like for a few weeks of just being very scared to take actions and kind of – and I got very afraid that like, shit, this might change the way I operate because I like to be very risky and I like to – I like to kind of set up these initiatives and take a bunch of bold moves like the other day we set up this like really crazy incentive structure for if we hit this wild run rate by April the team gets like like 50 % of their uh total comp as like bonus like these like wild things and and like you know I should I should have like approved that by like a couple like you know Gerald Council maybe board and so forth but but I just like I just I just went with it and and I do a lot of things like this.
46:28And those, those few weeks, right after this, this thing happened, I, um, I felt like I was about to get into this mode of like never doing those things again and being very risk averse and like, kind of like a managerial style CEO. And I, uh, I remember very, very explicitly that I spent two days thinking about this and convincing myself that if I go into this mode and I don't change this now, this will be the worst possible thing for the company, for myself, for my career, for everything. And I decided that I will force myself to have the same level of risk as before. And in fact, even more than before right away, because this just simply can't happen.
47:06That was like the biggest pivotal moment that I had to make this decision. And I, you know, I felt the exact same thing. I remember there's been many moments in my life where I love risk, but I love risk that I can control. You know, so there's, there's basically, I think our brains are naturally designed to fear the loss, like fear loss twice as much as we anticipate gain. And so you kind of have to counteract that and correct for that, which means that in all likelihood, any decision that you're making, you're actually over-indexing on the risk of the decision when, in fact, there's probably a lot less risk than you actually think.
47:41And the risk may be long-term in not taking the call at all. How did you kind of see that manifest over that couple-week period where you were kind of going into a shell almost like a turtle and then figuring out no I can't do this I remember when I would make even small decisions within the company in that in that two-week period I felt the sense of maybe I'm actually not the best one to make these decisions and I started to think again very managerial like maybe I should start to hire these you know more professional folks to help me make people that know what they're doing. Exactly. And, and, you know, have, uh, have maybe more experienced folks join us.
48:23And cause they, you know, the, the strategy we've taken is, um, hire, you know, really kind of recent grads and inexperienced people and, uh, and put them, you know, put them to work. Um, and that has done really well for us. And so, but I started to kind of change this model a bit briefly. Um, and I think that the thing that helped me get out of this pretty fast is I came to the realization that the company depends on it. And the founder's job is to inject as much risk as they can into the company. Because really no one else will. Like outside risk? Yeah. I mean, like just bold moves that have a pretty bad downside also.
49:08But if it works, it works well. And I think the reason why naturally other folks in the company don't do this is because they don't want to get laid off. I mean, they want to continue working at the company. And so really the only folks that really can get laid off are the ones that can ingest the most risk into the company. And so if they don't, no one else will. And you'll just have a company that is not risky and doing some basic stuff. And And obviously, if you're not taking risks, you're not going to grow. So I came to that realization that it is my duty to ingest risk into the company. I have to do it.
49:41No one else will do it. The second thing was, if you think about risk taking and you think about what is the worst case scenario, anything that you do has the worst case scenario that is really bad. I mean, us driving here today, God forbid, has the worst case scenario of us not being here today. You can't think about that risk as you decide to drive here. So if you're making a business decision, in almost every case, the worst case scenario is you're going to go bankrupt. And so if you're assessing the worst case scenario every time, it's just like not a helpful data point. So you have to think about the expected value.
50:21And you have to think about this distribution of probability that exists within this decision that you're about to make. And there's obviously, again, a long tail of really bad outcomes, but they have very low probabilities. And if you can kind of if you can come with this, like just just intuition, there's no math that's involved here. But like just this intuition of like, what is the distribution of of risk taking here and and come to a decision that I think that framework allows you to be bold. Jeff Bezos even talked about this a little bit where he basically says like the role of especially an executive is to make like a few really good decisions a year.
50:54And then for the most part, you know, he even says like if there's a decision late at night that's going to have a massive impact on the company, he just will delay it until the next morning. And that's like a 10 a.m. meeting for him. Do you have the same kind of philosophy or framework where if there's something really big that you have to decide on, you hold off until the next morning? You know, maybe it's 12 a.m. at night and you've been up for 18 hours. how do you decide like what thing you're going to take action on versus a delay? Not to disagree with Bezos here, but I actually don't do that.
51:25If an urge to act on something comes about, I try to do it as fast as possible. Of course, partly to just move fast, but I think more importantly to not think about the action too much, frankly. Because a lot of the risks that we've taken, whether it's as simple as DMing a customer POC about some new pipeline that they may be interested in, or whether it's this crazy bonus structure we set for a milestone we have in April. Those things happen when I get the urge to do it, they happen best. And of course, I have to come up with the actual plan. And if it's something as simple as DMing a certain customer, if I decide to do it the next morning, I might kind of say, okay, maybe we do it in a week maybe they actually it's not the best time to reach them and so forth but what i realized is that like almost all those actions end up doing something good for the company and they often happen very late at night right away when i get the urge to do it i think this kind of comes back to like training your intuition and you have to figure out what are the right people and models to run through your own head so that when you do get this piece of information where it's like you can take this action right now and has some massive impact whether upside or downside how do you decide and how do you decide quickly?
52:40How have you kind of gone about training your intuition over time? It's funny you ask this. I actually, I think a lot of folks, even like newer folks at MicroOne, they think that I'm very analytical and actually I'm not at all. We have folks in the company that force us to kind of set quarterly KPIs and so forth. And we do a little bit of that just because there's a lot of, you know, there's a lot of roles that you do need that for like sales and and so forth but i actually like the way i do it is um i try to set structures that are that are a bit more qualitative and i i try to use my intuition as much as i can as i assess whether someone has had an exceptional outcome in the corner in the quarter or or not not an exceptional outcome and my my philosophy here is that when you dumb down someone's 12 hour days every single day for quarters straight to a few KPIs, you're really like, you may optimize for the wrong thing.
53:45And for a company that is growing fast, those KPIs will likely have to change pretty much right away, like within a week, you have to keep changing them. And you end up spending a lot of time just changing KPIs. And so one thing that I've done is we've added this, and this is not for everyone in the team, but for most folks where we have this, if the role is very directly related to like revenue, we have this like revenue override, which is if we hit our crazy ambitious goals for the end of the quarter, your KPIs actually don't matter and you should just do what's best to increase revenue and build a great product.
54:25And so I try to like distill these things into this idea of like being analytical and having these like very key KPIs because I think it actually results and people doing things that are most important at any given time for the company versus optimizing for their own kind of like arbitrary set KPIs. And I also look at it as like, if you, like the human brain, when it, this idea of like intuition is basically like a really large neural net that is considering many KPIs at once as it comes to a decision. But if you're looking at three KPIs, you're just like reducing the number of features by like so much.
55:06And why would you do that? Is the way I think about it. And of course, this is not like a, you need KPIs for a lot of roles and you cannot just like eliminate it completely. But like, I think jumping to structuring KPIs too quickly would be a mistake. Did this kind of evolve over time or did you initially try to go in the direction of being more analytical and then moved back from it? initially I wasn't in terms of determining who's performing and so forth. and then I wondered whether I should because that's how every company does it and then we did for some time and then we went back to not being so much like that.
55:44So it was kind of a, you know, I had this urge of like, this is the norm, everyone does it like this, I think maybe we're doing it wrong but then we went back and I think for the state that we're in right now, it works well but I think long-term, you do need to go back to KPIs because you'll have a lot more specialized roles where their KPIs actually don't really change quarter over quarter. And you can just quantify it with three or four numbers and leave it at that. There's not been very many companies in the history of anywhere that have grown kind of as fast as this, which means you don't really have, there's not exactly a playbook for how to react.
56:23How did that growth feel just internally? How did you make decisions during that 12-month period where you're growing 30X?
56:34It's very intense. I feel very stressed and grateful is I think the way to summarize it. And I have to be very flexible in the way that I work and be okay with the fact that my day-to-day will change very quickly. because if you think about a company that, you know, I think there's, you know, great companies, they 3X in a year, 4X, and sometimes they 10X, and these are like really exceptional growth rates. And those companies, they have, you know, let's say companies 3Xing year over year, they have three, four years, whatever it is to get to this like 30X. And so they have time to kind of iterate their work structure and their day-to-day but but when you 30x in a year you don't have time to iterate like every every month or two what I should spend time on changes and I'm always like man am I spending the right time on the right things like I'm constantly questioning this and it's like the most stressful thing because you know when I'm in a certain thread and I read the thread for like 10 minutes in Slack.
57:46And then I, at the end, I'm like, okay, a good decision was already made. And I just replied, great. Like nothing changed about the state of the world. I just, and like, I just do this to like many different threads within Slack. And I realized that like, okay, maybe I should actually abstract myself away slightly from some of these details. So things like this happen every few months. And I have to be in this mode of like very flexible with my work structure and being okay with like changing it very rapidly. And so does, I mean, so does everyone else in the company. Like there's folks that are very much like IC and hands-on and like they, obviously they have to be in the details and the team grows so fast under them that they have to become a leader like within like two weeks of joining.
58:33And like things like this are really abnormal. And so a lot of folks in the company, pretty much everyone has to constantly change the way they work. And it's really difficult, but it's also fun. How did you think about which areas were the highest leverage points that you could be focused on any given moment over the course of that change from going from a recruiting business to like an expert's business? Yeah, I think now, I mean, obviously in the early days, doing everything, being in the code base, doing sales and all the rest. And then, you know, within the first like few quarters into the company, kind of being a little bit less in the code base, hiring a good engineering team, but then continuing to do sales.
59:15So I think now what's the main focus for me are still being an account executive and, you know, doing sales because we don't have that many customers. So we need to, and it's obviously really, really fun to meet these like exceptional researchers and have these conversations with them. So a lot of my time right now is well spent doing sales and doing it in a very non-salesy way. I mean, we just like, we just hang out with these folks and like get dinner. The best sales is, it's not transactional. It's just like a relationship and it's an evolution of a relationship. Exactly. And we take a, our CRO said this actually yesterday.
59:51It was a good phrase. He said, you know, we take a very human first approach for our experts and we also do for our clients. I mean, we go to dinner with them and we don't talk about anything related to selling them anything. And sometimes they actually, it's funny, they message us after we've gone this a couple of times. They're like, hey, why don't you like sell anything like during that dinner? Like that was so nice. And that results in more expansion. So that's, I think, that's the approach we take for kind of both ends of the market. But what I spend time now on is mainly product roadmap, trying to, again, productize our operations as much as we can, fundraising.
1:00:32We'll do a little bit of that soon. And customer calls and then aligning incentives. And then, of course, being in the weeds with the team as much as I can because that is a very important part of what I do. How have you kind of thought about when the right time is to basically go into a new vertical and go take on some new challenge versus just making sure that the thing that you're currently doing is done kind of 11 star experience in the sense of Airbnb? It's a really hard balance, especially when you raise some money. There's a lot of there's a lot of experiments you could take. I mean, you can just assign some amount of funds to some random project, some random app.
1:01:15and it might go well. And you can kind of silo a team to work on it. And it's fun to do so because it's like a new idea. It's like a startup within a startup. But I think that's something that we try to avoid as much as we can. And in fact, the team tells me to avoid this. I think I do a bit too much of this. I try to go on these side experiments. And we have our CMO, Daniel. He pushes back on us a lot, which is a good balance. The other part to the kind of data infrastructure we're building is naturally we do have a few pillars to the product and it's less of a, I wish it was like a one roadmap Airbnb type, one application that kind of serves customers.
1:01:58It's more of a infrastructure play that has a lot of components to it. Of course, like the recruitment part, the data platform, the RL environments that we create. And so naturally we do have to have kind of a few different engineering teams that do have different roadmaps and so forth. but we try to limit the number of new engineering teams as much as we can and you know have have everything kind of in one platform to the extent that it's to the extent that it's possible and you know to kind of reduce the number of new subdomains that are that are created when you have a dinner with a customer and you just talk with them for you know a couple hours yeah have you been able to kind of figure out where the puck is you know skate to the puck where it's going beforehand and then just plan out a couple months in advance that you're going to have to get there you know to help them um let's say four months in advance or six months in advance the short the short answer is sort of um i mean we we're in this area that is like very frontier of course what what our customers do the research they do is um exceptional research that has a lot of very risky hypotheses that don't necessarily work out every time.
1:03:13And obviously these labs are spending many billions of dollars on this research. And so it's harder for a non-lab to kind of hypothesize these same things and let them and kind of predict what it will be. But we try to do as much as we can on these kind of proactive pipelines that we create. And one of them actually is the is the robotics one where we i think it's like four or five months ago i basically randomly guessed and there's like not much research into it that i think human demonstration kind of egocentric data will probably work my my intuition was um was like you you can't really scale up teleoperations teleoperated robots you need to figure out a way to map real humans doing things to robots learning from them.
1:04:10You have to figure that out. Like, and if, and if you don't, if the robotics labs don't figure that out, I don't think robots will work. And so, so we decided to just start this pipeline with like, you know, a hundred people to begin with that were doing these like household tasks and recording themselves to it. And then, and then a few months later, we saw, you know, this is obviously public. We saw physical intelligence came out with the paper around um egocentric data is actually like the most useful thing ever and we're like shit we also guessed that we don't know why but great and and we uh you know we we scaled the pipeline from 100 to 3 000 right away when that happened so we do make these guesses and i think a lot of it is based on like just like the intuition that we have um based on pipelines that we have but it's uh it's it's it's tough to get it right so there's a lot of like data that we create that becomes a bit stale because it's not actually useful.
1:05:03Yeah. How did you take that, you know, when you realize that you need to scale up the team by like 30x to collect this human data? How do you actually do that? Like, what did that look like internally? There's a lot of things to think about here in terms of scaling that up. The first is, can our recruitment engine be applied as well as it's applied to experts, to generalists. So we had to first kind of like build an environment that allows for generalists to be vetted well. And part of that was them recording a video that's similar to the tasks that they're going to do on the job and seeing if they do that well.
1:05:43Another part of it is that we, it's a, you know, obviously we really optimize for everyone that goes through funnel to be really happy, but there is going to be folks that are unhappy. be I mean for for for a massive pipeline like this and so when the pipeline is so large there's a kind of a branding thing that we have to think about as well like it's a how do we make sure that there isn't leaks that happen when there's 3 ,000 new people joining in this pipeline within two weeks so we have to kind of prepare on the on the marketing side basically so there's a bunch of things like this that we think about and we and you know the funny part is there's no there's no time to think about these things because the customer says, Hey, we want this much data.
1:06:28And it's like a very nice contract and we, somebody will do it and you know, we want it to be us. So we have to do it and we have to figure out all the rest that, that comes with it. You know, you talked about, there's been a couple, a couple of moments where you like promised speed that was just like, after the fact, realizing it's just impossible to, um, has it brendan any other moments where you kind of like wanted to move faster than was possible and you had to reevaluate things or even things where you thought you could go at you know get something done in like two or three weeks or a month and you're able to do it in like much less time yeah there's a lot of that and we um what we try to do is build kind of a prediction model for timelines now and we actually it's it's funny we um right after this mistake happened with this this person that I told you about that ended up being, that ended up kind of leaving this account as partly as a result of their mistake is we ended up building this like internal, pretty basic, but important model that predicts timelines.
1:07:34And that allows us to be much more accurate with our timelines. But it's still very messy because there's no, the data structures are very different in this space. There's some data points that take three minutes to create. and some sort of like preference labeling for image annotation or video annotation or whatever it is. But then there's also data points that create, that take like 50 hours to create. And it's maybe it's a tax expert that is simulating the full journey of filing someone's taxes in California, which is like a complex thing to do, especially with the new bills coming out. So the range is very high.
1:08:12And so we have to first determine what is the actual time per task, per data that's going to be created. And then from there extrapolates what is the timeline that the customer looks for and therefore how many experts do we need with that timeline. And then kind of work backwards on can we actually hire that many experts in the two days that we have. And then if it's feasible, then we say yes. As companies scale, typically what will happen, especially in extremely fast growing companies, is you'll experience this massive need to hire. And I think Airbnb had this problem where they just overhired and had a whole bunch of different people working on all these different functions to a point where Brian Chesky didn't even know like what everyone was doing at his company.
1:08:56And I think it's incredibly difficult to basically stop that natural short-term incentive and make sure that the people that you're hiring are all focused on the same objective. Over the last like 12 months, I believe you only scaled your team from like 45 to like 80 plus, you know not not that much doesn't track revenue growth at all pavel durov also had this example where he's built this billion plus person you know user company on the back of 30 people he's only got 30 people working at telegram yeah i think they generated like a billion dollars in revenue last year how do you think about deciding when to hire and when not to hire yeah so i think durov is obviously an incredible example of this and it's uh i think it's hard for any company to aspire to be even remotely close to that.
1:09:42I think it's just an exceptional outlier. But what we try to do at Micro One is, you know, we have this notion of keeping a lean team and this kind of lean team philosophy. And we, like I said, in 2025, we went from 35 people to about 60, 70, and then now we're about, you know, 80 or so. And the approach that we've taken since the beginning is hire when you absolutely need to. And really, you have to build this into the culture of the company because oftentimes hires don't come from, you know, me saying we need a hire or, you know, other execs saying we need a hire, but it's more so a recruitment manager or some operations team that thinks they need more bandwidth.
1:10:35And oftentimes we don't have enough, you know sufficient context on being able to argue one way or another like they they can get they can give a very good case on needing to hire and so if you build if you don't build this early on in the dna of the company everyone will will try to kind of uh trend towards hires every time there's problems but but if you build this in from the beginning and you really kind of make clear that like we basically can't hire at micro one unless we really need to it's like the last straw. Exactly. Then the cases are made when they are like truthful and when they just cannot do anything else.
1:11:14So that's one thing that we followed and we continue to do so till today. Um, I think the, uh, the caveat though, is that we, in the middle of 2025, maybe towards the end, we, I decided to actually loosen this just a bit and we decided to hire a bit more and we actually started to hire, you know, the majority of the kind of 40, 50 people that we added in 2025 were actually in the last like quarter or so of the year. And so, and this actually wasn't like a bad outcome either. We were able to scale up a lot faster and kind of sustain the 20, 30 % month over month growth that we were having. And so I think when the company's having this like breakthrough growth, being a little bit more flexible and allowing that to happen with a bit more hires is also an important part of this lean team philosophy.
1:12:12And so as long as the hires are not nearly close to proportional to revenue growth, then I think you'll be really fine. So that's kind of the approach that we take. On that same hiring point, what is the kind of step or what's the process in between someone thinking that they may, you know, they have some function that they need to fill and then they got to find someone to do that. But what is the process that you go through before you decide we're going to hire someone new versus just, you know, you have more leverage, figure out how to do it. Yeah. So, so the first thing is we first see if we can actually delete that thing that there's constraint by.
1:12:49Like the question of requirement. Yeah, exactly like there's a recent case of um there's like very frankly bad process of sending out contracts to experts and it's required a lot of human involvement and therefore one of the teams that does this had to kind of hire a bit faster than others and you know i i looked into like what why there's why is this team kind of growing pretty quickly and we realized that we actually just should not have this requirement of sending contracts in this way. Spent about a week with the engineering team to kind of automate this function, which of course freed up this team's time to do much better things.
1:13:30And we didn't need to hire for that at all. And we slowed it right away. And so I think there's a lot of kind of questioning the requirements as Elon puts it really well, that has to happen. And then I think the other thing is like, if that requirement must be there and that function must exist, really dive in and see if folks are actually not getting enough time to do it or if they're busy with some other coordination or something that exists and then they're not able to do the core function that they're supposed to do and try to delete those functions to allow them to actually focus on that one thing that must exist.
1:14:09When things are growing as fast as they are right now, how do you kind of plan a few months in advance or even like a year or two out and try to predict where the business will be and how can we build everything today so that you're basically ready for when that point hits? Honestly, we don't plan. We try to do a little bit of planning and then it just ends up being, you know, we have to kind of replan similar to how the KPIs have to be kind of readjusted so many times. And I think, you know eventually we'll get out of this state of like just complete outlier 30x year-over-year type growth and you know it will eventually normalize a bit more and that's that's the simple truth at that point there will be more of a typical planning and budgets and so forth but right now when you know when the when like when the board says like what's the the budget planning for the year i mean i haven't even looked at what that means like yeah we're uh actually don't even know how to like structure a budget yet like we'll look into that later we we are, you know, we've been profitable.
1:15:10So like the budget is fine. So, you know, once we become like not profitable and can plan a bit more, then I'll look into like what it means to set up a budget and we'll do it at that point. So there's not much planning that happens. Yeah. I also, I kind of love that. Not very many companies, especially this early on are able to get to a point where they are default, not only default alive, where you have enough cash in the bank to get to profitability, but you're already there. And what does that kind of enable you to do like just psychologically day to day when you're thinking about business decisions you know you have a great business and it's growing really fast how are you kind of thinking about growing it even further after you've reached that point yeah so i think it's a you know obviously we're very grateful to be in this position of profitability we um we've been profitable for a while now pretty much almost entirely 2025 was profitable and this actually resulted in us being um net profitable historically now, which means we've raised, we have not touched it and we've added to it.
1:16:14Um, so, you know, feel obviously feels really good to be in this position and be able to kind of determine our own, on our faith and not, not be able to, uh, if we, if we don't want to not have to raise money. Um, but, but I think at the same time, there's a lot of, uh, there's a lot of good stuff to spend on and, and we want to, you know, part of it is just this idea of like proactively building pipelines. And for us to have material revenue come from those pipelines, the cost basis needs to be high. I mean, if we want a pipeline to give us tens of millions of dollars in revenue, the cost basis needs to be some order max to that.
1:16:47It needs to be tens of millions of dollars. And so that sort of spend can only happen if we have a really nice cash cushion. so that's why we are going to raise but we um but but we'll try to be very capital efficient still and and basically the only line item on the pnl that'll grow really fast will be r &d which is again this like proactive data spend and everything else we'll try to keep as stable as possible and i think there's a there's a chance even post our next raise and post spending a lot on on these these pipelines, we may stay profitable and it won't be, it won't really be the goal.
1:17:31I mean, I think it's wrong to like fully optimize for profitability right now, but I think it will be the byproduct of just having discipline within the company and having this like insane growth. So, you know, we'll, we'll sort of, we'll look at it as a bit of a bit of a side aim, but, but not like a full focus. Is this something where it's a little bit like Google where DeepMind could not do what they're doing if Google didn't just have this massive cash cow, which is search and ads. And because of that, they're able to take all these other bets. Like I look at DeepMind and they're working on completely different things than other AI labs are.
1:18:07They're working on like protein folding and stuff like that. And part of the reason that they're able to do that is because they've got this just massive cash generation engine, which they know is going to be there pretty much forever. How is that kind of allowed you to take or is going to allow you to take different bets? Yeah, I think obviously DMI is an incredible company. No way that we can compare ourselves in any way. But I think there's this idea of just having a large cash cushion gives you the flexibility to take on big, bold bets. And we believe that this market will be a multi-trillion dollar a year spend market on human data over the long run.
1:18:49But of course, there's a chance that that's wrong. And there's a chance that like, maybe the data business actually doesn't work. And if we have that cash cushion, we'll do everything we can to make it work and be the biggest winner in the space. But if it doesn't, we also have time to make sure that the current state of our product gets applied to something else. So that kind of, you know, comfort is not the right word, but that cash cushion in general allows us to just really take the bold bets that are required to hopefully build a multi-hundred billion dollar company. You posted a blog post probably like two weeks ago now, and you basically said here's why training data and human data is just going to continue to be valuable over time.
1:19:29Do you want to walk through what that actually looks like? Why can human data just be like a trillion dollar industry long term? Yes. I have a lot of thoughts on this, so cut me off if I'm talking too much here. But I, so there's a bunch of things. First is there's this notion of last mile in AI. And I think the first thing here is that the last mile in AI just doesn't exist. The reason for it is, you know, right now, the strategy for labs, what people perceive that the strategy is is that they're kind of trying to automate and optimize the last 10 % of capabilities. But in some ways, that's true.
1:20:16But in other ways, the capabilities that exist currently won't be the same ones that exist in the future. The function space of the economy will expand very largely and rapidly. With every technological revolution, the function space of the economy expands rapidly. But especially with this one, it will expand because humanity will have its time freed up on hopefully all of the current functions that they do, which means all of the current functions of the economy will be automated over time. And of course, this won't be an instantaneous thing. It'll be a very long iteration over time, which means as that happens in a continuous manner, human time gets freed up in every domain and they get to spend time on things that are more creative, more fun.
1:21:09And what that results in is net new functions that get created within those domains. So the example I'll give you that makes this concrete is obviously an area that we're very familiar with, which is recruitment. We believe that Micro One has the most powerful recruiters on the planet currently because of the agent that we built. And they're able to hire hundreds of people every single day. And their functions as recruiters does not look the same as any other recruiter at all. They're still recruiters. That job still is there and it's now way more impactful, but the tasks they do looks fundamentally different.
1:21:43And it's, it's ones that it's a lot more fun for, for, for, for these recruiters to work on tasks that they do versus a task that typical recruiters do. It's almost like the farmer pre and post industrial revolution where you're like actually on a farm versus you're just controlling a bunch of tractors. Yeah. And you can hundred X that across every function in the economy. If, if intelligence actually does become quote unquote commoditized. So now take this recruitment example and take what's happening literally today at Micro One, which is our recruiters are coming up with new things to do that are really impactful, that are now part of their function space, if you will.
1:22:22And now we're going after and automating those functions and this loop will continue. And so I'll give you one specific example in terms of this recruitment function space is that our recruiters, because they don't do any interviews anymore and our agent does all of it, they're able to spend time on this creative sourcing strategies where they create these fun, almost like marketing campaigns. And they're almost like doing kind of a marketing job in a recruitment context where recruiters would not do that before. And so this is a net new function that hasn't been created. And it's a lot more fun for humans that will automate also, but then there'll be nuance.
1:22:57So that's the first thing, which is there is no last mile. And so as humanity comes up with new functions, we will have to create, we would have to get structured human judgment on those net new functions to then automate those functions. So that's first. The second thing is, which is like, you know, maybe even a bigger reason, which is the labs and everyone just broadly in the US and pretty much all around the world is spending a lot of money on computes build-outs and of course algorithm efficiencies like hiring researchers and so forth but mainly compute build-outs like hundreds of billions of dollars maybe like trillion dollars at this point and they're they're betting on future inference and as jensen says a lot inference is going to million x or billion x or something and for that to happen and for the for the for like for the economy to not collapse entirely because of all these build-outs we need to unlock a lot of new capabilities for models and and the inference will the current state of models that inference will not be used at all like very small portions of what the future bet inferences will be used and so we must unlock a lot of new capabilities and and the way to do so again is structured human judgment in each of those domains that we're trying to unlock uh ai uh capabilities in and And there's no other route.
1:24:23The third thing is as synthetic data becomes more and more relevant and useful, what that results in is every human data point becomes a lot more valuable. Because if you think about the current pipelines, what happens in pretty much every pipeline is you take some amount of human structure judgment and you extrapolate that by a lot with synthetic data. Of course, it's not in every pipeline, but like in most pipelines, there's some notion of increasing the data points by orders of magnitude, sometimes like 1 ,000x with synthetic data. And if synthetic data generation becomes even better and you're able to like, you know, millionx that or something, and like the model can train on way less human data points, that's actually the greatest thing that can happen to our business and this human data market, which like is maybe the most basic economic principle, which is if something is more valuable, a lot more of it will be, there will be demand for.
1:25:25And so the spend will increase by orders of magnitude. And so we hope synthetic data continues to be, continues to accelerate in capabilities. And we actually want to like contribute to that as well. And so these are kind of the three main things that will result in this massive market. And actually, sorry, last thing I'll say is there is, if you think about like a, let's take one example of lawyers. Lawyers, what they do in their job is they create basically unstructured data for their law firm all day, right? They redline some random contract, they get paid for it. They do some M &A, they get paid for it.
1:26:03And it's a lot of unstructured work happening, which obviously is very useful for the economy. I mean, clearly. But you have to wonder why lawyers are, as just one example, are getting paid more to work at Micro One than their law firm. They're getting roughly 20 % more. And it's not, I mean, of course it's us paying them more, but it's like the economy that like allows for that. The value that they're creating is just literally higher. Exactly. And specifically the structured red linings that they do, the structured M &A tasks that they create are, the economy has determined are more valuable than the unstructured work they do for the law firm and so so one natural argument is like okay so why don't they just spend their whole time then like clearly but but but but you can't do that because there needs to be some percentage to to actually run the economy until we automate it um and so there needs to be some like equilibrium point of spending some portion of their time on structured value creation and then and then unstructured but but you could infer from this uh argument that if if the current state of basically every domain is some percentage of their time is spent on structured human judgment and human data creation, then over time, basically the entire economy will spend some small percentage of their time on this idea of human data.
1:27:23And so you could take a percentage of the entire labor market and put it as human data spent. So even if you take 5%, and which we have, you know, I did some math on like, well, I think 5 % is reasonable. If you take 5 % of 50 trillion a year in spend, that's$2.5 trillion a year. And then you just discount it by a lot for whatever reason, you know, maybe not all of it will be kind of like recognized in terms of like spend and a lot of it will happen in like less formal ways. Then you can make a pretty clear argument for$1 trillion a year in human data spend over the long run. This almost reminds me of kind of like the safe and when the safe was invented.
1:28:02There was all these very complex instruments that startups used to be funded on. And then I think, what was it? Carolyn Levy invented the safe and it suddenly enabled founders to basically raise a huge amount of money in a very short period of time, simply, simply because there wasn't necessarily as many steps in the process. It didn't cost as much. It wasn't as complex. Yeah. I think in that case, you would maybe argue that because it's so much easier to raise and maybe a little bit easier to also invest, that somehow there'll actually be less VCs? I mean, certainly not. There's a lot more. And that, you know, I think that has a good impact on the economy.
1:28:43So yeah, I think it's similar arguments. The kind of the principle of Jevons paradox. I want to spend a little time on, you mentioned, I think that you're basically getting more and more data points that are like long horizon tasks. And you're trying to have a single person maybe spend a week or weeks on a single data point that, you know, is fed into a model. How has that kind of evolved and how did you kind of come to that conclusion? If you think about the current state of models, they're very good at answering complex questions in pretty much every domain, no matter how complex the domain is, how niche it is, they will answer your question.
1:29:22And you could put some broad accuracy on the answers of like, let's say 90 % just generally of accuracy. And they continue to get better in those as well. And I think we'll approach even higher accuracy just broadly. But then if you think about models doing tasks and what it means to do a task, I think for a human, what it means to do a task is like, you essentially answer a bunch of questions, right? You first determine, you know, the first step of a task is you kind of planning it. So the question is like, what is the plan for this task, right? And then like you take an action and you're just like answering the question of what the next action should be.
1:30:03And like, you're essentially just answering a series of questions. And then obviously you're making some movements to actually act on it. So what the models have to do is basically just answer a bunch of questions in a row to do tasks. And answering a question with 90 % accuracy is a good outcome. But if you have to answer 20 questions in a row to do a task and you do 0.9 to the power of 20, you're going to get like, I don't know, close to zero, like 0.15 or something like that. Some very low number of accuracy, which means you're going to have that task be done correctly like literally 10 % of the time.
1:30:38And that's obviously horrible. And so this idea of like compounding errors is why models are not yet good at doing much. And even for applications that are like coding and they're obviously making a lot of great impact, if you if you ask cursor to kind of go back in the conversation and like check something you asked a few turns ago there's some struggles right and this so this idea of like multi-step tasks and very long horizon tasks is what models continue to struggle with and and so the way to get them to not struggle is by um not creating tasks that are questions and answers but creating tasks that are actual tasks that are very long horizon.
1:31:25So one example would be if you look at the domain of taxes, and currently if you ask anything about W2 California taxes, you'll get great responses. But there isn't really an agent that will file your taxes. So what we're trying to do is one of the RL environments that we're building is essentially simulating the full end-to-end process of filing one's taxes, which is certainly complex. And it's not just about the final tax form that you fill out. It's about first getting the right information from the customer. The customer is going to probably tell to you like, Hey, can you do my taxes and not send you any information?
1:32:04And then you're gonna say, Hey, like, can you send your income for the year, send your bank statements and a few other things? They'll send you half of what you asked. And then you'll have to ask again. And then you'll, uh, you know, you, you'll probably need some more information because it had some capital gains and so forth. So the first step is like a bunch of tasks to actually gather the right info. And then in the context of, again, in the context of taxes, you then have to kind of have a conversation with the customer about like optimizing their taxes. You certainly don't want to get the information and then file a tax.
1:32:31You got to like say, Hey, maybe, um, maybe go buy a car or something and like reduce your, uh, or increase your expenses and you know, whatever, maybe sell some stocks and have some realized losses to, to, uh, match, uh, to reduce to realize gains or whatever it is. And, and then, so, so there's like a bunch of questions to be answered in that, in that conversation. And then, and then there's a bunch of other steps. And then ultimately you file the taxes, which is you take all that previous States that exist, and then you, you, you fill out the form that is sent to the government. And so if you don't have a very long horizon task that kind of gives you rewards that are, that are partial rewards for each of those States before the final action of filing one's PD, filling out one's PDF, you will fail quite badly.
1:33:15So that's kind of the approach we're taking now, which is these very long horizon tasks that simulates end-to-end workflows. A lot of people kind of thought that 2025 was going to be the year of agents, and that didn't really happen, like you said, because they're very long horizon tasks and they're complex. It's very difficult for things to really understand what all the steps are to actually execute and make something happen. How do you think agents are going to happen to the point where we have super useful entities that are able to go execute your will? Yeah, I think you're exactly right. I mean, there's a lot of, there's a couple of really good use cases, coding, customer support, and a few others that have been working very well.
1:33:55But I think realistically, there hasn't been yet a huge adoption within enterprises or just broadly. And I think part of that is part of what people argue is the fact that enterprises, there's just like this lag in the economy to adopt new technology generally. And I think that's partly true, but I would say it's actually mainly because of this notion of evals is not yet built into enterprises. So the first part is, of course, you have to improve the foundational models in these long horizon tasks. So that's kind of the first step. But then the second is when you actually are using a foundational model to build any agent in any given context for an enterprise, you need to actually really further evaluate that within the workflows, within the very niche workflows of that one enterprise.
1:34:47And so this is like this notion of like contextual evaluations, which I think enterprises have not yet really thought about or implemented. And I think the way that this adoption speed changes is if enterprises start to treat evaluations as core as engineering in their full-on product buildouts. So basically a very large portion of the product budgets within these companies has to be spent on evaluations where they're kind of looking at each function that this agent should have needs to be qualitatively assessed versus like, does it work or not? But how well does it work? Final question. What's the hardest thing you've overcome?
1:35:29them realizing in retrospect how much my parents gave up to come to the u.s when they were when they had a pretty good life in iran they they had to um they had to give up pretty much everything and kind of restart their life and of course u.s is definitely the greatest country to be in but if someone has spent decades in one country and has to reset their life entirely it's an incredibly difficult thing to do and you know I remember the early days of my parents like really struggling when they came to the U.S. and us having to kind of live in a single bedroom with a family of four for a long time and all the rest that I'm now kind of appreciative of in retrospect of how hard they had to work for me and my sister to basically be able to live here and have a good education and have the opportunity to build companies and so forth.
1:36:34And so I think this is part of my, maybe the main part of my drive is really making sure that my parents get a great outcome with this move. And hopefully I can contribute to that outcome. Thank you.
From the publisher
micro1 is one of the fastest growing startups in the AI training data / human intelligence space. We talked about what it's like hiring hundreds of doctors and lawyers in a week, how they're collecting real world human data for robotics, and what it was like losing their biggest customer right before an investor pitch.
