In short
Podcast Summary: The Twenty Minute VC (20VC) - Episode with Alex Wang
Episode Overview
- Episode Title: 20VC: Scale's Alex Wang on Why Data Not Compute is the Bottleneck to Foundation Model Performance, Why AI is the Greatest Military Asset Ever, Is China Really Two Years Behind the US in AI, and Why the CCP's Industrial Approach is Better than Anyone Else's
- Host: Harry Stebbings
- Guest: Alex Wang, Founder & CEO of Scale.ai
- Key Highlights:
- Alex Wang discusses the importance of data in AI development over compute power.
- The role of AI in military applications and global competitiveness, particularly between the US and China.
- Challenges and strategies for capturing and utilizing data effectively in AI.
Key Topics Discussed
- Foundation Models: Diminishing Returns
- Core Pillars for Improvement:
- Compute: Increasing computational power alone is leading to diminishing returns.
- Data: Wang emphasizes that data is the primary bottleneck affecting model performance.
- Algorithms: Advances in algorithms are also necessary for improvement.
- Data Wall:
- The industry has exhausted easy-to-access internet data, and future improvements will rely on capturing more complex, qualitative data from enterprises.
- On-Prem Solutions:
- Discussed the potential for large companies to revert to on-premise solutions due to security concerns.
- AI as a Military Asset
- AI vs. Nuclear Weapons:
- Wang posits that AI could be a more powerful military asset than nuclear weapons.
- The centralized industrial policies of the Chinese Communist Party (CCP) may give it an edge in rapidly advancing AI capabilities.
- Global AI Race:
- Discussion on whether China is truly two years behind the US in AI technology, with Wang suggesting that the gap is narrowing.
- Perception and Media Treatment
- Treatment in Congress vs. Media:
- Wang expresses a belief that he receives fairer treatment in Congress than in traditional media.
- He advocates for founders owning their distribution channels to ensure their narratives are accurately conveyed.
- Capturing Frontier Data
- Data Scarcity to Abundance:
- Wang highlights the need for "frontier data" that includes complex reasoning and decision-making processes that are not currently documented.
- Proposed solutions include:
- Mining existing enterprise data.
- Creating new methods to generate complex data involving human experts.
- Roles in AI Development:
- Anticipates new roles for data trainers and contributors to enhance AI capabilities.
- Organizational Structure and Hiring
- Hiring Practices:
- Importance of hiring dedicated individuals (the "Navy SEALs" vs. the "Navy") who are deeply committed to the company's impact.
- Wang mentions that he personally approves every hire to maintain a high standard.
- Management Learnings:
- Reflects on the challenges of hyper-growth and the need to balance team growth with maintaining quality.
- Regulatory Environment and Data
- Navigating Regulations:
- Wang discusses the impact of regulations, particularly in Europe, on data access and AI development.
- He emphasizes the need for more permissive data regulations to foster innovation.
Conclusion Alex Wang's insights provide a nuanced understanding of the current state of AI, emphasizing the pivotal role of data in shaping future advancements. He also highlights the competitive dynamics between the US and China, the importance of maintaining high standards in hiring, and the necessity of navigating regulatory challenges to harness AI's full potential.
Key Takeaways
- Data scarcity is a critical issue for future AI development.
- AI's military implications raise significant geopolitical considerations.
- Founders should focus on direct communication channels to shape their narratives.
- Capturing complex data and fostering collaborative roles will be key in transforming AI capabilities.
- Organizational quality is essential, particularly in a rapidly growing environment.
Written by AI. May contain mistakes. Listen to the episode to check what was said.
Transcript
Automatic transcript. May contain errors.0:00At its core, this AI technology has the potential to be one of the greatest military assets the humanity has ever seen. But it's even more of a military asset than NUX. Let's say China or Russia had AGI today, and the United States didn't, I would imagine they would use that to conquer. The CCP's system is incredibly good at taking very aggressive centralized action and centralized industrial policy to drive forward critical industries. They have a clear shot at racing forward. This is 20VC with me Harry stabbing some My World, what a show we have in store for you today. This was such a special one to do live in the studio as we welcome Alex Wang, founder and CEO at Scale AI.
0:42The company that travelled revenue in 2023 and is expected to finish 2024 with 1 .4 billion in error. Earlier this year they raised 1 billion dollars at a reported 14 billion dollar valuation and this show was immense, really one of my favourite shows to record in recent times. And so let me know what you think and you can watch the full show from the studio on YouTube by searching for 2 .0 VC, that's 20 VC. But before we dive in, as face it, your employees probably hate your procurement process. It's hard to follow, it's cobbled together across systems, and it's a waste of valuable time and resources.
1:17And as a result, you probably are facing difficulties getting full visibility, managing compliance, and controlling spend. It's time for a better way. Meet Zip, the first modern intake to pay solution that can handle procurement and all of its complexities from intake and sourcing to contracting purchase orders and payments. By providing a single front door for employee purchases, Zip seamlessly orchestrates the procurement process across systems and teams, meaning you can procure faster with the least amount of risk and get the best spend ROI for your business. With over 4 .4 billion in savings for our customers, Zip is the go -to solution procurement for enterprise and industry disruptors, like Snowflake Discover Lift and Reddit.
1:58Finally, a solution employees love to use, where buying things for work just works. Get started today at zippachq .com, slash 20vc. And speaking of GameChanger with Zip, we have to talk about Cooley, the global law firm built around startups and venture capital, since forming the first venture fund in Silicon Silicon Valley, Cooley has formed more venture capital funds than any other law firm in the world, with 60 plus years working with VCs. They help VCs form and manage funds, make investments and handle the myriad issues that arise through a fund's lifetime. We use them at 20 VCs and have loved working with their teams in the US, London and Asia over the last few years.
2:38So to learn more about the number one most active law firm representing VC backed companies going public, head over to Cooley .com and also CooleyGo .com, Cooley's award -winning free legal resource for entrepreneurs. I'm finally travel and expense are never associated with cost savings, but now you can reduce costs up to 30 % and actually reward your employees. How? Well, the van rewards your employees with personal travel credit every time they save their company money when booking business travel under company policy. Does that sound too good to be true? or Navan is so confident you'll move to their game changing all in one travel corporate card and it spends Super app that they'll give you $250 in personal travel credit just for taking a quick demo, check them out now at navan .com -4 -2 -0 -VC.
3:30Alex, I am thrilled that we could do this in person. Thank you so much for joining me today. Yeah, great to be here. Now, listen, it's funny. I told you I tweeted before we should skip the founding stories because because there are many, many great times you've told it before, but I want to dive straight in, and I want to ask you the question of, when we look at model performance today, let's just start high level. Do you think we're seeing in case of diminishing returns where more compute doesn't need to better performance? Yeah, I think it's pretty fascinating. I mean, I think there's been this is especially coming up now, where opening I has had you before since fall of 2022.
4:03And since that time frame, we haven't yet seen a new base model or a new model that's jaw -droppingly better than GPT -4. You know, we haven't seen the GPT -4 .5 or the GP5, or the other labs haven't yet come out with models that are leagues and leagues better than GPT -4, despite way, way more compute expenditure. Since when ChatGPT came out, you know, you can look at the graph of Nvidia's revenue, and it just in flex. It's just like, it just goes straight up after GPT -4 came out. And it goes from, I think, the Nvidia's data center revenue, they were doing roughly about 5 billion a quarter and then it shoots up to now it's north of 20 billion dollars a quarter.
4:43So there's been tens of billions going to 100 more than 100 billion of spend on high -end Nvidia GPUs. You know, all in the same time frame, we haven't yet seen the big breakthrough since GPT -4, which actually that model was came out before this huge inflection in Nvidia expenditure. So overall, it's this interesting thing where we're seeing investment into compute go up dramatically go up exponentially right now but we're still I think as a community as an industry kind of waiting for the next great model. So do you think we've reached this kind of asymptotive performance where actually we'll see this kind of plateauing in performance while we wait for that and do we think that's like a monthly thing what do we think that's kind of like self -driving.
5:25Remember self -driving we saw kind of the plateauing performance actually for kind of several years and actually it was only recently where we see that in flight again. It's kind of this interesting thing. So there's three ingredients that go into these AI models or three pillars. So there's compute, of course, there's data and there's the algorithms. The history of AI is that progress comes from sort of all three of these pillars sort of being built altogether. You certainly need a lot of computational capability, but you need the algorithmic advances like the transformer originally or RLHF or you know whatever future algorithmic advances come.
5:57And then you need the data pillar to support it as well. And I think a lot of the plateau that we've recently seen can almost be explained at a very high level from hitting kind of a data wall. The GPD -4 was a model basically trained on nearly all of the internet and using a huge amount of computational capabilities. A lot of the, a lot of I think what the industry has been doing over the past few years is scaling the computation dramatically but not necessarily by building up the other two pillars in tandem. So there needs to be, I think, a combination of more algorithmic improvement, but in particular, we need to ensure that there's more data to support it.
6:32When you say data rule, what is the data rule, and what can we do to enable our overcoming of it? Yeah, so at a super high level, we've used up all the easy data. We've used up all of the internet data, the common crawl and newer versions of the common crawl. Just so we understand, easy data is stuff on social media, anything not behind pay rules, anything that's easy and free to crawl. Anything that's easy and free to crawl or stuff that can be torrented, there's a lot of reports So there's like a lot of torn to data and some of these models or you know It's basically anything that is sort of like already written down and easy to get from the open internet And then the first stage of all of this AI improvement has been this these advances in pre -training Which is basically training these models to be really really good at emulating the internet and right now We're at a point where like these models are exceptionally good at emulating the internet They're better than any human at emulating the internet But the problem is when we think of AGI, when we think of powerful AI systems, we want much more than just emulating the internet.
7:30You want AI systems that can do tasks. You want AI systems that can solve difficult problems. You want AI systems that humans can collaborate with to solve all their daily problems. This process of building agents and AI models that are capable of all these things, we're not going to get there from internet data. And we've already used up all the internet data. Why are we not going to get that from internet data? When we think about effective agents and we think about software doing the work, not just selling the tools I think it's our town will say quite well before. Why is existing data not equipped to do that transition from tools to work?
8:02The simple answer is like a lot of the thought process and a lot of the thinking that Humans go through when they are doing more complex tasks that doesn't get written down on the internet. So for example If I'm a fraud analyst inside a large bank my job is like understanding based on a set of transactions that seems suspicious, whether or not it's a fraudulent transaction. And I need to analyze all sorts of different pieces of data and use my deduction and use all my human intelligence to make that decision. That process that I go through, it's not like I'm writing down step by step, like, oh, I looked at this piece of data and I looked at this piece of data.
8:38And then based on that, I deduce this, and I'm not writing all that down on the internet to later be crawled by these models. One way to think about it was like, all of the reasoning and thinking that is powering the economy today, none of that gets written down on the internet. And so if you just train on the internet, the model has no ability to learn from all of that. So how do we codify and capture the data that's not codified already? As you said there with the fraud analyst, the thought process, the analysis, the discussion that goes on in internal meetings, that's not codified in data sets, how do we capture that to enable us to do the work?
9:10What I really believe is what we need from now forward is frontier data. We need to basically have data abundance of frontier data. We're right now we're in a sort of data scarcity mindset or we're hitting a data wall. And this frontier data is exactly what we're talking about. Frontier data in my mind is, you know, complex reasoning chains, complex discussion, agent chains of models going and looking up a piece of data, doing some reasoning, looking up another piece of data, maybe correcting if it has an error, tool use, all of the key components that we would think of an agent being able to do, that all needs to be encapsulated into the frontier data to power the four capabilities of these models.
9:46How do we capture that data? There's basically three pillars. So first is there's a lot of this data that's locked up in the world's enterprises today. And none of that gets on the internet for very good reasons. But just to give a sense of scale, you know, JP Morgan's proprietary internal data set is 150 petabytes. The GPT -4 was trained on an inner data set that was less than one petabyte. So the amount of data that exists inside large enterprise is just absolutely astronomical. So there's one process of just sort of mining all this existing enterprise data for all the goodness that exists within it.
10:20But you would never get that open source, would you? So this is all proprietary and then delivered custom to that customer. Exactly. This is to be a process like every enterprise, like I have a set of very important problems for my enterprise. Then I need to go through the process of like basically mining all my existing data and refining all that existing data for use for AI systems to solve my own problems. So when we think about kind of breakthroughs, we said about diminishing returns at the beginning, you know, I spoke to one of the most powerful CTOs in the world the other day, and they said the real breakthrough in kind of this question of all we reached in diminishing returns, it's like whether we can really solve reasoning.
10:53How do you think about our ability to solve reasoning and that impact of data that you mentioned there in helping us navigate that? Yeah, I actually think that, you know, if you look at what these models can do, they're very good at reasoning in situations where they've seen a lot of data before. You know, I think we like to think about these AI as if they're like little human intelligences, but they're very different. Human intelligence and machine intelligence are very different. Humans have a very general form of intelligence. If a kid is raised in a very small neighborhood, they can live their whole lives in that small neighborhood and then go to an entirely different part of the world and they can navigate and understand what's going on.
11:27No AI system today would be able to do that level of sort of drag and drop in one situation to another situation and figure out what's going on. I think we have to be cognizant that that's a limitation. But what that means is that for any situation that we want these models to perform well in, we need to have data of that situation or that scenario, and actually the model will perform really well. So there's kind of two ways to think about resolving the reasoning gap that exists in these current models. One is obviously you build some sort of general reasoning capability, which would definitely be a big breakthrough.
11:57The other one is just it's a data problem. It's like you need data for every scenario where you want these models to reason well in. You just need to overwhelm them with data and all those scenarios and you're gonna get models that can reason really well How do we move from an environment of data scarcity to data abundance when we appreciate the immense amounts of data That it's a JP Morgan or Goldman's house or any large enterprise has but also the proprietary nature of that which won't actually go to Generalize models which will help the world or humanity or any of these kind of breakthroughs actually occur to everyone else How do we move from that data scarcity to data abundance is it synthetic data that we're creating?
12:31How do we think about that? Yeah, so I think the second part is to your point, new data that has to be produced. We need the means of production of new frontier data to get us from, you know, GPT -4 to GPT -10. I think when we think about chips, this is very natural, which is, oh yeah, we need to build more and more fabs, we need to build bigger fabs, we need to like increase the resolution and get lower and lower nanometer fabs. Like, for compute, it's very natural for us to think about increasing the means of production. But I think we don't think about this with data. And I think we need to do something very similar.
13:01And this process of producing data, it's sort of a hybrid human synthetic process. And that's really how we think about it, which is you need algorithms that can do a lot of the heavy lifting in producing synthetic data, but you need human experts who are going to be able to guide the AI systems and basically help provide input as to, you know, when the AI system gets stuck or when they have a factuality issue or when it's in a situation where it hasn't encountered before. A lot of autonomous vehicle scale up has been through the safety drivers. You have safety drivers inside the car, and when the car starts screwing up, you have the safety driver disengage and take over.
13:36You need that kind of setup for these AI systems. You need AI models to be generating large amounts of data, and then humans who can take over and nudge the models when necessary to make sure they get really high quality data. What is other in the structure of organization state? Do we create new roles for these AI savis? Yeah. Yeah, trainers is one term AI trainers or contributors is another term. For what it's worth, I think this process of contributing data to AI is actually one of the highest leverage jobs that humans can have. And the reason for that is let's say I'm a mathematician. I can either go into my hole and do pure math and try to do pure math research.
14:19That's one trajectory for my life. The other trajectory is I use all my skills and talents and intelligence to help make these AI models smarter. Let's say I make GPT -4 just like a little bit smarter on math. If I take that little bit of improvement of the model and I sum that up across all the times that GPT -4 is going to be called and used across every math student who's going to use GPT -4, every company that's going to use GPT -4, every developer that's going to use GPT -4, that's a huge amount of impact. And so as a human expert, you have the ability to have society -wide impact by producing data to help improve these models.
14:56What we see is for scientists, mathematicians, doctors, human experts in the world, it's an incredibly exciting proposition to be able to, I can transmit my capabilities and intelligence training all of that into a model that's going to be able to have society -wide impact. I mean, it's an incredibly exciting proposition. How do we think about the structure of data? Often people talk about the biggest challenge in daily governance, it's actually just like the structure and cleaning, when we look at the 150 petabytes of JP Morgan data, I have no idea, but I presume it's not structured perfectly for a lot of models to ingest efficiently.
15:30How do we think about the structuring of this huge data set that I'm sure all large enterprises have and the challenge to that poses? So again, I think this is a case where there's two parallel efforts. One is mining existing data, which by all means is going to be a one time hit. There's going to be a one time benefit that you get from mining all your existing data, and it could be really meaningful. Do you think in five years' time, everyone will have mind that larger data sources internally? I don't think everyone will, but certainly the most sophisticated companies will. And then we'll be at a point where we still need to make the models better.
16:02At the end of the day, it'll all boil down to data production. What are the means of forward production? In the same way that you need the means of forward production for chips and all the other things that you care about? Okay, so we have that in terms of mining existing. You said that was another fool. So there's data mining and then there's forward data production These are the two core core directions for where we need this data to come from and I think kind of taking a broader step back I think that a lot of AI progress at this point is Fundamentally more data bottleneck if we were able to produce Compute and data in lockstep with one another so as in video continued to manufacture actually hundreds of billions dollars worth more of chips.
16:43If we were able to produce a proportional amount of data as we got more and more chips and we were able to produce these two together, then we would get astronomically more kippled. But just so I understand. So when we think about increasing the supply side of data, what is the literal ways that we can do that? What comes to my mind is actually Dan Sorokra at limitless, but he basically has this new hardware device which records like every single thing that you say and do and it produces your own personal AI because it has everything that you've ever said in the day. That is a new form of data creation in my mind.
17:13How do we increase the supply side of data? So there's probably two main pieces. One is like this effort from LimitList or other efforts, which is basically much more longitudinal data collection. Collecting more of what's naturally happening in the world. There's a bunch of forms of this. So one is like in a workplace, I think you're going to want, you know, as creep as it sounds, some kind of constant data collection of what apps are using, what order apps are using, you know, where do you copy paste one thing to another thing? You have a lot of this with RPA and a lot of UI post flows. Yeah, exactly.
17:42You still have that. Yeah, yeah, yeah. So process mining, which is one of the terms, it's asked. But basically like the continued collection of existing enterprise processes, then there's the consumer version of that, which looks kind of what you're referencing, or maybe it's with the meta -ray band collaboration or whatever device ultimately does it, but sort of something that collects, you know, the longitudinal view of your own life. And then there has to be a real investment towards human experts collaborating with models to produce frontier data. So both of the things I refer to before, both enterprise process mining and for lack of a better term, consumer data collection, those are all going to produce valuable data sets, but they're not going to produce the data that's actually going to push the models forward.
18:23Because the push the models forward, you need really highly complex data that's going to be able to push the frontiers of what the models can do. So this is where you need the agent behavior. This is where you need the complex reasoning chains. This is where you need advanced code data, or maybe advanced physics, or biology, or chemistry data. These are the things that are really needed to push the boundaries of the models. I think this is a global kind of infrastructure level effort that needs to happen. I think we need to think about it as how do we get the world's experts to collaborate with the models to help produce AI systems that are going to be the world's best scientists, or the world's best coders or mathematicians.
18:57When we think about the commotivization of the models, as everyone says that we have. How do we think about proprietary access to these data sources? People have said to me before that I don't mean to throw a shape, like open AI's models are not necessarily better, they've just had better access to data, they've bought more data, whatever, whatever, but data being the central superiority element of why they had better performance in the past. Will we see one model get access that others don't? How do we think about fair and actable access to data from the model side? Yeah, well, I actually think to your point, If you think about the competitive playing field of these different model providers against one another, there's three pillars.
19:33There's algorithms, compute, and data. And data, I think, is actually the primary pillar that you can imagine a real durable competitive advantage emerging. So if you think about where there are modes in this LLM race or where there are modes in this foundation model game, I think data is one of the few areas where you can produce a sustainable mode. Because the issue is algorithms, that's IP that at some point the rest of the industry will learn about, you know, you can have more compute than other people, but other people can just spend more money and buy that compute. And data is one of the few areas where you can actually produce a long -term sustainable competitive advantage.
20:07I agree. When you look at some of OpenAI's, you're going to say obviously partner with the FTs, get access to all of the FTs, historical library, and they've done quite a few actually with ASL Springer, I think. That is access to a lot of other models. Do not have, which will make their content superior in whatever queries they have in that respect. Yeah, exactly. And I think this is the start of this form of thinking of sort of data as a mode. You know, there's the FT, there's SQL Springer, these are the first indications of this. But in the future, these labs are going to be thinking a lot about, okay, what's the data that I'm going to use to differentiate relative to my competitors and how I'm going to produce that data?
20:39And what is the long -term, durable advantage created by that? I actually expect that, you know, everything we've been talking about data around model commoditization, we're going to see companies start building data strategies that drive more differentiation in the market over time. I mean, another way to think about this is, right now in San Francisco, researchers and the big CEOs brag about how many GPUs they have. The biggest indicator of how serious they are about AI is how many GPUs they have, but I think in the future, they're going to brag about what data they have access to, how much data they're producing, and what are their sort of unique rights to different data resources.
21:15Anything that's actually going to be the primary plane of competition in the future versus just, okay, Jensen's giving me however many hundreds of thousands of GPUs. Given data strategy being a potential element that one could win on and compete on in different ways, do you think we will not see the commoditization of these models over time? There's two futures. One is that even data strategy becomes something that very quickly, commoditizes and different labs sort of copy one another or they all end up converging to the same direction. 100 % because especially with a lot of the content produces, they're not going to do exclusive agreements with one model and not other models.
21:53Yeah, different labs need to have strategies to produce their unique data sets. Let's say, Anthropic, for example, has focused a lot on enterprise use cases. And maybe they need to develop a data strategy that enables them to have a very differentiated access to new data to support those enterprise use cases. Or maybe OpenAI with ChatGPT needs to develop a unique data strategy that lets them leverage the fact that they have all these users and all this reach. The various labs are going to need to lean into where they're going to be able to get proprietary and differentient data going into the future.
22:27Do you think we're going to see a reversion back to on -prem? I'm jumping around so much, but I'm loving this conversation. Sorry for that. But when we think about the 150 50 petabytes of cheaper, more data. I don't know if they're going to be like, yeah, I'll throw it all in the cloud. My most sensitive data. Will we see the reversion back to on -prem and models that work on -prem for these large enterprises? This is a super interesting question. I think when we talk to... Thank you, Alex. I think when we talk to these large enterprises and the leaders within these enterprises, they're very quickly realizing this fact that you stumbled on, which is that their enterprise data might be their only competitive differentiator in AI world.
23:05They're extremely, extremely cautious about, you know, if they do a deal where all their data somehow a model developer gets access to it or they share it in some way, then, you know, they could be mortgaging away their entire future. And so I think they're very, very cautious about that. And this is actually why I think there's a very big sort of opportunity for whether it's open source models or the Lama models or the that can go on -prem and that enterprises can take and then customize on top of their own data, and then it never has to go back to a model developer or cloud or anything like that.
23:40I think that there's a huge unmet need there. And I think that's actually where most serious enterprises are gonna go towards, which is, I need really, really strong guarantees that my data is not gonna be used in any way to improve my competitors. I think AI services will actually create more of a new of them that's five years than AI models. We saw actually extension come out with, I think it was $2 .4 billion in revenue from January to May, and opening it was obviously $2 billion. How do you think about, I'm just intrigued with scale AI today, and working with some of the large centur prizes, a services component that learning an adoption curve is challenging for large enterprises.
Read the full transcript
24:13Do you see that as a core part of your business in the next few years as we scale the education curve? First of all, I think you're right. There's so much value to be generated from AI for sure, but then there's this natural question of where's the value capture going to be, right? It was this fascinating thing. If you go back and read a high output management by Andy Grove, there's these chapters around like, oh, for Intel, first we thought that this is where the value capture is gonna be, but then we realized it was gonna be in this other part of the stack and we had to migrate to that part of the stack and then we had to migrate again.
24:44And it's this incredible case study. I remember reading that and I read it maybe a decade ago in a different era of tech and I was like, this is weird, this doesn't feel very relevant. And then now in AI, you're seeing it once again where it's so new and so nascent where exactly where in the stack value will accrue feels like it's constantly moving. And I agree with you, I think that the models themselves, there's so much competition there. I don't know how much value accrues at literally the model itself, but everything above the model and everything below the model, I feel very confident that there will be value accruing.
25:16So for the infrastructure, I mean, Nvidia's the biggest company built on AI today, like they're the third most valuable company in the world. Nvidia is more valuable, you know, their market gap is higher than meta and Google and Amazon and Saudi Aramco I mean, it's really started like Nvidia is an incredible credible company and that's below the model and then above the model You have all these apps and these services that are gonna be built on top So I was arguing with someone this morning actually on the way here, though, and I was saying like yes Okay, we have notion AI and we have you know box the storage company who are gonna implement AI solutions into their existing storage products So you can extract information better.
25:52Yeah, have you seen the numbers? Salesforce are now growing at single digits, like Mongo and Albury at single digits. Point being, actually the commoditization of these features means it'll be better products for us, but I don't know if you'll get value extraction from that and the form of increased pricing. How do you feel about that? Yeah, so our thesis on this is there was this article that flew around the end of software, right? I saw this Chris Pike. You're from Chris Pike. Yeah, it was an intentionally provocative point of view, I think. So for those that haven't read it, what was the core premise just so they understand it?
26:24I thought it was like a brilliant comparison, but he basically drew this comparison of software companies today to media companies, pre -social media. The rough comparison was in the older days of media, you had all these incredible media companies, there were these high -end shops where there were like all these experts producing this very differentiated content, but then it got disrupted by social media and the internet broadly because all of a sudden you just had the Content distribution cost came down dramatically the world of media consumption turned into this like very broad Constellation where you would consume whatever media was produced by anybody those interesting to you and it was sort of like much more on demand versus being the sort of walled garden of large media producers and Basically this comparison to that's what's about to happen to software which is now the enterprises live with this walled garden of some small number of software providers and what's going to happen now with gender AI and all these other trends is they're going to have this constellation of all these different apps and point solutions and this sort of portal to that constellation of various software providers and This sort of like we're going to move from this current world of like smaller number of walled garden SaaS apps to this sort of much more decentralized Universe to agree with that It's intentionally provocative, right?
27:42But I think one thing that is true is I do think that enterprises and the world at large are going to demand greater levels of customization. They're going to demand greater levels of personalization and stuff that is really purpose -built for their business like a glove. The first tech company that ever did something in this direction was Palantir. You know, they got a bad rap for a long time because everyone thought the Palantir, oh, So there's a consulting company, but Pounder's point of view, which is provocative as well, was like, no, what we're going to do is we're going to go into enterprises.
28:15We're going to understand exactly what their problems are. And we help them build the perfect application for them that's built on the connection of their data and all that stuff. And if we can do that, then we're going to build something that's far more valuable for them than what any other software provider is going to be able to produce. And they did this obviously before, generally, via before all these tools that are going make this this motion a lot more feasible. But I do think there's an element that this is like the way the world is moving, which is now especially that the software production costs and software creation costs are going down so dramatically.
28:48We're going to end up moving towards a world where more and more of the software that enterprises consume are going to be customized and custom built and purpose built for exactly their problems. What does that mean in terms of the makeup of engineering teams of large end prices? Do they shrink? Do they focus on different things? Do we just have teams of the world's best prompt is what does that mean in terms of the changing structure of engineering teams? Yeah, well, I think software engineering in general is going to change dramatically. A lot of what developers spend a lot of time on today, it will not need to spend time on going to the future as the models get better and better coding.
29:22But there's certainly big parts of what they do, which are irreplaceable. And over time, I think that the part in particular that's very, very valuable is this sort of like general process of going from water to my customer problems or water the sort of like problems I need to solve and like translating those into engineering problems and scoped sort of like tickets almost that can be solved by an AI engineer. Everyone says that we're going to see the end of per se pricing like he said, Chris had that provocative article but I everyone was by the end of per se pricing. To what extent do you think we will see the end of per se pricing in this next way of software and especially with the data lens where you could see a more consumption based pricing model aligned, do you think that truly takes over?
30:05The reason that Percy pricing doesn't make sense going to the future is that at an enterprise, today, certainly most of the productive work is done by by their employees, done by people. But in the future where you imagine more and more of the work is done by AI agents or AI models, then Percy pricing doesn't really make sense as a provider provider of software, provider of solutions, you want to make sure that you're capturing the value that you're providing to the people, but also the value that your agents or your AI systems are producing. That shifts a lot of the world towards consumption based pricing versus perceived.
30:39One of my biggest worries is obviously we're in London. We specialize in many things here at Long Lunch Break and Regulation. And we're so diminishing on London. But my question to you is, I really worry that we're going to see regulatory provisions which stifle innovation because of consumer data, protection acts, and just unnecessary regulation around data access. Do you think I am justified? And how do you navigate the regulatory access to data question? It's a really important point, and I think that certainly what we've seen in the EU is a very restrictive approach to data. My personal belief, I don't think that more permissive regulations around data are at odds with being a liberal democracy.
31:25More sort of liberal data access provisions are in fact very compatible with being a liberal democracy. And I think that we as a society need to figure out what the right balance there is and how we sort of square the circle. But I think this is a very important question because it's almost like, I think in the United States, there's been a huge amount of effort and real regulatory effort on terms of, how do we ensure we do not slow down chip production? How do we make sure that we can keep manufacturing huge amounts of chips and the US won't be disadvantaged from that perspective. We need to take a similar lens to data.
31:58So how do we from a policy standpoint, both in the US and in the UK, frankly, how do we think about ensuring that as countries, we're not tying one hand behind our backs for future data production for these models? Do you think the US is currently tying one hand behind its back in terms of that? I'll put it this way. We're definitely not taking a pro data regulatory. What would a pro data regulatory stance look like? I've used a few things. I large data sets that do not lend proprietary advantages to specific players that need to be sort of centralized and made accessible to whole industries. So simple examples, safety data in, let's say aerospace, which is a hot topic, obviously.
32:39But safety data in aerospace should be collectively pooled for the purpose of advancing the entire industry forward. Or the data I mentioned before, or the example mentioned before, fraud and compliance in financial services should be pooled together and should build forward capabilities. So I think there's like entire industrial sectors where there should be some degree of data pooling to just push forward the overall industry. And I think what you need is in a lot of consumer facing areas, we need to work through a lot of the existing restrictions to make sure that those don't prevent AI progress.
33:14So one great example here is actually HIPAA in healthcare and all the PII and other limitations. Right now, HIPAA and all the PII regulations will more or less prevent patient data from being used to train AI models. But I think we can agree as a civilization, as a human race. We really want to learn from all of the existing medical data on how do we cure human diseases going forward. And so we need to figure out like how are we going to make it so that like there's very clear non -animization provisions or There's a there's a very clear and obvious way in which you can use existing patient data to improve future health outcomes I had actually the China apparently I come who said this on the show But they said that like two years behind the US in terms of AI progress I had that and I thought that is absolute shit And I think when you look at like data provisions and what the Chinese government will be willing to do in terms of data access and data provisions and regulation.
34:07I think if they ought to use behind that, we'll very quickly catch up. How do you see China being to use behind and do you agree with that? Two years ago, there were probably more than two years behind. When opening I first produced GP4 in the lab, China were nowhere near that. But just even the past few months, there's a Chinese company, 0101 .ai, that produced a model E large, YI, dash large, that is one of the best models in the world. I think it's just behind, so it's behind GPD40 and Gemini and Plod3 Opus. And it's the next model right behind that in the leaderboards. So it's one of the best models in the world.
34:46So we've already seen them meaningfully catch up. They are like Chinese, LLM and AI capabilities are, I would say right now, pretty close to Neck and Neck with US capabilities. And I think if you plot the path ahead, based on everything we've talked about with data, they have a clear shot at racing forward and racing ahead of us. It comes down to at its core, the CCP's system is incredibly good at taking very aggressive centralized action and centralized industrial policy to drive forward critical industries. And what we've seen even in the past few years or the past few decades, frankly, on solar, how the CCP has been able to make take industrial policy to the point of like being by and large the world later in solar.
35:28And then most recently EVs and how the CCP's system and approaches been able to create very, very cheap EVs. You're seeing this pattern play out over and over again where the CCP approach to industrial policy is not the most innovative. But once an industry has been established and it's about turning the crank, they are better at turning the crank than any other economy in the world. I am totally agree with you. I saw actually a chart. I can't remember who tweaked it yesterday, but I think it was either Elon or Bill Ackman. And it was basically showed countries different kind of creation of EV providers.
36:01and it should like the US. And it was like the US, I mean, without Taster, it would have been in the dumps because it would have only had the end -general notice, but China was like up into the right. Does that worry? It worries me a lot. You know, one of the elephant in the room topics, which I think is an AI community we rarely discuss, is that at its core, this AI technology has the potential to be one of the greatest military assets the humanity has ever seen. Let's say you had a GI, and you have one country with AGI, and another country without AGI, which one will win in a war? Well, probably the one with AGI is gonna figure out how to produce all the weapons, or we'll figure out a brilliant military strategy, or we'll be able to hack the other country systems, and it is potentially one of the greatest military assets that the world's ever seen, but it's even more of a military asset than NUX.
36:48And so, if you think about this, we're in a geopolitical environment that is increasingly tense. The amount of conflict in the world has been monotonous increasing in the past few decades, You're seeing these multiple wars being fought in the world and some of them without very clear paths to resolution And there are totalitarian leaders right now in the world many of them for whom like let's say China or Russia Had a GI today and the United States didn't I would imagine they would use that to conquer That's a really scary outcome for the world writ large and I think it's one that the Western world and he's spent a lot of our thought and effort towards preventing that outcome.
37:26Given that concern, should we not have closed systems? Obviously, open systems have a lot of benefits, but the challenge of open systems is anyone can use them and that means that Russia can use them, China can use them, and everyone has the same levels of access, well, supposedly so. Should we not have closed systems with what Yijia said? I think there's a bit of a dichotomy that must emerge. I think we need to think about the most cutting edge and the most advanced systems, those we will want to ensure are closed for geopolitical reasons, for military reasons, for whatever reasons, like as we develop systems that are genuinely so so powerful, we will want to keep those closed.
38:01That doesn't preclude us from making open, less advanced versions of technology, that frankly just have the ability to produce a lot of economic value. And I think that's where we are with Lama right now. Lama 3 in and of itself is an auto -military asset. yet. And I think that there's clearly a line underneath which I think it's totally fine to have open models. So that's what we need to be thoughtful about is where that line is and when we're getting close to it. Before we discuss some kind of company building principles which I do want to touch on, Tania's time, what does that foundation model layer look like?
38:31Who's independent? Who's been acquired? What does it look like? I think at its core, what we've seen about the foundation model race is that it is incredibly expensive. And it is expensive to the level of, you know, these malls have gone from crossing hundreds of millions to a billion dollars to maybe multiple billions. I think in 10 years time, maybe they'll cost tens or hundreds of billions. There's just not very many entities that have that much discretion in capital to invest into these AI models. So naturally, what will happen over time is AI effort, the foundation law efforts will coalesce around nations or the large tech companies over time.
39:09Basically you will see the most all these hyper -profitable business models whether that's a nation state or one of the hyperscalers those will be the only entities that could possibly subsidize or underwrite these massive AI programs. In the future already it looks like a battle of giants but at that point it's even more a battle of giants. So do you agree with me in saying that you'll see all of the small players acquired by the large cloud providers who Google your Amazon and you're in video you name of your logic and components, but especially the large cloud providers and how they're integrated in 30 system solutions.
39:39Yes, with maybe an asterisk that there's some of these partnerships that I think it'll be interesting to see how they play out. You know, the opening, Microsoft partnership or the Anthropic Amazon partnership. One of the most interesting questions of this technology era is how do these partnerships actually end up playing out long term? Listen, I do want to touch on some company building principles. Let's start with, I can't remember the exact thing. You said it on PR. It was a brilliant statement. This was it which is the best P .O. is no P .O. What did you mean Alex? At its core, the traditional press industry is not particularly conducive to great companies being built And let me be more specific around that.
40:15A lot of traditional press is oriented around generating clicks And so the traditional press engine will it'll build you up and it'll generate clicks on the way up And it'll tear you down and generate clicks on the way down This is in contrast to I think 20 VC and other direct outlets so to speak, were founders and companies of a direct channel to get their message out and explain what they're working on? You know, I think the other thing, and I actually think it's a little bit unfair, I feel for traditional media, I don't care about clicks. Like, yeah, we have sponsors, respectfully, if we didn't have them, but still we're doing the show.
40:48I don't do sensationalist headlines, I'm not going to put some glossy thing, scale AI, I predict is military devastation, with this episode, because I'm not there to just optimize for clicks. Exactly. Yeah, you're there to genuinely educate and explain what's going on to your audience. It's almost unfethered. Can you imagine if someone said, hey, I'm gonna do scale AI. But I didn't care if we lose money. It would be like, oh fuck, how do I compete with that? Yeah, it's pretty stark. You know, I feel like I've received more fair treatment testifying in front of Congress than I have from various media outlets over the years.
41:24It feels like this totally ridiculous statement, but I think we're in this perverse state of a lot of traditional media where this system itself, you know, because of this sort of like very click oriented approach versus a genuine educational approach, it almost has no way of being fully fair to the companies. And so I think it's the imperative is on the companies themselves to properly tell their story through direct channels and through podcasts and through avenues where their message won't be altered. I completely, I think this is why Founder Brandt's day is more important than ever because if you don't own your means of distribution, it will be contorted.
42:00Exactly. It's kind of a shocking state of the world, but it has that changed your strategy then. Yeah, I think for us, we think a lot about how do we get the direct message out there and how do we develop to your point like, what are the purest ways that we can transmit and explain what we're doing? And this is a great example. You know, you'll ask me a question. I will answer exactly how I believe that I think, and this will go out to your listeners and your viewers. One of the purest forms of getting the message out there. I think one thing that people make a big mistake on those is that they then try and build the direct channels for the companies.
42:30And respectfully, people don't follow scale. People follow Alex. It's much easier to build followings with personalities than to those companies. I think there's just, I think there's like so few companies that can open a eyes one where like, I think OpenAI's and NAD has a lot of meeting as a brand. But very... It does, but if you look at the amount of times that Sam Altman trends versus the amount of time that OpenAI trends, it is disproportionately higher to Sam Altman. People still now more than ever love the cult of personality. Yeah, that's a fascinating thing. I mean, that definitely should be...
43:02And that transcends actually when you look at Lionel Messi at Miami, when you look at Margot Robbie with Barbie, the slabbitization of individuals in organizations or in movements drives everything. That's fascinating. I mean it probably speaks to a deep a deep human need I think we as people we have a lot of circuitry to understand Individuals we have this ability to understand individuals. It's very hard to understand what an organization means There's no intuitive so ship founders give a shit about traditional PL should they care about getting in that traditional press? I would argue no I would argue we're in an era now where they they shouldn't they should think about what is an interesting point of view They can have what is the most pure way to get that point of view across when do you feel the prostrate to tie you down on Fali.
43:43We've had, I would say, that almost precisely we've had this story where we had an incredible rise up and an incredible come up. Maybe we initially became a unicorn back in 2019 and for the few years after that, it felt like smooth sailing. And then starting in about 2022, when the entire media narrative was tearing down tech companies. because in some ways it was very fair. Many, many tech companies received very high valuations. There was an incredible amount of excitement in tech and then the markets all crashed. That, in starting in 2022, was when I noticed for us specifically, the tone entirely shifted, where it was the media engine pointing itself towards pointing out all the missteps from companies like us or a lot of our peers versus trying to take a balanced perspective.
44:33And there were even another example of this is So starting in about 2020, we began working with the US military and the US DOD. This is obviously long before the current defense tech hype wave and long before all that, but it was driven by an intrinsic belief that we had as the I had and we had as a company that it's important for the United States DOD to have access to incredible AI technology. That was like a fundamentally important thing for the future of the world. And in the years after that, by and large, the traditional media engine actually tore us down for supporting the US government and supporting the military versus taking a broader view that maybe this is a positive thing actually to support the US military.
45:16This almost goes to what I was saying about the dichotomy and treatment and, you know, testifying in Congress versus with the media. I testified before Congress about AI's use in the military. I would say the treatment I got there, I think, was a properly broad one. It was, hey, obviously this is powerful technology that we need to be thoughtful of, but it is so important that America leads in this. And thank you for everything that you're doing. That, I felt, was the response. Whereas in the media, it's this incredibly scornful perspective around, is this a good thing? Do we trust this company?
45:47Like, what does this mean? I mean, it's this shocking. But I think it goes back to the incentives to our outcomes. And what is the incentives of media versus the incentives of Congress? Congress will not let us sell you or clicks. Then I hopefully get to an informed decision on the best outcome. Exactly. Yeah. Okay. On the incentives to our outcomes, I loved something. You also said, you said, why hiring people who give a shit is harder than it sounds. What do you mean? And how do you think about that when hiring? If you hire people who we say give a shit internally, but who really, really care, you their work product, they really really care about the quality of their work.
46:22They really really care about the organization. They care about making sure that the company has an impact. They just really care. And what that means, how that manifests is they're willing to sweat every single detail. And if they get road blocked or there's like something in their way, they'll spend the extra, they'll go the extra mile to make sure that they get through those things. That's how startups work. These small teams of people who each care ten times more than the average employee, ten or a hundred times more than the average employee inside a big company, You end up just solving so many more problems than than the big company.
46:51How many people do you have in scale today? We are about 800 people. 800 people. You are now getting to the kind of bigger company size. It is harder, you know, the kind of only higher A++ or A++. A++ by definition, a rarer. Can you have 800 A++? I think the answer is yes. You know, what we say a lot internally is how do we hire the Navy seals, not the Navy? Not there's anything wrong with the Navy, but how do you have, you know, a really small elite group where you're really hiring the cream of the crop. And this goes down to process. You know, for us, at this point of the company, still I approve every hire.
47:25I will either indirectly interview or look at the interview feedback and look at the understand every single person who we hire to ensure that we're keeping an exceptionally high bar. And that way, if there's... What percent of the time will you go against the recommendation of the team on a new hire? Maybe on average, 25 to 30%, like a lot. Wow. Like a lot. And I think usually it's due to, you know, maybe there's a new hiring manager who, you know, needs to get calibrated or it's like an edge case of various forms. But to me, the way I think about this is like, I, as the founder of the company, I have seen everybody who's come in and I've seen who succeeds and who fails.
48:01I have, as an algorithm almost like, developed the most fine grain data set of understanding what it looks like for people to be successful at scale and what it looks like to have the Navy SEALs versus the Navy. and it's my job as a founder to help ensure that we as an organization are actually utilizing all this knowledge and utilizing all this learning that's been happening over the past eight years in the organization and carrying that forward. Finally what, what was your biggest management leadership fuck up? So for an example, for my name, people act out of fear or freedom. You know when you bring someone in, some people act out of like you have to perform, you have to perform, and other people act out of hey I trust you, I and you just have to identify which camp someone's in and then hopefully if they're skills there, they should operate to their best.
48:48I wish I'd known that when I started and I didn't and I just tried to act out of fear for everyone there. What do you know now that you wish you'd known and why did you fuck up? The biggest one was actually, you know, in the same era of like 2020 -2021, was thinking that hypergrowth is a company meant that you had to hypergrow your team. In those few years, we did were a lot of tech companies it. We like double triple the team here on year in 2020. We were about 150 people by the end of 2022. We were over 700. It was this insane amount of hiring and this incredible amount of hyper growth as a team.
49:26What I found out is when you hire that quickly, it is impossible to do what we just been talking about, which is maintaining this high bar and maintaining this feeling of excellence within the team. Did you see the reduction of that bar in real time? It was kind of subtle. It was something where you would hire all these people in and you'd notice it like the next year or the next six six months later. You would notice it slowly and that the organization, you know, there were challenges that the organization used to be able to to deal with and solve that slowly just calcified and we weren't able to we weren't able to get around.
49:58And so you'll notice, you know, from the end of 22 where I said we were 700 people to now we're 800 people, team has mostly kept the same size. But the company the revenue of the company has grown dramatically. It's funny, companies have like brand inflation points, they go hot, they go cold, they go hot again. Do you know what I mean? It feels like from the outside, scales hot again. Well, that's uh... I don't mean that like to be super nice or not nice, I didn't mean it when saying you're cold, but it's just weird how brands have moments of heat and not heat. This is a fascinating thing actually.
50:29I actually asked Patrick Carlson this question as well, and Stripe obviously is an incredible company that has, for a lot of their lifetime, I think it's been one of the iconic Silicon Valley companies. And I asked him whether or not he thought that the fact that they were such an iconic company was beneficial in all the hiring they did. And he made an interesting point which was that the best people they hired, he thinks would have been people who would have joined whether or not they were the hottest company in Silicon Valley. It was the sort of like off the beaten path people who were actually the best hires they could have gotten.
51:04And a lot of the people who joined because they're with the hottest company in Silicon Valley for one reason or another weren't necessarily the most valuable employees. And so there's this there's this element where I think the common belief and the common narrative is like you want to be the hottest company so you can track the best talent so you can hyper grow So you can then go keep growing and anything that's often so so difficult and it's much more about like How do you develop an ecosystem of talent that is like very self -preserving? Keeps a very high bar and always seeks out and searches for the best people and then an independent of whether the company's heart or not heart because you will have to your point.
51:37You'll have moments where your heart wants to your not heart, moments where your heart not heart. And you need that talent ecosystem to be self -preserving independent of that to drive the best out. I also think it depends on functioning. Like when you look at a lot of go -to -market functions, traditionally for sales, they do like concentrate towards hotter brands. And actually if you can get a concentration of incredible sales people, especially as you expand yourography, something about open AI is kind of go -to -market team in London. Unbelievably good, one on the best in London. And it's because they have an amazing brand.
52:02GCO, I mean, so it depends on how close you are to the nucleus and what function you're in. Yeah, I think that's right. Yeah, yeah. But then if you look at core technical development of OpenAI, a lot of that is still driven by people who have been at OpenAI since before they became the hottest company ever. You know, another company that I think experiences to go through this is Airbnb, Brian Chesky, right? And I think that, you know, he's talking about this publicly after the pandemic, he all of a sudden realized like, hey, I have to kind of rebuild be built the entire company. And he massively shrunk the team, he invested a lot more to talent density.
52:35And then he built the team to remain small. And I think that they're even now the most or one of the most profitable companies per head in all of tech. And that's because of this sort of this realization that he had that he didn't need to keep growing that team to see the financial gains or the financial output. At least I want to do a quick fire. So I'm going to say a short statement, you give me your immediate thoughts. So that's not OK. Yes, it's OK. So what if you change your mind on most in the last 12 months. I think it's actually everything about this hyper growth stuff that we've been talking about.
53:03And it's really around divorcing team hyper growth from company hyper growth and extra investing into quality and excellence. What's the biggest misconception you hear most often about AI? I think the biggest one today is all that's between us and EGI's compute and I think we need data to get there too. Tell me, you can have any board member in the world who you don't currently have. You have an amazing board, but you don't currently have. Who would you choose as your next ball member? This is a great question. You know, I think, obviously I don't think this is practical, but I do think Satin Adela has been one of the most brilliant business strategists of the modern era.
53:43What he has accomplished at Microsoft is just staggering, and I think any board would be very lucky to have him. Unfear one for me to ask, but I actually like it, which is, What question are you not asked or are you never asked that you feel you should be? That's an interesting one. The interesting one is like how My perspective on AI has changed in the successive eras and I mentioned this because I started the company in 2016 The first three years of the company were just full focus on autonomous driving Not autonomous vehicles and then in 2019 we actually started working on a gendered AI We started working on the opening eye on GPT -2 and so we are one of the few AI companies that I think has seen multiple eras of the technology and has seen the sort of the first boom and bust cycle with autonomous vehicles.
54:29I think it's an interesting one which is like what's the same in these six different and what's different. That's an interesting question. How's your view changed? Are you most excited now? I'm quite excited but I think there's also reasons to be cautious. In autonomous vehicles one of the things that happened in the autonomous vehicle craze. There There were a lot of promises that were being made that were divorced from the technical reality. So a lot of the prominent automspilko companies, a lot of the prominent organizations were making bolder and bolder promises to be able to raise money. Those were at first they weren't super divorced but over time they became more and more divorced from the technical realities.
55:09That resulted in this very painful trough where the promises weren't met and so it felt like the entire industry is falling apart. And actually, at the end of the day, you know, now we have Waymo's driving on San Francisco, perfectly proper L4 autonomous vehicles driving around. Tesla autopilot has gone really good. If we had more measured promises along the way, I think now we would feel amazing about autonomous vehicles, whereas instead we went through this huge up, this big down, and maybe it's sort of like on the upswing again. I think this is one of the big concerns I have about generative AI, which is, I hope not, but the same thing might happen again, which is that we have these really big promises that are starting to get made about the technology that get divorced from technology reality.
55:53And then that creates the sort of gap that is bound to cause a hangover. Will Trump win the ultimate one? I still think it's a toss up actually. US elections are so strange to think about because it always gets decided by the swing states. Frankly, I don't trust anyone on the coasts to have any fine -grained understanding of how the swing states will play out. I have no idea. I don't think anybody should listen to anybody who lives on the coast to understand what's going to happen It always boils down to the swing states. Final one for you my friend. What scale in 10 years time? You know hopefully doing something very similar what we're doing now Which is continuing to be the data foundry for AI and serve the data pillar for AI progress.
56:33Would you like to go public? For sure. Yeah. Well one thing I think a lot about is how do you solve problems that will never go out of style? Like would you like to be the CEO of a public company? Do you know what I mean? if you were Stripe. There's clear benefits to being a public company for sure, but I think Stripe is an incredible company in that they can be incredibly profitable and they can accomplish all their core financial goals without needing to go public. There's an Alex, I love to have you on the show. Thank you so much for joining me. Alex said it's so nice to do this in person. I'm sorry for the many kind of meandering pivots and tards, but this was fantastic.
57:06Yeah, this was a lot of fun. I have to say I absolutely love doing that conversation with Alex. I want say a huge thank you to him for being so open and honest with quite a few of those revealing questions. If you want to watch the full episode live in the studio and you can jack it out on YouTube by searching for 20 VC that's 20 VC on YouTube. But before we leave you today, as face it, your employees probably hate your procurement process. It's hard to follow, it's cobbled together across systems and it's a waste of valuable time and resources. And as a result, you probably are facing difficulties getting full visibility, managing compliance and controlling spend.
57:42It's time for a better way. Meet Zip, the first modern intake to pay solution that can handle procurement and all of its complexities from intake and sourcing to contracting purchase orders and payments. By providing a single front door for employee purchases, Zip seamlessly orchestrates the procurement process across systems and teams, meaning you can procure faster with the least amount of risk and get the best spend ROI for your business. With over 4 .4 billion in savings for our customers, Zip is the go -to solution procurement for enterprise and industry disruptors, like Snowflake Discover Lift and Reddit.
58:16Finally, a solution employees love to use, where buying things for work just works. Get started today at ziphq .com, slash 20vc. And speaking of game changer with Zip, we have to talk about Cooley, the global law firm built around startups and venture capital, since forming the first venture fund in Silicon Silicon Valley, Cooley has formed more venture capital funds than any other law firm in the world, with 60 plus years working with VCs. They help VCs form and manage funds, make investments and handle the myriad issues that arise through a fund's lifetime. We use them at 20 VCs and have loved working with their teams in the US, London and Asia over the last few years.
58:57So to learn more about the number one most active law firm representing VCs backed companies going public, head over to Cooley .com and also Cooley .com. who leaves award -winning free legal resource for entrepreneurs. And finally, travel and expense are never associated with cost savings, but now you can reduce costs up to 30 % and actually reward your employees. How? Well, the van rewards your employees with personal travel credit every time they save their company money when booking business travel under company policy. Does that sound too good to be true? Well, the van is so confident you'll move to their game -changing all -in -one travel corporate card and it spends Super App that they'll give you $250 in personal travel credit just for taking a quick demo.
59:41Check them out now at navan .com forward slash 20VC. As always I so appreciate your support really it just means the world to me and the team here and stay tuned for an incredible episode this coming Friday.
From the publisher
Alex Wang is the Founder and CEO @ Scale.ai, the company that allows you to make the best models with the best data. To date, Alex has raised $1.6BN for the company with a last reported valuation of $14BN earlier this year. Scale tripled their ARR in 2023 and is expected to hit $1.4BN in ARR by the end of 2024. Their investors include Accel, Index, Thrive, Founders Fund, Meta and Nvidia to name a few.
In Today's Show with Alex Wang We Discuss:
1. Foundation Models: Diminishing Returns:
- What are the three core pillars that can meaningfully improve foundation models performance?
- Why is data the single largest bottleneck to the performance of models today?
- What data do we need to capture that we do not currently, that will have the biggest impact on model performance moving forward?
- Will we see the largest companies in the world revert back to on-prem with the increasing security challenges of migrating all customer data to foundation models?
2. AI: A Military Asset in Global Conflict: China + Russia
- Why does Alex believe that AI has the potential to be an even more powerful military asset than nuclear weapons?
- If this is the case, should we have open systems? Do we not have to have closed systems?
- Why does Alex believe that the CCP's approach to industrial policy is better than anyone else's?
- How does Alex evaluate the rise of Chinese EV car manufacturers in the last few years?
- Does Alex really believe that China is two years behind the US in the AI race?
3. "I Get Fairer Treatment in Congress than in the Press":
- Why does Alex believe that the best PR is no PR?
- Why does Alex believe that he got fairer treatment in congress than he does in the media?
- Why does Alex believe that all founders should look to own their own distribution channels today?
4. Alex Wang: AMA:
- What are some of Alex's biggest lessons from Patrick Collison on the impact that a hot company brand has on the ability for that company to hire the best?
- Does Alex think Trump is going to win? What would be the impact if he were to?
- Why does Alex believe that enterprise software will be changed forever in the next few years?
- What question is Alex never asked that he thinks he should be asked?




