E68: How Theory Ventures Differentiates in a Crowded VC Market

11 Dec 2024 · 53 min

Ask about this episode

Ask anything about it. ChatGPT or Claude reads this page and answers with the times it was said.

Connect VO and ask about every podcast you hear, including the moments you saved. Add to ChatGPT · Add to Claude

In short

Turpentine VC Podcast Episode E68 Summary: How Theory Ventures Differentiates in a Crowded VC Market

Podcast Overview

  • Host: Erik Torenberg
  • Guest: Tom Tunguz, General Partner at Theory Ventures
  • Episode Focus: Discussion on Theory Ventures’ $450M second fund, concentrated portfolio strategy, investment theses in AI and decentralized infrastructure, and the future of data businesses.

---

Key Themes and Discussions

Theory Ventures' Strategy

  • New Fund Launch: Theory Ventures recently announced a $450 million second fund, focused on concentrated investments in specific sectors.
  • Portfolio Approach: The firm adopts a concentrated portfolio strategy, utilizing extensive research and analysis to identify key investment opportunities.
  • Emphasis on high ownership stakes and deep understanding of chosen sectors.

Market Dynamics

  • Growth of VC Industry:
  • The venture capital market expanded from $8 billion to $300 billion over 12 years, forecasted to stabilize around $150-180 billion.
  • Investment Trends:
  • Contrarian views on blockchain and decentralized infrastructure as potential growth areas in 2024.
  • Significant revenue growth observed in companies like Databricks, which increased data warehousing revenue from $100 million to $400 million in one year.

Data Infrastructure and AI

  • Modern Data Stack:
  • Importance of tools like Fivetran for data movement and DBT for data transformation.
  • The value lies in compute workload processing rather than mere data storage.
  • Artificial Intelligence:
  • Opportunities in developer tooling and application layers for AI technologies.
  • Focus on enterprise readiness and security concerns surrounding large language models (LLMs).

VC Landscape and Advice for Emerging Managers

  • Trends in Fundraising:
  • Smaller funds are gaining favor among institutional investors due to higher multipliers.
  • Differentiation Strategies:
  • Emerging managers are advised to focus on a specific sector or strategy that resonates with LPs.
  • Importance of aligning product, go-to-market, and business strategy for startups.

Long-Term Outlook

  • Future for Theory Ventures:
  • Aim to attract the right LP base, hire a strong team, and validate their concentrated investment model.
  • Potential expansion of fund size in future rounds, contingent on market conditions.

---

Key Takeaways

  • Concentrated vs. Broad Portfolio: Concentrated investments offer higher ownership stakes and deeper insight into sectors, which can yield better returns compared to more diversified strategies.
  • Evolving Data Landscape: The convergence of structured and unstructured data management presents significant investment opportunities, especially as companies adapt to the growing importance of AI.
  • Emerging Manager Landscape: A strong track record and clear differentiation in strategy are key to attracting capital in a competitive VC environment.

---

Notable Quotes > "The more diversified a portfolio becomes, the harder it is to generate a high multiple fund." — Tom Tunguz

> "We're spending a lot of time around the developer tooling infrastructure." — Tom Tunguz

---

Related Links

  • [Tom Tunguz's Website](https://tomtunguz.com/)
  • [Theory Ventures](https://theory.ventures/)

Sponsors

  • [Carta](https://carta.com/investors) - Platform for private fund management.
  • [GiveWell](https://www.givewell.org) - Research-based charity funding.
  • [Squad](https://choosesquad.com/) - Global engineering services.

---

Conclusion In this episode of Turpentine VC, Erik Torenberg and Tom Tunguz provide valuable insights into venture capital strategies, the future of data businesses, and the evolving landscape of AI technology. Their discussions illuminate the opportunities and challenges facing emerging VC managers and the overall investment ecosystem.

Written by AI. May contain mistakes. Listen to the episode to check what was said.

Hear the part that matters, and keep it.Open this episode in VO. Double tap your headphones to save a moment as you listen.
Get VO free

Transcript

Automatic transcript. May contain errors.

0:05Welcome back to Turpentine VC, the podcast where we discuss the art and science of building successful venture firms, VC to VC. Today, we're airing excerpts from my talks with Tom Tungus, general partner at Theory Ventures, which just announced their$450 million second fund less than two years after launching. Tom and I spoke in January of 2024 to dig into Theory's approach to concentrated portfolios and his contrarian take on decentralized infrastructure and AI. Then we spoke a few months ago specifically about the future of data businesses, another key part of the firm's thesis. Please enjoy.

0:40Tom, welcome to the podcast or podcasts. Thanks so much for joining. Thrilled to be here. Thanks for inviting me. So Tom, let's start with the theory behind theory. Given that you're entering a very crowded venture market, how did you think about, hey, where do you want to fit in within the ecosystem? Where did you want to differentiate? Walk us through kind of the idea maze of how you thought about getting your fund off the ground and where you wanted to play when you thought about fund size, when you thought about portfolio construction, where you thought about where you wanted founders to see you in market compared to all these other amazing firms that have been around for a long time?

1:17Yeah, great question. I mean, there are a lot of wonderful firms out there. The way that we think about ourselves is we initially started by using math to create portfolio construction. And so we started running Monte Carlo analysis on historical venture returns to come up with basically a thesis-driven, highly concentrated portfolio where we research spaces for long periods of time, try to understand the entire landscape, and then invest at the early stage and continue to invest as companies grow. That's the core idea. And today, we're a team of six people all pursuing that vision. Yeah. And you have unique insights on portfolio construction in terms of you want it to be more concentrated, higher ownership.

1:59Talk about how you got to conviction on that being the right opportunity. Yeah, I think there's probably two dominant models in venture capital. I think there's the, you would call it like the Y Combinator build-in index, very, very broad, and then ideally have a growth fund or a mid-stage fund to be able to pick up the winners and then concentrate. And then the other is what you might call the classical venture model, which is very early bets with significant ownership where over time you're able to drive a lot of returns for investors. And we think the U.S. venture capital asset class grew from about$800 billion to$300 billion over the last 12 years, 81 % of those dollars, according to PitchBook, are from non-traditional VCs.

2:37And as we start our firm, one of the things that we need to do and the advice that we give to startups is we need to focus to be able to win. And so our goal is to be able to focus on categories that we really care about, go really deep. And then once we have a lot of conviction in those businesses, help them grow as quickly as we can, both with advice, but also capital. And that$300 billion number, where do you expect that to be in the next, in the next few years? Yeah, I think it settles to somewhere around like 150 to 180 would be my guess. So pretty significant correction. Obviously the vast majority of those dollars are kind of in the mid to late stage, just sort of definitionally.

3:16So I think, and where will it be in five or 10 years is much harder to predict, But I do think over the last 10 years, the venture capital asset class has become institutionalized. If you think about what David Swenson did at Yale, 30 % to 50 % in privates, that's here to stay. And one big part of it is index investing has dominated the public markets. And the second is the total number of publicly traded companies in the U.S. is significantly less. And the last part is 25 years ago, a company with$25 million in trailing could go public. Today, you probably need$150 million in trailing. So if you're an institutional investor and you want exposure to some of these mid-stage, early mid-stage companies, the only way to do that is through privates.

3:58Yeah. And so if we go down from 300 to 180 or 150, almost, you know, almost a cut in half, where does that get cut from? Is it multi-stage firms just lower their fund size significantly? Is it just that there's no new entrance? Is it that a lot go out of business? Is it all of the above? How does that happen? Yeah, I think, well, one, you have hedge funds who are public and private. They look at, I would imagine they're looking at public multiples on a relative basis and thinking that the public markets are more attractive. If you want to play the AI trend as an institutional investor, Microsoft is actually a really phenomenal way of doing that.

4:33And so I wonder if some of the hedge fund money moves out. The second is the really big growth funds will be much harder to raise than they have been in the past. And the top firms will continue to do that. But, you know, they called, and I just learned this term during the fundraiser, staple funds. And that term means raising the early stage fund and then I have a growth fund. And they're called staple because in order to invest$1 in the early fund, you must invest$2 or$3 in the growth fund. I think that dynamic may change. And so I think you'll see a lot less later stage capital for this reason.

5:07Yeah. And so what's your advice to emerging managers? You are an emerging manager, although, you know, at quite a big fund. a lot of emerging managers listening to this thinking about, hey, what's the market like? How big of a fund can I raise? But also, what is an approach that will resonate with LPs in this market? When you're advising emerging managers, what is some of the non-common advice that you're giving? I think the most important thing, well, one, a strong track record with DPI, I think, is the golden ticket in this ecosystem. The other, so I would say like six months ago or nine months ago, the fundraising market was quite difficult.

5:43And that's just because many LPs were re-evaluating their investments. And there was obviously the US public markets crashed, geopolitical tensions with China, the real estate implications or the implications to real estate of 400 basis points of increase in the Fed funds rate, what that means for the value of those assets. I think at this point, a lot of the repricings of the private portfolios have come through and limited partners or institutional investors have a better sense of where they stand, which is a good thing. I think what I've been hearing from the institutional investor base is that smaller funds is where many institutional investors would like to be because the multiples are higher.

6:29And so the most important thing is to be able to find LPs who are interested in potentially moving from bigger multi-stage down to smaller funds and asking qualifying questions about how many emerging managers have you backed in the last 18 to 24 months is a really good way of figuring out whether that LP could be a fit. And what types of strategies do you think are most differentiating? People are asking, should I differentiate on sector-specific? Should I differentiate on geo-specific? Should I try to do something different with portfolio construction? What do you think are the types of strategies that really resonating in market outside of sort of, hey, we've got some DPI, it's great references, et cetera?

7:11I think that the really important question when you have a startup is, I have a product idea, I have a product and I have go-to-market strategy and they all need to align. And the companies that work really well are the ones that are able to draw a line through those three points. I think it's the same for early stage fund managers where you can focus on AI, super crowded category. If you have a proprietary network or access, you can make it work. You can come up with a different sort of fund strategy. There are a handful of friends who are starting SaaS roll-up funds where they buy companies that are not, they're growing at like 10 to 20%, 10 to 30 % profitable.

7:47And they're rolling them up as a way of creating a next generation constellation, which is a publicly traded company that does this. And so I think it's just about like the consistency of vision and some specialization that's defensible. And it's not that there's like a unique specialization, but just as long as it's like a very consistent story, you can be in a good place. Totally. I want to transition a little bit into, you mentioned AI earlier and how Microsoft could play. How are you approaching AI as a venture capitalist in terms of where do you think are opportunities uniquely suited for venture investors to play and invest and make money from?

8:25Yeah, great question. I mean, I think so at the highest level, who's earning the most money from AI right now? It's it's open AI, like one point three, one point five billion in run rate. That's what they've said. Microsoft has two businesses that when you total them are roughly the same size. And then there's sort of everyone else. The foundation model is a really difficult place, I think, for small venture firms like ours to play just because of the capital intensity of those businesses. Where we're spending a lot of time is trying to understand the. So one, the tooling. We interviewed a bunch of data leaders, about 25 of them over the last couple of months, and only one had actually deployed an LLM inside of production.

9:05And the major challenge there is just understanding the risks associated with moving data into and out of LLMs and containing it. So one of our themes is just enterprise readiness around large language models. If you're a Goldman Sachs, if you're a Fidelity, if you're a Nike, how do you become comfortable with these kinds of issues? I went to dinner with a friend yesterday who works at a publicly traded company, and she raised this issue around terms and conditions of what indemnification exists if I'm using an image generation software. And so there's just a lot of these questions that have yet to be asked and answered around the use of LLM.

9:44So we're spending a lot of time around the developer tooling infrastructure. And then the second part is at the application layer. So it's clear you can't beat Salesforce with an LLM-enabled CRM. You can't beat Zendesk with an LLM-enabled customer support tool. And our current working hypothesis is that there's an opportunity to redefine categories. So there's a CRM category and there's a marketing category. And those have been sort of etched into the fabric of how we sell and build and buy software. And we're starting to wonder whether these large language models, you can use English as an API.

10:24You can write something and it'll translate it to what a computer understands and bring you the data back. But what if you could combine CRM and a marketing software in one or the entire go-to-market functions in a single stack? What would that look like? So that's the theme that we're currently researching is how do you redefine the way that people think about these categories? That's helpful overview. you. Hey, we'll continue our interview in a moment after a word from our sponsors.

11:15searching charitable organizations and only directs funding to a few of the highest impact opportunities they've found. Over 125 ,000 donors have used GiveWell to donate more than$2 billion. Rigorous evidence suggests that these donations will save over 200 ,000 lives and improve the lives of millions more. GiveWell wants as many donors as possible to make informed decisions about high impact giving. You can find all of their research and recommendations on their site for free. You can make tax-deductible donations to their recommended funds or charities, and GiveWell doesn't take a cut. If you've never used GiveWell to donate, you can have your donation matched up to$100 before the end of the year or as long as matching funds last.

11:53To claim your match, go to givewell.org and pick podcast and enter econ102 with Noah Smith and Eric Torenberg at checkout. Make sure they know that you heard about GiveWell from econ102 with Noah Smith and Eric Torenberg to get your donation matched. Again, that's givewell.org to donate or find out more. um what are other areas that you're particularly interested in in investing in or sort of uh where you think there's lots of opportunities for startups you'd like to see more startups pursue um companies in in this area or companies of this type yeah we're keen on the modern data stack so if you look at the vendor q3 data bi databases that's a single fastest growing category for spend the second is security and so we spend a lot of time in the modern data stack next generation databases streaming that kind of thing and then the last is blockchains as databases so we look at ethereum it's worth about 250 billion fastest growing database company of all time worth five snowflakes put together and one of our long-term theses is that many future software products were built with web3 components embedded inside of them and so those are the three areas where we spend time in addition to ai it's contrarian to be thinking about blockchain applications in 2024 before it is it is i mean i think we've got we've gone through this bear market and it's been a really healthy development because what we would have called like the projects of the 2020 and 2021 era where a pitch deck didn't have any notion of like revenue or cost of customer acquisition or any of the economics of a business now that's changing many web3 companies and i think it's a very healthy development are now starting to think about what kind of businesses can we build which buyers do we sell to how do we package up the core technologies that are fundamental innovations and really meaningful and and solve an end user problem that doesn't have to do with stable coin movement or decentralized finance but is solving a real real enterprise need yeah that's well said you gave a talk at angel list confidential uh a year ago where you kind of uh talked about some of the biggest data trends of the of the year in in the space if you were giving that same talk this year and it just happened.

14:05So maybe you did give that talk. What would be some of the biggest points that you'd, you would emphasize in that talk today? Yeah, I think the data teams are becoming software engineering teams. Historically, they've lived sort of downstream of the analysis, right? You build a product, the product produces data, your customers do stuff that produces data. And then you ship it to the data team and they do a bunch of post hoc analysis. Now data is becoming fundamental to building of applications, personalization or risk scoring or chatbots. And so the data teams and the software engineering teams are converging.

14:39And there's a lot of opportunity to build software to enable that to happen because that hasn't existed before. The second one are the applications of machine learning within data. So there's two big problems with these large language models that are relevant to data. The first is they're non-deterministic. That's a fancy word that means if I ask it the same question twice, it will give me two different answers, which is really hard. If you're the CEO of a business and you ask a BI system, what is my revenue by region for a particular product? It will give you one answer. But if you ask it, what is my revenue by region and product?

15:19And then if I flip it and if I say, what is the revenue by product and region, I'll get two different answers. That's a big problem for data. And then the second is the hallucinations. hallucinations. So I think there's a significant amount of opportunity to solve those problems and then also bring more sophisticated data analysis to people who may not speak SQL. Text to SQL is a huge movement and many companies are spending a lot of time. And then the last is what I would call the small data movement. So the laptop that is in front of me today is more powerful than the server, the third most powerful server that Snowflake used to build Snowflake in 2012.

16:00So I can manage exactly the same volumes of data on this MacBook as Snowflake could in that era. And so there's this big drive now to take advantage of the fact that I can develop locally, I can process huge reams of data. I'm running some large language models on these machines. And as a way of both reducing costs and improving the developer experience for people manipulating data, you have next generation databases that operate and data analysis systems that operate and take advantage of the fact that I have this incredibly beefy machine at home. Those would be the top three. Well said. Talk a little bit about how LPs think about different venture firms, right?

16:40Because when Andreessen pitches an LP, it's different than when first round pitches an LP, right? And so why don't you explain a little bit the land of LPs and the different kinds of LP products that are better suited for, you know, in terms of matches between VCs and LPs? Why don't you give a little bit of a lay of the land there? Okay, great. So let's talk about the universe of LPs. And then let's talk about the financial products that venture capitalists offer to LPs. Let's cut it up in that way. There are many different kinds of LPs, right? There are individuals, family offices, then there's endowments and foundations fund to funds and then like pension plans and health care plans and each one of those has a different investment mandate endowments and foundations are typically much more focused on privates because of swenson's influence and then others and what i mean by that is like 30 to 40 percent of assets maybe sometimes more will be in private so about 80 percent of that will be in private equity and buyout and then single digit percent will be in venture capital.

17:45And then a lot of LPs might have one or 2 % in venture capital total. And the way they think about it is if you're a diversified LP, you have public company, public equities positions with hedge funds, and you might have index funds. And that's a big chunk. That's probably 40 % of your book. And that is super liquid. And it's meant to drive an S &P or marginally better than an S &P-like return. And then you have private equity and buyout, which is meant to drive something like, call it 15 to 18 % IRR. And then you have venture capital, which is the most expensive, longest duration, least liquid asset class, which is a small percentage portfolio, but is meant to drive a lot of alpha.

18:29That's typically the way that LPs think about it. And that's because we raise funds for 10 years with like two, one year extensions is pretty typical, although some firms are raising with 15 years. So that's the way that they kind of see the whole universe you know this kind of dawned on me during our fundraising where when a startup raises it raises a seed and then an a and then a b and then a c and then a d and the return expectations for each round change right if you invested a seed you might expect like a hundred x or a thousand x in the case of a really successful company and at the a your multiple is less because you know maybe you're expecting like a 20x and then at the series b maybe you're expecting like a 5x and the series c you're expecting a 2x and a 3x as you approach the IPO.

19:11It's the same for venture firms, right? So the way that LPs look at an emerging fund or a first-time fund is on average, first-time funds tend to produce, when they're successful, much higher multiples. And so that's a seed round. And then a second fund, vintage, typically is a little bit bigger. And so that's the A. And then the third one is the B. And then by the time you get to be a multi-stage, multi-platform fund where you're offering 17 different products to LPs, that's like an IPO stage, public company stage return profile. And so that's my mental model for it. If you were explaining kind of like what you think would happen to multi-stages over the next decade, what do you think would happen?

19:54Or I should say firms that have agglomerated or accumulated a lot of AUM and are, you know, raising or investing across every every stage do you think that those firms continue the same strategy um do you think that they change their strategies what advice might might you give them or what would you do if you if you were those firms and sitting on a ton of capital right now but knowing that the uh you know overall capital set will uh will decrease over time i think the the larger you are the the greater the likelihood you remain in the ecosystem um and that's just because as an LP, if I've decided to invest$250 million or$500 million with you, that's a 20 or 30 year commitment.

20:37And unless something goes seriously wrong, I will probably keep that commitment or increase it with inflation or even more. And so the way that I think about, like, if you're a multi-stage, multi-strategy asset, I mean, you're an asset manager. And the goal there is the firm has built a fundraising brand with both LPs and startups that allows it to hire people. And when those people come in, the brand in the calling card produces high response rates from customers on both sides, both the institutional investors and the startups. And the goal is to drive consistency and performance. That's the ultimate goal.

21:20It's trying to get to, you know and some people might disagree but it's trying to get to the beta of the asset class for larger and larger dollar sizes it's trying to sustain okay an lp puts in 250 million 500 million a billion what is the top quartile return for the asset class great can i have that in a really really large check size that's the product that's being offered and the way that it's done is across all these different strategies so i think those you know the multi-stage multi-asset firms they will continue to exist i would argue that they would thrive there are a lot of parallels between what's happening in the venture capital industry and what happened to private equity.

21:55So the original buyouts happened in the 1970s when KKR spun out, I think, a bear steams. And for about 20 years, it was a very, very small cottage industry. And then in the 80s, it was Milken and the junk bond market that really blew the private equity market up. And they went from single strategy firms to multiple strategy firms. Now KKR, huge asset manager, Many of them are publicly traded. And I think that evolution 40 years later is exactly what's happening in venture. Do you think that these firms will be publicly traded or that some of them may? I think some of them. Yeah, absolutely. I mean, you know, you have like Iconic has gone from zero to 75 billion in AUM in 10 years.

22:37I think the last time I looked was like zero to 35 billion in a similar timeframe. And there are publicly traded asset managers that are at that scale. So I think it's a firm by firm decision. I don't know anything about anybody's particular strategy, but there's no reason why they shouldn't or couldn't be publicly traded. Do you think that they will also get into like sort of public market investing or sort of real estate or just kind of things that have nothing to do with venture? I think so. I mean, I think, you know, the goal of most businesses is just to continue to increase in size. And if we trace like the history of venture capital, right, it was initially just like seed stage and then there's mid stage and then there's growth stage.

23:14And we talked about the hedge funds costs, crossing over, investing between public and private equity, offering that product. And some venture firms have started high net worth individual asset management. Right. So they're in that business. And there are a couple of firms have started secondaries businesses where they buy existing LP and GP stakes. So that's another financial product. One firm that I know of started like a structured credit product that lends dollars. to companies that may or may not be in the portfolio. So now all of a sudden there's a debt problem in there. And so starting from like a$3 million to$5 million check, all of a sudden you have all these different flavors, matrix that over a bunch of different geographies, and you have a pretty complex product suite.

24:00And again, if you think about the ultimate business of an asset manager, it's about being able to deliver returns and building a brand on both sides where LPs will take your call on and founders will take your call. And so if you continue to expand and you have that brand, you can hire some great people to use it effectively. It's kind of your, it's your motivation, right? Where a capital capitalist is in the job title. So I think that's, I think that's where we end up. Yeah. Hey, we'll continue our interview in a moment after a word from our sponsors. You're bearish on sort of the economy in the short to medium term.

24:40If I recall, you think there was a bit of an overcorrection. And as a result, I think you believe that rates will be, if not high, not super low, certainly not what they have been the past decade. Is that true? And if so, does that mean that you're bearish on industries that kind of depend on low rates or unpack that a little bit? So the futures market, the last time I looked at the bond market, is pricing a rate cut in Q3, Q4 of 24. The dynamic is there's a convexity to the curve. So cutting one percentage point from five and a half to four and a half. Yes, it's one percentage point cut and it has some impact, but cutting it from two to one has much more impact on what happens in the economy.

25:20So I think that the economy is strong, or at least that's what the numbers say. And what we're starting to see finally is like you look at like the data dog earnings, a couple of other companies that Microsoft earnings, people are starting to see a bottom where the growth, the decline in growth rates has stopped. And some of them are picking up growth again. It's not broad, but you're starting to see some, and even in the private markets, a bunch of portfolio companies are starting to get their footing underneath them after missing a couple quarters. And then the earnings surprise, which is a measure of how much more positive the earnings are for public companies is off the charts for a lot of software businesses.

26:02So I think we're, you know, who am I to predict? But I think we're at a place where we're kind of close to touching the bottom. And I would expect that the back half of next year is stronger. Gartner, again, trying to predict the future. But their overall numbers for growth, they predicted in 22, 9 % software growth year over year. In 23, which is this year, 13%. Next year, they've raised the expectations to 14%. So there are a lot of positive signs, I think, for, call it two to three years from now that you'll have good positive multiple expansion and there'll be a lot of appetite for software.

26:44Yeah, there are a lot of firms over the past few years, you know, there were SaaS specific firms or fintech specific firms that it feels like were built for a previous economy. But now we're entering sort of a world in which rates are higher and thus the sort of multiples. You know, we can't expect kind of the same ones we've been having. Do you think, do you agree with that framework? Do you think that's unique to SaaS or fintech or just kind of across the board? Or what does it mean for those two sectors in particular? yeah i so i think so software the median publicly traded multiple over the last 15 years about 5.5 x forward revenues to ev to enterprise value and we went through a period where like snow like traded like 89 times forward and there were a lot of companies in the 30 to 50 i think base case for a fast growing company you're looking at a multiple of something like 8 to 15 depending on how hot the market perceives it and we need to underwrite those investment cases to those multiples.

27:42And that's the way that it was for a really long time before we went into the zero interest rate environment. So what does that mean? Well, it means the cost of capital is significantly higher than it was. And there was a study on the cost of customer acquisition for software companies where over the last five years, it's increased 60 % during that time. Well, so what does that mean? Well, in a zero interest rate environment, it's fine because you can raise 60 % more dollars and you can grow at the same rate. You just pay the market fee for a new user, new customer. But in an environment where the capital is more expensive, that means that startups, they either need to give up more of their cap table to be able to grow at the same rate, or they must evolve to find a less expensive way of growing.

28:28And so I think the major driver, the major change in software will be, what are the new go-to-market strategies that are much more capital efficient? And open source was one for a while. Product-led growth was one for a while. there are these iterations or platform shifts, mobile acquisition was the third. And we'll be looking, I think we'll be looking here in the next couple of years for an innovative way of acquiring customers. We could argue that like the rippling suite strategy is another way of doing it. We're offering a whole bunch of bundled products as a single package is an innovation that is a pretty market departure from the best of breed last 15 years that Salesforce catalyzed.

Read the full transcript

29:08Gearing towards closing here, why don't you talk about the future of theory? What do you hope that this looks like in a few years? We've seen firms like USV and Benchmark stick to their knitting and have their ideal fund size and stay the same. And we've also seen firms like Thrive and AC2Z and Founders Fund and Sequoia add more product lines and aggregate AUM. And both types of firms have had massive success. So how do you think about where you go from here? For sure. We have a multi-decade strategy document that everybody who joins the firm reads. And I think that for the first, McKinsey has three horizons.

29:48Our first horizon is we need to prove, one, that we can attract the right limited partner base. Two, that we can hire the right team. And then three, demonstrate that the idea behind our model of this thesis-driven, concentrated approach resonates in the market and we can win. We can win in competitive situations. And so I think for Funds 1 and Funds 2, that's the objective, is to demonstrate that the model works. And in the medium term, it's about continuing to use math to make sure that the numbers are on our side to generate really high multiple funds. That's our North Star. Fund three, fund four, what do you think fund size would be?

30:31That's a good, well, the market will determine it, right? So I think we'll remain very, very concentrated. And the goal is to be a really strong capital partner to startups. How do you determine the right amount of companies per fund? What is sort of the ideal concentration versus what's not enough companies or what's too many? Yeah, well, so from an LP's point of view, they're already so massively diversified that I think many of them prefer highly concentrated funds because if a company works within a fund, they really wanted to move that part of their portfolio. And so ideally, they'd be much more concentrated.

31:09From the GP's perspective, the more concentrated a firm is, the greater the risk that we take on the capital, I mean, with our commitment. And so, but our goal is to be on the much more concentrated side. And that's, I mean, if you think about it, like a power law, we all know that shape, the median and the average of a power law are zero. So the more diversified a portfolio becomes, the harder it is to generate a high multiple fund. And we want as much of our capital as close to the y-axis as possible. So the longer term strategy is to continue to create funds that allow us to do that. Later in our conversation, we shifted to discussing the future of data businesses, starting with Tom's experience with Databricks.

31:53So we're going to cover Databricks. Let's start with your journey with Databricks. And when did you think, hey, this is going to be a pretty spectacular company? I remember meeting Ali and I mean, he's a force of nature. And clearly, I mean, he was coming out of the Berkeley labs and they were commercializing Spark. Spark was a very difficult technology to run by herself. And Databricks was building software to manage it. And many of the leading data scientists were using this technology as a way of manipulating enormous data sets to get them to from whatever unstructured raw place they were into whatever place and packaged output they needed to be.

32:32And I think he's just done a phenomenal job building a really aggressive company. I think the story one of our founders is building within the data ecosystem. And he went to an event with Ali. And I think the story really sort of encapsulates his business aggression, which in my view is an extremely good thing. He said he got on stage talking to all these different startups and he said, we would love to partner with you and we will be competing with you. So if you win, great, we'll work with you. And if we win, well, we win. I don't know if it's exactly what he said, but that was his sentiment, which is this is an open, competitive playing field.

33:10We are playing to win. Let's be aggressive. Yeah. And talk about the company itself. What do you think was sort of the insight or what do you think about like what makes Databricks so special or what makes it work and situate it within a larger kind of context of the market? Yeah, good question. Okay. So let's say you're building within the data ecosystem. The classic data infrastructure has been the output has been BI, business intelligence. The CEO wants a dashboard of how many widgets am I selling per region per month. And the way that that's built is there are transactional systems. So let's say you have like a point of sale system that measures how many widgets you sell.

33:47That data is moved from the point of sale database, which is called the transactional database using ETL. It's basically just extraction, transformation, and loading pipes like 5Tran into a cloud data warehouse like a Snowflake. It's then in Snowflake, it's manipulated, reconfigured, and then goes into a dashboard. That's what we would call sort of the modern data stack. And that works really well for relatively small data volumes. And it works really well for structured data numbers, things that you would find in an Excel spreadsheet. There's this entire other world of what's called unstructured data, which are things like raw text or video or images and even really, really large files where that doesn't work because it's really expensive.

34:28And because they're so large, the latency doesn't matter so much. You may not need down to the second latency. And so what you want are bigger systems that are burlier, that can handle much larger data volumes and can parallelize them and manage them over large numbers of servers. And before the world of Databricks, there was a technology that was called MapReduce that Google had built that did this and which became commercialized in Hadoop in the form of Cloudera and Hortonworks and MapR. Those were the three companies that were sort of building this technology. And the way that it's been described to me as sort of the most tangible difference between these two technologies is Snowflake is really to deal with like data frames.

35:09And then what the Hadoop vendors, those were built by people who were file systems people. In other words, like how do I manage logs files or video files? And even when I was at Google, I was trying to play around with MapReduce and I had, candidly, I had a really hard time. It was very difficult for me to understand how do I set up a map? And the reason it's called MapReduce is like a map. This is how all these fields map together. And then here are how all the files kind of compute and go out and get you to a reduction, which is that particular nomenclature for an output. And so what Spark said is, okay, file system people built this really sophisticated thing that can manage unstructured data and process it.

35:52But a lot of data people are having a hard time. So why don't we build this really sophisticated pipelining infrastructure at scale in a way that data people can understand? And so that's a very simple sort of reductionist view of why Databricks has had so much success is because data people now can take advantage of absolutely massive computing resources to build these data pipelines. So what are some of the applications of a big unstructured data pipeline? Let's say you want to train a machine learning algorithm to identify license plates on, I don't know, at the scale of New York City Police Department.

36:26Well, you use Spark. You'll use Databricks' core open source technology, and you'll piece together a constellation of different open source projects that take those video files, put them into a folder, effectively process them with code, and then spit out an output. And a lot of the times that output is just either refined files. But now you're seeing Databricks actually starting to compete with Snowflake. You can look at the data warehousing revenue has 4X in the last year. It's gone from about$100 million to$400 million in a single year. And two years ago, we would ask enterprise buyers, are you using Databricks for BI?

37:02And the answer broadly was no. It was very difficult to find anybody. And now we're hearing about them more and more. So these two worlds of the structured data and unstructured data are starting to converge. And that's why there's increasing competition between Databricks and Snowflake. What else about the data catalog sort of line of discussion is worth mentioning or making sure that it's being kind of fully understood here about the significance of it? It's a strategic component to the infrastructure that historically has been very difficult to commercialize. So there are some companies, some great companies building data catalogs.

37:35but because it's not self-updating and because nobody really owns it, no one is basically promoted for managing a beautiful data catalog. It's probably a compliment to one of those key products, business intelligence, compliance, data quality, security, rather than a standalone product. And so now all of a sudden, and I think we'll start to see this more snowflake and Databricks will start to compete or at least step on the toes of some of their key partners, particularly because they're vying for bigger and bigger markets. They want to show higher and higher growth rates. And so they'll probably start to acquire or compete as they push out.

38:12The most valuable commodity in this space is a compute workload. It's not storage, but they're related. But what Snowflake and Databricks are both competing for is the opportunity to process data. They want compute. Storage is important because if the storage is with Snowflake, then it's very easy. There's no friction associated with the compute. If it's outside of Snowflake, then you have to pay. Amazon charges you based on ingress and egress fees, moving data in and out. So there's friction there. So this is why these companies are really, they care about the storage. But the crown jewels, the most valuable part, the filet mignon of this market is the compute.

38:50And so that's why compute-heavy workloads, ETL, will be really important. materializing all these different views like the dbt's the five trends i think they'll play a really key part here in the next five years and it'll be interesting to see how the what as the elephants dance how all these businesses need to respond yeah and can you explain those businesses as well you mentioned dbt five trend can you give a little bit of insight into into those businesses you just mentioned and how they work sure yeah so let's go back to the point of sale. So you and I started a business for selling widgets.

39:25All the data is stored within the point of sale, like a square or whatever. And we need to move that data into Snowflake. And so we need a connector from Square into Snowflake and then a pipeline, some computers that calculate, make sure the data is correct. If the connection drops, we try. That's Fivetran. And this is super high level. And then once it's in the database, it will be in one particular format, but let's say I need to change it in a particular format. So let's say the transactions are listed by microseconds and I really want to see them aggregated by the month. Well, you need to transform the data.

40:01How do you do that in an intelligent way? There's a technology that's called DBT. Looker had a technology called LookML that does this too. So you can create metrics, define them once, and then reuse them in multiple places. So 5tran are the pipes that move the data and then dbt is once it's gotten to its particular place how do you reconfigure the data to be in the format that you want for the right output do you have a request for startups along these like has everything kind of been picked over or where no i think well a lot is changing within the sort of the modern data stack um a lot is changing when you have lots of ai enabled bi companies that allow you to ask questions of a bi system and i think that There's definitely a role for that.

40:44I think what will happen is you'll see a pretty significant wave of consolidation here over the next two years. And once the dust settles, then it will be easier to pick your spots. But right now, it's tough. And one of the reasons is the modern data stack has been very heavily financed, particularly through 21 through 23. And there has not been a lot of consolidation aside from the very, very largest players. That's really interesting. How much as an investor are you sort of like, hey, there's this great opportunity, like tops down versus bottoms up of like, I think this thing should exist. Let me go look at everyone who wants to do something here or is doing something here versus just kind of like responding to the event.

41:28How are you, you're sort of what you're looking for evolving over time? Well, we're extremely thematic. and so we'll spend lots of time researching spaces trying to find what's the angle where is there a pain point where is there a top three priority that's meaningfully underserved and so yeah and so we've been spending time in the modern data stack the thing that we hear from buyers is one don't sell me another tool I don't need another tool the second is cost reduction is really important and then the third is either my board or my ceo is really pressing me for an AI strategy and I need an answer, but I'm afraid because I've never shipped production systems in the past.

42:08Technically it's probably okay, but I really don't want to be fired for losing a bunch of data or exposing somebody's social security number. And so how do I make sure that those things are secure? We have looked at the large language model security space and there are many different approaches there. So we definitely are spending time to try to understand and data loss prevention and prompt injection attacks and model poisoning data toxicity, those kinds of things. But still, it's also really early. I think our estimate is there's probably less than 5 million of ARR in that space today. And when you did Looker at the A or the B?

42:41At the A. And when you got excited about Looker, was BI still a very nascent space? Or what did the market look like? So in the late 1990s and early 2000s, there were four, basically the four original, at least from my view, four original BI companies, Cognos, Hyperion, Business Objects, and MicroStrategy. All those companies were worth about$2 to$3 billion, which is about$8 to$12 billion today. They were three-layer cakes. So they had databases in them, they had caching layers, and they had visualizations on top. And they were super tightly controlled by IT. When I was working at Google, there was a micro strategy instance and there was a very small team and it took forever to get the metrics.

43:26Tableau then came out of Stanford and said, these systems are really locked down and they're also very complicated. Let's just take the top layer of the cake, visualization, and let's have anybody be able to make a pretty chart. So that business grew to be$16 billion over the course of about 14 years, grew bottoms up$5 ,000 to$10 ,000 at a time and a spectacular outcome. And so the pendulum swung from super centralized, very structured to very decentralized, no structure, bottoms up. That worked for a long time. Then what happened, then the cloud data warehouses started to come around and there was Redshift, which was the fastest growing product at AWS.

44:05And there was BigQuery, which was Google's database. And then Snowflake came around. And so the classic sort of centralized IT systems were not architected to handle that kind of a scale because the databases they had inside were for much smaller data sets. And so the idea behind Looker was try to strike a balance between centralized and decentralized control, but really build a BI system that could work natively with the cloud data warehouses. And so originally, Looker would sell and bring Snowflake in because the buyer wanted a complete package. And then the Snowflake started to grow and grow and grow.

44:36So it became the other way around where Snowflake had actually many more AEs than we did. Not to say that Looker wasn't growing fast, but their ability to spend and their ability to raise capital was huge. And so people wanted this bundled solution. Now the next wave of BI, we're investors in a company called Omni, which is the ex-Looker team. And they're again striking the balance between centralized and decentralized IT in a really beautiful way. Is there anything you think we didn't go into in full depth that you think we should cover more? Otherwise happy to either on Databricks or any other company we've discussed or happy to wrap on that.

45:09You know, I think one question that we are actively researching is whether these databases like Snowflake and Databricks will ultimately be part of applications and will they serve AI models. And I think they're trying to push in that direction. They were never architected for this. But if they can push into the path of production, it opens up a new market for them. because I think the fastest growing part of software today in terms of venture-backed software are inference companies. So what does that mean? Well, you have a large language model. You do two things with models. You can train them, teach them how to predict, or you can ask them to predict.

45:47And so the first one is training. The second one is called inference. For a long time, training was by far the largest part of the market, 80 % to 90 % plus. All the GPUs were there just to train and train and train. Facebook's buying 20 billion of GPUs this year. Well, just to kind of give you a sense, and then Google and Microsoft and Amazon spending 12 to 15 billion a quarter. Half of that is on GPUs just to build out data centers. And now what we're starting to see is inference. So it's actual usage when a user asks a question. Well, you have to ask for a prediction from a large language model where NVIDIA is trying to push into the inference market.

46:18And I can imagine Snowflake and Databricks also starting to push meaningfully into this market because the growth rates on these companies are enormous. Like, you know, 1 to 20, 1 to 30, 1 to 40, 50 to 150 in a year. And that's just because the demand is there. It's a commodity or relatively commodity market. But the total top line growth is staggering. So I could imagine acquisitions there for both of those businesses or meaningful product pushes and then tying the training systems ultimately to the inference is a way of keeping all the data within an ecosystem and capturing more and more customer spend, particularly for the very largest businesses.

46:55Yeah, that's a good note. I have one more question, which is when you talk to your peers, the people whose opinion you really respect and who know the most about some of the topics that we've talked today and you have disagreements with them about where something is or where something is going or the state of something, what is an example or what are some of those disagreements? Value of NVIDIA in three years.

47:24i think that's a really interesting if you were hosting a dinner i mean two three years ago the question was what is the price of bitcoin in 18 months right that was sort of the the catalyst for a great debate i think there's an equivalent question here which is what is the total market cap of nvidia in three years and there are bulls who believe that the demand for gpus is basically unquenchable here for the next five years as a result of small fabrication capacity, none and effectively very little in the U S that you know, Tesla is buying tens. I mean, whatever, 15 billion of GPUs, Facebook's buying 20 billion of GPUs.

48:00And this kind of goes to the moon and you believe that larger and larger models become more and more important. And they go from 150 K run to 10 million to train to a billion to train, which is what Amazon has had recently. And so you just have scale, scale dominates gpus rip and um and nvidia goes to continues to go to the moon it's already most valuable company in the world and then there's another view which is amazon and google have their own gpus amd release the chip set that's about 30 more powerful than the current generation of a100s and this market ultimately reaches commoditization i mean you look at nvidia's revenue revenue's grown 5x in the last four years profitability has gone from 4 billion in profits to about 46 billion in four years.

48:46We really have this beautiful engine of a business. And so how sustainable is that? How does that grow as more GPUs enter the market? What does the dynamics look like? And what do you think is the steel man of the other side or the best argument or something that could almost convince you, but not quite? Of what? That NVIDIA would be worth less? Yeah. I think the biggest argument is small language models start to really dominate. So you look at Lama's 8 billion parameter model that was overtrained on data. It's really good. And it compares favorably to 70 billion parameter models and even some 140 billion parameter models.

49:23And then a large number of the enterprise use cases don't need parameters in the billions. They need much, much, much smaller models that can be deployed on a computer or a mobile phone for privacy reasons or latency reasons. And so these big fancy GPUs become less important. I think another dynamic there is just the competition from like Google and Amazon on the Google's TPUs and Amazon's inference chips, where the bottom falls out of the market because you have, there's this awesome paper. We studied in business school called the bullwhip effect. The bullwhip is, you know, you crack a whip and you can see a wave going through it.

49:56Whole idea. So in business school, we had this Belgian professor and he made us play this beer game, sort of illustrate this. And there were four students. One was a beer maker. Another one was a wholesaler. Another one was a distributor, the first distributor, then a wholesaler, then a retailer. And the professor would modify the demand just a little bit at the retail level. It's like one or two units a week. Then it would go back up to the producer and the producer would see these massive swings in demand. And there's this great paper from the Sloan School if you want to read it. And then that massive swings in demand would go all the way down.

50:31And by the end of like four or five cycles, maybe 10 cycles, everybody in the supply chain is bankrupt. And the producers turning to the retailer and saying, what is going on? It seems like all of a sudden, all these people want this beer. And then the next week, nobody wants any beer. And you can look at NVIDIA's any one of the multiples like EBITDA or PE multiple. And over the last 15 years, you see this huge spike when gaming became really big and the next generation MMOs and the first person shooters really needed beefy GPUs and then it surged and then fell. And then there was the next generation, which was the GPUs used for crypto mining.

51:10And so the PE multiple went from about like 15, 16, all the way to 50 or 60 and then back down to around 25. And so you have this like, particularly at the chip layer, you have this incredible amount of volatility that exists because it's not a recurring business. It's not a subscription business. And at some point people will have enough GPUs. And this is a big reason. And I completely agree with the strategic direction that NVIDIA is pushing more and more into software. Again, like I would not be surprised if they start getting in the business of inference, but they've started to push into like weather prediction and lots of different other applications as a way of diversifying their revenue and stabilizing the value of the business.

51:45I think that's a good explanation of, of, of, of both sides. And how confident are you in, in your position? I don't know how to answer that. I mean, I think it depends over what timeframe. I was looking at leaps, which are long-dated options for NVIDIA. So I think this is the question of the day, which is how long does this GPU demand last? And I don't know if I could answer that for you. So 50-50, you know, coin flip.

52:20Yeah. Makes sense. So let's wrap on that. For people who want to go deeper on your work, if they enjoyed the conversation here, I want to point them to your blog, to your Twitter. Any other plugs that people should know about listening? No, there's three places. There's tomtingus.com, there's Twitter, and then there's the LinkedIn. So you can find the content there as well. Cool. Awesome. Well, Tom, thanks so much for coming on the podcast. And until next time. Thanks for having me, Eric. Such a pleasure. Talk to you soon.

53:17Thank you.

From the publisher

This week on Turpentine VC, we feature a compilation episode of our popular interviews with Tom Tunguz, General Partner at Theory Ventures who just announced a $450M second fund less than two years after launching. Over the course of the episode Tomasz explains their concentrated portfolio approach, and expands on their key theses in AI, decentralized infrastructure, and the future for data businesses (like Databricks and Snowflake).

—


🙏 Help shape our show by taking our quick listener survey at https://bit.ly/TurpentinePulse


—

SPONSORS:


📑 Discover Carta, the innovative end-to-end accounting platform revolutionizing private fund management with streamlined operations and on-demand insights. Experience the new standard at carta.com/investors.


🤲🏼 GiveWell spends 50,000 hours every year doing deep-dives into different charitable programs to try to find the ways to do the most good for your dollar. GiveWell has now spent over 17 years researching charitable organizations and only directs funding to a few of the HIGHEST-IMPACT opportunities they’ve found. Visit https://www.givewell.org to find out more or make a donation. (Select PODCAST and enter Econ 102 at checkout to support our show.)


💥 Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.


—

LINKS:


Tom’s Website: https://tomtunguz.com/

Theory Ventures: https://theory.ventures/ 


—

FOLLOW:


@ttunguz

@Theoryvc

@eriktorenberg

@TurpentineVC


—

HIGHLIGHTS FROM THE EPISODE:

  • Theory Ventures has launched a $450 million second fund and focuses on making concentrated investments after extensive research in specific sectors. 
  • The venture capital industry has grown from $8 billion to $300 billion over the last 12 years but is expected to settle back to around $150-180 billion.
  • Blockchain technology is viewed as a contrarian investment in 2024, but there's potential for practical enterprise applications beyond cryptocurrency.
  • Databricks has seen massive growth, with its data warehousing revenue increasing from $100 million to $400 million in just one year.
  • The modern data infrastructure stack includes companies like Fivetran for moving data and DBT for transforming data once it's in a database. 
  • The most valuable part of the data infrastructure business is compute workload processing, not data storage.
  • Tom’s take on NVIDIA's future value

More from "Turpentine VC" | Venture Capital and Investing

All 87 episodes
E68: How Theory Ventures Differentiates in a Crowded VC Market"Turpentine VC" | Venture Capital and Investing · 53 min
Listen in VO