In short
Podcast Summary: Insightful Investor Episode #27 - Jacob Ziemann: AI Explained
Podcast Overview
- Title: Insightful Investor
- Host: Alex Shahidi, Co-CIO of Evoke Advisors
- Description: A podcast focusing on unique investment insights, featuring discussions with leading investors and business figures.
- Episode Title: #27 - Jacob Ziemann: AI Explained
- Guest: Jacob Ziemann, Partner and Portfolio Manager at Glynn Capital Management
Episode Summary In this episode, Alex Shahidi interviews Jacob Ziemann, who discusses his extensive experience in the tech industry and provides clear explanations of artificial intelligence (AI). The episode delves into the evolution of AI, its implications, and how it intersects with investing.
Key Points Discussed
Jacob's Background
- Early Interests:
- Grew up in a technology-rich environment influenced by his father's military career.
- Developed an interest in investing alongside technology, inspired by a teacher who was passionate about investing.
- Career Path:
- Attended Claremont McKenna College and interned at Morgan Stanley, focusing on private equity.
- Joined Glynn Capital Management, where he has gained insights into AI through interactions with various tech companies.
Understanding AI
- Definition:
- AI, a branch of computer science, primarily relies on machine learning to process data and identify patterns.
- The goal is to create machines that can replicate human intelligence in complex decision-making and language understanding.
- Evolution:
- Early AI milestones included defeating chess champions and advancements in personalization and fraud prevention.
- Recent breakthroughs in AI have brought about significant changes in industries and everyday life, with consumer awareness skyrocketing around 2022.
AI's Strengths and Limitations
- Strengths:
- Capable of processing vast amounts of data quickly and objectively.
- Enhances productivity through automation and efficiency.
- Limitations:
- Data quality strongly influences AI performance; biased data can yield biased outcomes.
- AI lacks creativity and struggles with nuanced understanding of context and ethics.
Coexistence of AI and Humans
- Augmentation vs. Replacement:
- AI should be viewed as a tool to augment human capabilities rather than replace them.
- Emphasis on the need for human oversight and ethical considerations in AI development.
- Collaboration Examples:
- AI can enhance customer service, decision-making, and personalization in various sectors, including finance and healthcare.
Future Outlook on AI
- Artificial General Intelligence (AGI):
- AGI refers to AI that can understand and learn at least as well as humans across many tasks.
- Predictions about achieving AGI vary, with estimates ranging from a few years to as far out as 2035.
- Benefits and Risks of AGI:
- Enhanced problem-solving capabilities and advancements in fields like healthcare.
- Risks include potential job displacement, ethical dilemmas, and existential threats.
Current Trends and Investment Insights
- AI Infrastructure:
- Companies like NVIDIA dominate the infrastructure layer by providing essential semiconductors for AI development.
- Applications of AI are emerging across various industries, and there’s potential for new market creation.
- Investment Landscape:
- The current funding environment is healthy, with significant capital flowing towards foundational AI models.
- While major tech firms are benefiting in the short term, the long-term landscape may shift with the emergence of new players and applications.
Key Takeaways
- AI is transforming various industries and everyday tasks, but it has inherent limitations that must be acknowledged.
- The future of AI, particularly AGI, presents both promising opportunities and significant risks that need careful consideration.
- Investors are currently optimistic about AI, but caution is warranted regarding market valuations and the sustainability of growth.
Conclusion The episode provides a comprehensive overview of AI's current state, its implications for the future, and how it can augment human capabilities, making it a valuable listen for anyone interested in technology and investing.
---
For more episodes and information, visit [Insightful Investor Website](https://insightfulinvestor.org/).
Written by AI. May contain mistakes. Listen to the episode to check what was said.
Transcript
Automatic transcript. May contain errors.0:06Welcome to the Insightful Investor Podcast, a weekly series that seeks to share industry investment and market insights. We define insights as concepts that are counterintuitive, widely misunderstood, or underappreciated. In other words, unique ideas that you probably won't hear elsewhere. I'm Alex Shahidi, the host of the podcast and co-CIO of Evoke Advisors, one of the nation's leading investment advisory firms. Learn more about our show at insightfulinvestor.org.
0:43Today's guest is Jacob Zeman. Jacob is a partner and portfolio manager at Glynn Capital Management. Glynn Capital is focused on investments in private and public technology growth companies. The firm was founded 50 years ago. Is that right, Jacob? That's exactly right. This is actually exactly our 50th anniversary. Congratulations. Thanks for joining me today, Jacob. No, thank you so much, Alex, for having me. I'm super happy to do it. This is what we love doing, talking about technology. So I'm so happy we could come together today. Well, I've been really looking forward to this episode because Jacob has been right at the forefront, witnessing AI innovation up close.
1:28And we're going to spend the session talking about artificial intelligence. Jacob, you regularly interface with pioneers from top private and public companies. And you've been kind of doing this during this entire phase as AI has really started to take off. So I feel like you have a pretty unique vantage point. I also appreciate that you have a talent for taking complex concepts and breaking them down into easily understandable explanations, which I think is critical for talking about AI. So why don't we just start with your background? You clearly have a passion for investing and technology. Which came first and what originally sparked your interest in each?
2:16Yeah, of course. I think they really came about pretty much in parallel. So my dad was an Air Force officer. We grew up in Europe for 15 years. I went to Dodd schools, the Department of Defense schools. They were very well funded. There was lots of technology in the classroom. My parents spent a huge amount of their income on bringing computers home, a lot of money on dial-up internet from Telecom Italia. And so really invested a lot in technology, both in school and at my house. And in parallel with that, like a lot of stories, I have this incredible teacher in fourth and fifth grade who was just this super saver, who was super passionate about investing and made millions of dollars just through saving on a teacher's salary and investing.
3:01And I think he saw in me someone who was a little bored in the classroom, who was interested or potentially interested in investing and could really be someone who worked and collaborated with him and he could teach me a lot. And so those two things were happening at the same time. And then we would find stocks to buy and I would write up little write-ups of why I was buying them, send that to family members, work on those with him. The first two stocks I bought were EasyJet and Microsoft. So two companies I used every day. And it's funny looking back on that. In EasyJet's case, I was buying this business that was the definition of a business that was commoditizing, trying to be a low-cost provider, literally a race to the bottom.
3:44On the other side, I was buying this compounding, massive, no company. At the time, I had no idea. But looking back, it's pretty funny. Those were the two businesses I bought. Let's talk about AI. When did you first learn about AI, and how did you go about educating yourself? The first time I really jumped into AI in a really dedicated way was actually when we were investing in Facebook and a whole host of these, you know, web 2.0 companies where machine learning aspects of AI were really critical to building the revenue models of these businesses. That sort of personalization, targeting of ads, that was really sort of the cutting edge of where machine learning was at the time.
4:28And machine learning is really the foundation of AI. And then we were also looking at a lot of fraud prevention use cases and the businesses that were driving that, companies like Palantir. So that's when we first got deep into it. And then, as part of being a part of the industry, talking to entrepreneurs, got to spend a lot of time looking at graphical processing units, the businesses that were building those, the sort of massive parallel computing that was coming about at that time, following businesses like DeepMind, thinking about how that was potentially going to change so many industries.
5:02even just small things stick out in my head like more than 10 years ago you know riding around in palo alto and some of the first self-driving cars where you know there was the entire back of the car was just servers and machines and they were super hot and super loud and weighing down the whole vehicle and just this incredible you know set of sensors outside the car and at that time looking at that and thinking i don't know how this is ultimately going to work but it seems like over the long term, this is going to be pretty exciting. And so those are some of the physical things I gripped onto in the middle there.
5:34And then I think one of the very last pieces that really got me interested was this book called, you know, Super Intelligence by Nick Bostrom. And I think this book was just really formative in thinking about what are all the ways that AI could potentially supplement, but also eventually surmount humans? And what are the potential rewards and risks of that. I think that book was really influential for a lot of technologists, Bill Gates, Elon Musk, Sam Altman. And really after reading that book is when OpenAI got formed to really work with how do we harness AI in a way that's positive for humanity and avoid some of the negatives that were in that book.
6:19And so Elon Musk and Sam Altman forming this incredibly important company really grew out of that. And then obviously today, there's so many resources beyond that. So those are the key things in my mind. Those are the learnings, things I read that really stick out over the last 15 years. And obviously, you're learning all along the way as well and talking to companies and learning from them. Yeah. And I think like a lot of technologies, it looks really slow initially. It seems like a toy. And then you have this acceleration. And I think human beings are really difficult to thinking about, you know, you know, accelerating growth or compounding growth that isn't linear.
7:00And so you heard, you know, small amounts about AI kind of slowly built. And right now we're in that, you know, parabolic curve, or it's not just linear advancements, it's literally linear advancements every, you know, few, you know, weeks, few months. And then over the course of a year, you say, wow, that curve is actually big and actually accelerating. And so we're in that period where it isn't these small whispers and things that look like toys and experiments. We're at that point where growth has broken out and is no longer linear and advancements around AI. So before we jump into AI, would you share your career path and what brought you to where you are today?
7:43Yeah, of course. So I went to Kona College, which is a small liberal arts school, really close to Alec, to you down in Southern California. I spent every summer and for all my summers and then internship at Morgan Stanley up in San Francisco, entirely focused on working with private equity firms, mainly focused on technology buyouts. Definitely came into that knowing I wanted to be an investor, knowing that that was the stepping stone to that. Every single one of my peers went to one of our private equity clients. I skipped that whole formal process, knew I wanted to invest, knew I wanted to stay in San Francisco, do technology here, be at the center of that, and really be close to the process.
8:26So I wanted to really drive investment decision-making. And I knew I had to go to a small firm to do that and not just manage process like a young person at a big private equity firm. And I courted Glen Capital, or we courted each other for almost a year. And it's been such a great decision to really grow up the last 14 plus years inside of Glen Capital, learn at the feet of John Glenn, the founder of our firm, really just this legendary investor in Silicon Valley, who's invested in every single cycle from semiconductors to databases to the internet, and now AI and software. And so it's just been incredible to learn from someone who had a front row seat and really make his own investment style mind in many ways.
9:14That's great. Okay, so let's talk about AI. Let's do it. Yeah, let's do it. It's not an easy task. So my first question, maybe even the most difficult, how would you explain AI to someone who has been out of touch for the last 30 years and has never heard of it and knows nothing about it? Big question. I think at a very high level, just thinking definitionally, AI is really a branch of computer science. What ultimately builds up to delivering AI is machine learning. Machine learning is really about taking algorithms, so complex math, to look at large amounts of data and then identify patterns over time, at points in time.
10:01Think about it this way. You have enormous pieces of data. You run algorithms against that. that's called machine learning. Machine learning is an offset or an offshoot of computer science. AI is an offshoot or computer science, an offshoot of AI. So that mess, it's just foundational, definitional layer. That's what it looks like. The goal of AI is to really create machines that perform like humans, have human-like intelligence. And while we're very far away from approximating humans, we're working towards approximating what humans do every day. So complex decision-making, doing intellectual tasks, doing scenario analysis.
10:46And I think most importantly for our discussion today, understanding language. So having conversations. And so one of the big goals of AI, while there are many, I think that's the one right now that we're experiencing this explosion. in. 30 years ago, I think AI competing against Garry Kasparov and the chess champions was this moment in time, captured people's imagination. But today, there's just been this explosion that definitely goes way past those memories, goes way past what we've experienced with Siri or Amazon Alexa in the house. And really, that breakthrough, that happened in about 2022, where it really broke into the consciousness of normal Americans, normal people globally.
11:34And now you see virtual agents, assistants. You see people who are normal knowledge workers using these tools dozens, sometimes hundreds of times a day. You see self-driving cars. I take a self-driving Waymo to and from work every single day. It's actually the only ride-sharing vehicle I let my eight-year-old in. And so that acceleration, and now it's just seeing the benefits of AI every single day, multiple times a day, that's really what's occurred over the last 30 years. You talked earlier about how the growth can be very slow and then it can jump pretty drastically. So we talked about the supercomputer AI beating the chess champion, and we've seen it with Jeopardy.
12:17And it took a long time to go from that to what we're experiencing today. And that massive breakthrough. Yeah. And again, it feels like it's happened overnight. It was definitely slow. But then growth and new technology environment and every tech change we've seen eventually becomes nonlinear. And we're at that steep, steep, steep part of the curve right now. Let's talk about what you said earlier, which is part of the goal is for this computer to our technology to match humans. So we know humans have limitations. We can be biased. We can only process so much data. We learn slow. We get tired.
12:59We can become bored with repetition. So what does AI do well and what are its limitations at this point? Yeah, I mean, there's so many different things to list. I mean, maybe starting with some of the strengths. I think AI is obviously great at handling large data volumes. At its core, we're talking about processing huge amounts of data, finding patterns, applying those patterns. So handling large amount of data, amounts of data, indexing and understanding it, learning from it, massive strength first and foremost. It obviously is very fast. It can be very efficient. It doesn't tire, as you just talked about.
13:38It's constantly learning, constantly improving. It can be very objective. We obviously need to think about ethics and morals and how we fit that in there. But if you give it a set of rules will be objective along the lines of those rules. And so those are the big strengths that I tend to think of, but there's obviously a long list and that's far from inclusive of everything we potentially see. The weaknesses here, I think we're going to dig into all of these, I'm sure, in this conversation. And these weaknesses are probably the root of all of the worries that people have on AI right now. I think one of the biggest ones is right where I started with, they're great with data, but everything depends on how much quality resides in that data.
14:23Is it heavily dependent on, you know, where that data came from? Was that data already, you know, biased? Were there issues with it that make these sort of outcomes and the training of the AI models, you know, less than optimal? So data quality has always been a weakness. It'll probably stay a weakness forever. We can just continue to improve on that. obviously we've all had experiences with this generation of ai and previous generations where ai is not really understanding the context of situations or the context of how we talk to each other so it's not picking up the nuance of how we handle tone sarcasm slang how we relate to each other i think another big limitation which which relates to some of that context and nuance is just ai just can't be as creative it can't be as innovative its ability to come up with unique and novel ideas is just more limited.
15:15It isn't as creative because it's really built on existing data and what's come before, not what humans can imagine and think about into the future. And then I kind of touched on this before when I talked about strengths. It can be objective, but also there's all of these ethical and moral decision-making points, which aren't necessarily rules-based. They are things that require human judgment and they require us as a society and individually to wrestle with when it comes to decision-making. So those are some of the bigger weaknesses that I think about. So let me phrase it a different way and tell me if this makes sense.
15:52I think of, if you think like a computer, if a human thinks like a computer, there's like this infinite decision tree and you kind of go down this different path. And I assume AI has the ability to obviously capture a lot more than a human in that respect, But also, it may have a better ability to focus on the right part of the decision tree to really empathize. Okay, it kind of narrows the range of future potential outcomes and can really analyze that better than a human. Does that make sense? I think that's exactly right. Yeah, that's one way to think about it. Okay, so you've got these amazing computers that are getting better, and you have humans.
16:32How do we coexist? And ultimately, how does one plus one equal three? I mean, I think that's been a question that has gone back decades and decades. It's not one we're just wrestling with now as we think about this explosion in AI. I think the biggest sort of coexisting point to focus on is really one of augmentation versus replacement. And I think we're seeing this in this wave of AI where the AI that feels the most valuable, the most positive, that's honestly delivering the most value today is really about augmenting human beings, augmenting the work they do, making them more efficient, giving them more time to do things that are more meaningful or valuable to them.
17:23it's not about replacing people. It's about making human capabilities better, making people more efficient, removing tasks like note-taking or workflows that are super tedious. And so if we always are looking at AI and saying, how do we get better? You have to start from a place of thinking AI is going to augment us. It's going to make us better. It's not going to ultimately replace us. And then I think if we're going to coexist, we have to answer those tough questions around how do we have ethics around AI? How do we control AI in a way that's aligned with the success of each individual person, of us as a society, of us as a species?
18:05And so figuring out AI ethics is critical to how we're going to ultimately, again, be augmented and not make this into something that doesn't work for us. And then I think we're also going to have to build ways to make sure that human oversight always sits on top of AI. We have to be able to control how this technology develops. And I think, again, if we're going to stay focused on augmentation and using AI to make people's lives better, we have to have that piece of oversight. What we talked about earlier is we have certain strengths and weaknesses. AI has certain strengths and weaknesses. And between the two, you could be in a much better place than you could be with just one by itself.
18:50Absolutely. Yeah, I think there's tons of places where one plus one can definitely equal three. So we're seeing enhanced productivity, absolutely. We're seeing customer service agents who just provide much better answers than they can provide alone, and much better answers than a computer could provide through a chatbot. We're seeing much better decision-making. So, you know, classic example we see all the time is, you know, Amazon used to employ, you know, 50 people, 100 people on forecasting demand around, you know, certain seasons of their business. They've supplemented those people with tons of algorithms over time, and they're actually getting to much better results than they were able to get to when they weren't using machine learning or they were just relying on humans.
19:38And so here's an example, definitely, where the two of those pieces working together is actually getting us a bunch better outcomes. And then I think it's important to just think about personalization. And so I think there's definitely a way for AI to surface to people, unique experiences surface to them, what they really care about, just save them all that time. And that personalization is something you can't do purely with computation. It's something that a user has to interface with the AI to ultimately get the full value out of it. And I suppose the main message for people is learn to use AI so you can work with it rather than try to compete against it.
20:22100%. And I think every business leader, every management team we talk to, whether that's a technology management team or it's a non-technology space, they're thinking about it the exact same way. They're thinking about how do I train my people? How do I bring this technology into our organization in a way where it enhances everything we do in our core business, but it also enhances how effective and productive my employees are? And can that actually help me on the cost and revenue side? They're not thinking first and foremost about replacing people. They're thinking mostly about how do I get more out of the investments I've made, which will allow me to invest more in my business ultimately.
21:04Right. So if we take AI one step further, there's this concept of AGI. Would you tell us what that is and a realistic timeline to get there? So AGI is definitely the big fear, but also the big promise in this space. And if you look at technologists, there's definitely a bit of what I would call a holy war between if we do reach AGI, artificial general intelligence, will that be a big positive? Will it be a big negative? The way to think about what AGI is, is it's really the ability for AI to understand, learn, apply knowledge at least as well as humans, and potentially in a way that exceeds humans.
21:51And it's not specific to certain tasks. It's not specific to language tasks or image generation or the sort of generative AI tasks we're seeing today. It can complete many different forms of tasks, just like a human being. It's capable of performing all sorts of intellectual problem solving. And, you know, I think that presents, you know, all sorts of potential issues, but also a really bright future. in terms of, you know, getting there, very difficult parlor game to play right now. I think history is kind of littered with examples of, you know, over exuberant predictions around what's going to happen in the near term.
22:32But then, you know, ultimately, we still get there just takes a little longer. And so right now, I mean, the progress in generative AI is just so rapid that I think there's definitely a school of thought that AGI is right around the corner. You see the improvement in all of these benchmarks around Gen AI, taking the bar exam at a level of the top decile or passing the MCATs. You're seeing all of these tests of Gen AI performing specific tasks. I think you want to extrapolate that and say, well, we're going to be at artificial general intelligence really quickly. I think if you look at some of the experts in this space, so Sam Altman at OpenAI, he talks more about, hey, this is a three to five year away from AGI, the CEO of Anthropic, another leading AI company.
23:30He talks more about two to three years. There was a big survey of 2 ,000 AI experts. They put the date at more like 2035. But again, this is very difficult to forecast. And those are just the sort of predictions from practitioners who are deep in the weeds today. What would you say are the potential benefits and dangers of AGI? The big, big benefits are just enhanced problem solving. So problem solving that isn't about pointing AI at one particular task or solve this math equation for me or write me a letter, but actually AGI solving a problem from start to finish and knowing how to go do that, knowing what individual tasks to do, how to stitch them together, how to ultimately move forward to what's the next problem.
24:29what should be working on. And if it wants to get to a certain place, it understanding, you know, like a human being, what sort of complex steps to take to actually get there and actually, you know, make that problem happen. I think some of the other exciting things, definitely around healthcare, there's a whole series of, you know, diagnostic benefits we could have, a whole series of rapidly scaling drug discovery benefits. there's just an incredible amount of sort of scientific and technology advancements that could come from AGI that we probably can't get to if we're thinking about the limitations of just the number of scientists, for example, or how quickly they can process data and do research.
25:14And so there are all these potential benefits of AGI that in some ways are just the benefits of AI and Gen AI today just placed on steroids and massively scaled up. And is there a risk that it becomes so productive and so powerful that humans just become lazy and we become a useless society? Or will we adapt and give it its tasks and take on things that maybe it can't do? That fear is definitely out there. And I think it's something that all of us individually, but also policymakers, are going to have to constantly be looking out for. And you're exactly right. There's tons of potential economic disruption, loss of jobs, this sort of widespread automation problem solving that AGI could do could potentially be really destructive to society.
26:09And then if we're not able to monitor and control AGI, there's all these new ethical and moral concerns. We need to work really hard to make sure that AI, especially AGI, stays aligned with us. And where you don't see things like autonomous weapons or massive privacy violations or some of the sort of security issues that can ultimately arise. And the stakes are just a lot higher. The potential dangers are there. And then I think at its zenith of fear, we have something which is more just existential risk, the sort of AGI takes over the world, ultimately takes off and doesn't just become a peer of humans, but an accelerating rate gets super intelligent relative to humans.
26:55I think these are all gradations of how much risk we face. I don't think we need to necessarily end up on either side of that. The reality is it will probably exist somewhere in the middle. But all these are real dangers and they should be taken seriously and we should be developing a framework for how to control them alongside all of the advancements we're seeing again every week, every month, every year. And I guess there's been enough science fiction movies where you have things like this happen. And so we've got a glimpse into what the future may look like. And usually those stories don't end positively for humans.
27:35I could see why there would be some hesitation and letting it just run on its own. It's definitely the case when you train a lot of the Gen AI models on data that's focused on science fiction, they put out a pretty dark view of the world. Okay, so let's talk about the industries and the jobs and the various functions that are the low-hanging fruit that AI is likely to take over quickly. And which tasks would you say have a much longer way to go? That's a great question. I think it's one we think about a lot just as an investment team, because a lot of this low-hanging fruit is where value creation is happening right now.
28:18And this isn't things we think will happen. It's actually happening at a pretty interesting pace. And so some of the obvious low-hanging fruit are things like customer service. This is happening all across the public technology markets and businesses you can go by today. This is responding to common questions, managing FAQs, just all the basic interactions and troubleshooting between a company and its customers. And we're just seeing leaps and bounds, measurable improvements there. And so I think that has to fit in a low-hanging fruit category because we're already seeing it. It's already very measurable.
28:56These AI assistants and the augmentation they can bring to customer services is really just incredible. And then data entry, processing, all of that AI has been chipping away at for a while, but Gen AI has just made that meaningfully more powerful. And we're talking about orders of magnitude improvement and how fast and careful we can do that. And then we're seeing the changes in transportation and logistics, Waymo's transporting people all over San Francisco and Los Angeles. definitely in financial services, there's low-hanging fruit there. There's tons of advancements in figuring out financial fraud that we have now that we didn't have before LLMs and for the current advances in AI.
Read the full transcript
29:43And so there's a whole host of low-hanging fruit pieces that their job is happening right now where Gen.ai is stepping in to supplement people. and there's actually measurable value getting created as we speak. On your second question in terms of what's going to take longer, there are jobs that kind of go back to what we were talking about before, things where AI struggles more. And so I think for a lot of people, that's the creative professions first and foremost. So when it comes to originality, emotional intelligence, being a musician, being someone who creates art, working in advertising, those are really difficult things for ai to do because again it's focused on data that's come in the past it's tough to be it's very difficult for it to be original and so those sort of roles and jobs to be done on the creative side i think are just really difficult uh to be uh to be automated at this point i think a lot of legal and regulatory situations i think that ai can help with some of the road tasks.
30:49It can help with search. It can help do some common documents. But those are spaces where you can't have error rates that are even 5%, 10%. The potential issues of making mistakes are just too high. And I don't think AI is at a place where the thinking and care and duty that a senior attorney puts into a process is going to be easily replicated by where AI sits right now. And then I think also just healthcare, I think again, the stakes are very high. I think AI can supplement a doctor or a decision maker. It can help them with some diagnostics. But when it comes to actually generating a plan, doing all the cost benefit analysis, doing the emotional work with a client, that's just going to take a really long time for generative AI to have a big impact.
31:44I guess you could think of it as having a really smart analyst that has more data than anybody and is really smart and keeps getting smarter and smarter and can give you great information, but you make the ultimate decision. Absolutely. You mentioned financial services. Obviously, you and I both work in that industry. I'm curious what you think about investing. Is that something that can be taken over by AI or does it have limitations that prevent it from being as good as humans? Yeah, I think it's a nuanced question. I think there are definitely ways Gen.AI can help humans in decision-making.
32:24It can help us process a lot of the work we're doing. It can do great summary work. It can help pull apart different data points that reside in different work we're doing at the ground level, talking to management teams, talking to experts. And so from what I observe day to day as a fundamental equity investor who's trying to make the best decisions possible, it can be really powerful in terms of automating the work that we're doing every day. But when it comes to actually going out into the real world and collecting that data, analyzing people, figuring out those things that are difficult for a machine to really understand, I don't think it can really replace that piece of decision-making.
33:09I think it can make us a lot better. We use it every single day. I have the major LLMs open in my computer in a tab all day. Our team is using these systems all the time. But I think ultimate decision-making when it comes to understanding what businesses you want to own for 5, 10, 15, 20 years, that's very difficult. I think in the world of quantitative finance, AI has had a presence there for a very long time. I think it will continue to get better and be a part of that. But I think that's a different approach. Maybe that's a much shorter term approach to how investing is done. And I think you and I both know there are many different ways to be successful as an investor.
33:55One of my prior guests was Martin Escobar, co-president at General Atlantic. And he talked about now they have another person or a computer on their investment committee. She's not voting yet, but she's AI powered and she provides great insight and she's gaining credibility amongst these great investors. And you can think of it as just one plus one equals three, another example of that? Absolutely. Yeah. No, I mean, we're processing all of our notes in our main repository, but we're also processing all of our investment memos. And we're definitely trying to find blind spots or things that we've missed on some of our companies.
34:36And then we're feeding in a lot of third-party information too. So all of the transcripts, all of the additional data that's more readily available and mixing that with the data notes and the real sort of information we're capturing from meeting with management teams directly. So I totally understand you could have not just another analyst, but you could have this improving decision maker who maybe will never get to our team's level, but can be a really powerful voice around the table. Right. And the way I've heard it described, which I think makes sense, and I'd like to hear your thoughts, is AI works really well when you have a lot of data.
35:15there's actually limited data in financial markets you know compared to billions of data points elsewhere there's a low signal to noise ratio that you have players that are impacting prices and those players evolve if you were the only one with ai technology you'd have a huge advantage but when everybody has it it's not as big of an advantage and and also when you study history and you just look at financial markets history that was one path that history took but could have easily taken thousands of other paths. And so the data can become overconfident that the future is going to resemble the past.
35:52I'm just curious about your thoughts about all of that and how it relates to AI taking over investing. I think that's exactly right. I think that if you think about the extremes here, and as you said, there's relatively a small amount of data in the financial world. The data I'm talking about on the ground, meeting with management teams, that's in a tiny amount of data, not just inside of our firm, but across the entire industry. On the other extreme, we have the big large language models from OpenAI, where you're getting to a place where 70 % of all printed words are inside of those models. And we're getting most video globally into those models.
36:31And so those models are getting incredible at certain tasks because they have almost the history, not just of human knowledge, but the history of how almost every word is relate to every word on the internet and more expansively. And so I think you're absolutely right. The problems you can solve here when you have a quantity of data aggregated and trained against are going to be different problems than when you have a relatively smaller data set, and you're going to need different levels of human judgment input there. So in terms of AI, we've seen some pretty big bugs that need to be resolved.
37:09And we've seen examples of this brilliant machine that makes obvious mistakes that a human would rarely make. Would you talk through some of those? Yeah, absolutely. So, you know, I think the one we see pretty frequently is just the lack of common sense. So there's just a whole lot of, you know, world knowledge and common sense reasoning that we're learning our entire lives from our parents, but also our experience that we move through the world. And, you know, we see machines fail to do that pretty frequently. Going back to the autonomous car piece, autonomous cars can take us through dangerous neighborhoods or cause us to do things that aren't perfect for the social context or raise certain safety concerns.
37:51And so there's just all of this common sense that you use throughout your entire day, that you use in everyday life that isn't easy to pick up from that big backward-looking generalized data set. They're things that you've experienced. I think another Another big bug is just decision-making. So like we talked about it, we talked about earlier, the quality of the data really matters. And so if you're feeding in a whole bunch of data that's biased, what you're going to get on the other side is very biased. And that's going to have discriminatory lending practice issues. You're going to have potential issues in how you screen candidates for jobs.
38:28And so there's this big bug around bias that's driven by the ultimate data that goes into these systems. And then I think we've talked about this a number of times, but this, again, this ethical and moral reasoning piece, simple things like autonomous vehicles deciding what's the optimal decision when they're thinking about potential harm to this human being, this piece of property, etc. Many decisions that are very common sense, somewhat easy for human beings to answer. Many difficult decisions that you would need an ethicist to work on with maybe a priest or a rabbi. And so that piece, the ethical and moral reasoning piece, is a big bug that we're going to be working on for a long time.
39:13It's not easily solvable. How does the AI breakthrough that we're experiencing compare to other technological innovations in the past, like the railroad or the internet? Yeah, I think that's an incredible comparison. I think comparing it to the internet, that's maybe too close a comparison to what we're experiencing. I think my personal opinion, I think the opinion of a lot of AI experts, this is bigger than the internet. You do, again, have to go back to the railway and electricity. And so maybe I'll just focus on the railroad one because I think that it is different enough. Enough time has passed.
39:48And so the middle model we work with internally, and it's one that we're not geniuses. I'm sure we've taken it in over time from reading and from what we've learned in the world and other people have learned, is that any big tech innovation has to improve the lives of human beings on a really massive scale. It has to transform industries. It has to improve connectivity and transform industries while it's doing that. And it has to create new markets. And so in the case of railways, you had this enormous improvement in daily life. People could travel and see each other and see their relatives. The world literally just got smaller over time.
40:31And that improved not just their ability to see their families, but also the opportunities they had in jobs and education and access to markets. And so daily life is dramatically improved. I think in AI, we're seeing daily life improvements with agents inside the cars or personal transportation or Apple intelligence in your phone. But that's just the very beginning of the transformation of daily life we're going to see over the coming decades. And then from a transformation of industries, you know, improved connectivity, we've been having this conversation here about the innovation and change we're going to see in healthcare, in finance, in all of these critical industries that touch all of us every day and do make our lives better.
41:15The railroad obviously revolutionized transportation, you know, and enabled, you know, fast movement of people. There was every single industry was touched by what happened. And then on creation of new markets, a whole bunch of the industrialization of America and globally, moving coal and steel and commodity products in a way that made human life better. Railways did that. And I think we're stimulating all of our existing industries in a way that's going to create new markets, new knowledge markets, but also ultimately going to create entirely new markets and entirely new jobs to be done that we can't even understand at this point.
41:55In the same way that if you were sitting there at the advent of the internet, sorry, at the railroad, you couldn't have really seen those new markets, the new facilitation of trade that was probably coming our way. We've seen this before, but it's not exactly the same. No, there's, I think, up and down the stack from that high level piece, all the way down to the investing stack. There are commonalities, there are things we've seen, but there are also things that are distinctly different this time. I've heard the argument that AI progress will be constrained not by the technology, but by society's acceptance and ability to keep pace and its interest in protecting the people.
42:36Do you agree with that? Absolutely. I think right now we're seeing the technology advance at such a rapid pace. I think as I walk around San Francisco, as I spend time with my friends and network, and I spend time inside these companies, it's just this incredible explosion. It's reinvigorating San Francisco, but I think it's just reinvigorating technology, broadly speaking. And so that explosion, how fast it's moving day-to-day, week-to-week, month-to-month, society is going to take longer and it's going to have to catch up and it may always be a little bit behind but if we're going to actually use these big advancements and not rein them in too fast society is going to have to accept these these technologies or find a way to accept them and so i think people are going to have to learn to you know trust these systems they're going to have to have great experiences that they feel are safe they're going to make sure that they feel these systems are safe, that they're ethical, that they're monitored by the right regulatory bodies.
43:41We're going to need to see governments step in to some extent and deal with difficult, thorny issues like data privacy, but also regulation stepping in and mitigating some of these really wild risks we talked about earlier. How do you regulate artificial general intelligence if we get there. And then I think as a society and just how do we think about economic distribution and potential unrest, this whole idea of how you protect jobs, but also allow new jobs to be created as a result of AI. So striking that delicate balance is something that as a society we'll have to figure out, the regulators will have to figure out.
44:26And so I completely agree. And then overlaid on top of all of that, which I think in Silicon Valley, we maybe talk more about, but I don't know if society talks quite as much about it, is just the global security and competition issues. And so if we're not moving fast, if we're not enabling this innovation in other countries where we are competitive, where there are national security interests are doing that, are we leaving ourselves vulnerable? And so we have all of these competing concerns and we have to strike the right balance between, you know, how fast the technology is moving, the benefits from that, you know, society accepting that, us regulating that, and then making sure that we're not constricting it so much that we're falling behind or putting ourselves at a disadvantage as a society.
45:13And I suppose one lesson history has taught us is you can't fight technological innovation, but you can try to manage its pace, but to a limited degree because of reasons like you described in terms of competition of others and just the natural progress that humans experience through time. No, I think that you're absolutely right about that. And in many cases, at the front end of every one of these big innovations, we see some commonalities, as we said. And one of the big ones is this, we will lose a bunch of jobs, the economy will be ruined, this technology innovation won't work for most people.
45:53and maybe it takes some time to sort that big change out. Maybe it takes time to sort out the winners and losers of industrialization or the internet or globalization. But eventually, new jobs get created to replace those old jobs. And we look back and say, wow, I'm so glad that technology happened because it actually did make all of our lives better. It made all of us more prosperous. There was this difficult period, but a whole bunch of new jobs were created. And ultimately, we have a much bigger pie that is beneficial to many more people as a result of this change in our society. Let's dig into the key components of an AI infrastructure and trying to keep it not as technical if possible.
46:41That would be ideal. Yeah, definitely. I think just right up front before we jump into the infrastructure piece, we've talked a little bit about large language models. Those are the big breakthrough. That's what we're seeing in ChatGPT. That's really the foundation of this big AI shift we're seeing right now. This whole infrastructure today is really built around enabling that big change, the large language models and all the benefits they deliver. And so as you're thinking about creating an entirely new technology stack, an entirely new infrastructure, it's all in service of making those foundational models better user experiences.
47:28And so when you think about a technology stack, you start most simply with the infrastructure at the bottom, which tends to be hardware, all of these middle technologies, which help enable the usage of that infrastructure. And then at the very top, you have applications. So this is where the difficult work actually gets done, where humans are actually interfacing with this core infrastructure, with these enabling technologies. And this is why we build infrastructure. We build infrastructure to do useful work with the application layer. And so for AI right now, at this foundational level, that's where most of the dollars are flowing today.
48:06That's where most of the revenue growth is. And we're putting that infrastructure in the ground for the very first time. And so that's why NVIDIA has just been on this incredible ride, not just as a stock, but obviously on revenues and its criticality to the development of the space. And so NVIDIA, for example, it's added almost$2 trillion of market cap a year a day. That's an entire Google. It's more than 10x free cash flow in a matter of quarters at incredible scale. And so we've never seen anything like that at any point in modern financial markets. And it's really because the foundational market, this infrastructure, it absolutely requires graphical processing units from NVIDIA.
48:54It needs those semiconductors. And the demand from the big clouds for those semiconductors is essentially limitless right now. NVIDIA can't make enough to build infrastructure into the ground. And then riding on top of that infrastructure are these large language models from the companies you hear about every day, like OpenAI, where they're training on these massive data sets, data sets like I talked about earlier that look at 50 to 60 % of all the data, all the printed word that has ever been created. And training one of those models is incredibly expensive. It costs hundreds of millions of dollars.
49:30It will cost billions of dollars in the future. And once you've done that training, you can actually start to do useful work for people. You can actually make ChatGPT get better and better over time. And then that middle level, we have all these technologies that essentially help advance LLMs. So help technologists utilize the underlying technology, make LLMs better, build better models, essentially get the data and the access to the infrastructure ready for that application layer where humans are actually going to do useful work. And I'm happy to talk about some other companies that are in that middle layer, that application layer.
50:12There's businesses that are at massive scale today that are putting AI into their applications. There are native companies that are getting built with AI at the very beginning that are doing application work. And obviously, if you've worked with ChatGPT, that's the quintessential AI native application that's solving real problems for users today. Yeah, let's talk about some of the leading public and private companies in this space. What do they do? What makes them the leader? Yeah, absolutely. So I already talked about NVIDIA. They make semiconductors, specifically graphical processing units. These graphical processing units allow for parallel computing, and parallel computing is absolutely essential to the machine learning and the building of LLNs we've experienced so far.
51:04Obviously, you also have the big hyperscaler public clouds that have really revolutionized the internet the last 40 years, but have particularly revolutionized the cloud and are now critical to the adoption of AI. So that's Microsoft Azure, Amazon Web Services, and Google Cloud. They're obviously all enormous beneficiaries. Then as you move up the stack, you end up with a number of public and private companies. Some of the big private companies are really around how do you store these LLM models, how you collaborate on them, how do you store the weights that you see inside of these models. These are businesses like LangChain, Llama Index, Weights and Biases, Hugging Face.
51:50They're all solving different parts of that issue. And then you also have businesses that are trying to sort of monitor what's happening around these models and look inside them, hopefully, and figure out how the algorithms are actually working and how they can be tuned and improved. And then that application layer, there's a long tail of AI native companies that are trying to build applications from the ground up that are heavily reliant on AI. But then there are public companies today like ServiceNow and Microsoft and GitLab and a long, long list that are taking all of this AI technology that's being built by the public cloud companies and businesses like OpenAI and embedding that in their applications today to make those applications better.
52:43And so the quintessential example is ServiceNow, which is a business that helps in one area deliver customer service, deliver service from HR to employees or from customer service agents to consumers. and they've embedded all of these Gen.ai products throughout those use cases. And they're actually able to charge meaningfully more, up to 50 % more, because they're really getting to measurable returns from integrating this technology. We look at the news, OpenAI and many of the LLMs seem to get a lot of the headlines. What's your outlook for the LLMs? Yeah, that is something we wrestle with all the time.
53:27And you're absolutely right. Those companies are pushing the state of the art. They have the capital from VCs, but also from strategics. They have all the leading researchers. They have incredible technologists. And now they're building out commercial teams for the first time. And so those LLMs, those foundational models, there's probably three to five that really matter right now. Plus, you know, an open source model called Lama that's developed by Facebook. In the near term, I think we're very positive there. They're advancing, again, the state of the art very fast. They're training these LLMs at incredible speeds.
54:08And I think the distance between where they're at today and somebody who wanted to launch a new foundational model is enormously wide at this point. And so we're very positive on those companies in the near term. I think over a longer period of time, there are real risks there. So, you know, there's definitely situations that could arise where they're all training on the same data and they all are kind of getting to, you know, a similar sort of terminal level of effectiveness. And at that point, I do think it's more of a race to the bottom. And there's also potential issues where, you know, good enough may be okay for the vast majority of AI use cases.
54:53You may not need to be on the leading cutting edge model for every single AI use case. And then I also think that there are just issues around they're providing, you know, API access to sort of core generalized AI function. but really most of the value creation is happening at the application layer. And so if you think about the historic model for technology innovation, you usually put these infrastructure companies at the bottom at the very start. And so in the internet, you had the big investments in semiconductors, in Cisco, in all of the physical infrastructure. And then you had the application companies like Google that came at the very end.
55:41And the amount of value that gets created at the end of the application layer tends to dwarf the amount of value that gets created in the infrastructure layer. And so right now, we may be at the phase, and I think we're at this phase, where we're generating a ton of value as we put the base layer infrastructure in. And that's NVIDIA. It's these large language models like OpenAI. But ultimately, most of the recurring value that's going to be sustainable is going to reside at the application layer. And it's probably going to reside in many companies that haven't been built yet or are being built as we speak.
56:16There's been a perception among investors that larger incumbent tech companies are the primary beneficiaries of AI. How do you feel they are positioned today? Yeah, right now in the near term, that's an absolute fact. Going back to that infrastructure piece, you need to put this infrastructure in the ground if there's any hope for delivering great experiences for people and actually advancing AI over time. And that looks like an incredible amount of investment today. So it's billions of dollars spent on NVIDIA chips. It's tens of billions of dollars invested in these models. That's all flowing to the semiconductor companies.
57:00It's flowing towards businesses that are building out data centers, building out just the core physical infrastructure to deliver that computing. And it's flowing to the big clouds who are making those resources and those data centers accessible to AI-driven companies. And so right now, most of the value creation is happening at the largest companies because they're best equipped to go put that infrastructure in the ground. But if it plays out like the internet, that probably won't be the case five to 10 years from now. What do you think the AI funding environment looks like today? It's been very healthy, as you might imagine.
57:39And valuations have obviously been pretty difficult to swallow, depending on your investment approach and what stage you're investing in. I think it's important to sort of dig in the covers of what that environment looks like specifically. And so most of the capital, call it 60 % to 70%, has flowed towards those large language models. So headed towards open AI, towards anthropic and competitive open AI, towards all of that tooling around those foundational models. And then there's this long tail amount of capital that's been focused on some of those applications that are going to get built that are AI-specific.
58:18Some of these technologies that help the consumption of these core LLMs in different ways. But I think from a quantum of capital, it's still very focused, that infrastructure layer. It's very concentrated in a few companies. And you have this long tail of companies where valuations are all over the place, but definitely high and potentially rising. But it's very difficult to pick winners and losers at this point in that group. Yeah, you talked about high valuations. We see that in public markets, as there's so much optimism surrounding AI and companies that are touching AI. Are we in an AI bubble akin to the internet bubble?
59:01Do you expect a correction? How do you compare those two? You've definitely seen some multiple expansion. So certainly NVIDIA's multiple has expanded for just looking at that company as the quintessential explanation for this. But also, free cash flow in that company has more than 10x. And that's different than what we saw in the internet period. we saw multiple increases, 5, 10x, 15x, increases in fundamental revenues and a handful of businesses, but not nearly as fast as what we're seeing with NVIDIA where that's all happening in this compressed four to eight quarter timeframe. And so for these leading companies that are really driving stock market returns around AI, a lot of that, if you deconstruct it, really is driven by fundamental growth right now.
59:50On the other side of that, whenever we potentially go into your typical sort of, hey, we're really positive, but there's potential concerns in the near term, maybe the narrative shifts, and there is some deleveraging happening there, some of that growth may start to tail off and then valuations will decline. And so I don't know where we are along that wave of valuations relative to fundamental growth. I do know, unlike the 1990s, the leading companies right now are actually generating a lot of fundamental growth right now. It's not mostly valuation expansion that's driving fundamental returns.
1:00:32I guess the key question is, how long will the fundamental returns persist? You know, when you go through a phase where all of a sudden you get this explosion in growth, it's easy to extrapolate that over a long period of time. And there's a huge uncertainty around, are we underestimating the growth? Are we significantly overestimating the growth? It's hard to know. So I guess it becomes riskier at that point. Riskier to invest and riskier not to invest. Yeah, it's a perfect, that is such a good summation you just put out there, especially the very last point. You don't want to miss the value creation when you're at this steep part of the curve and it's very difficult to predict what NVIDIA's revenues could be in two quarters and four quarters.
1:01:20But at the same time, we know these things are never straight lines. While we may be super positive on where AI is in 10 or 20 years, just like we're super positive in 99 or 2000 around where the internet could be in 20 years, along that path, there's going to be periods where, you know, maybe some of these companies don't grow and you actually see a lot of, you know, deleveraging in a business like NVIDIA. Even if, you know, shutting your eyes over 10 years, you're going to end up with a business that's 10 or 20 times larger from a fundamental perspective. My last question is, if we look forward long-term for the potential for AI, Are you confident that it's going to be transformative?
1:02:03And are there certain proof points that you're looking for in terms of its potential, particularly relative to what people expect? Yeah, of course. So I think over the long term, we're very positive. We're already seeing enough point use cases and adoption that are broad enough. You see how those could scale and expand from here. So we are very early, but we're seeing measurable adoption, measurable returns, and we're monitoring an enormous number of those proof points. And so I kind of think about those proof points in two categories. So there's laying the foundation, which we spent a lot of time just talking about, which is, are we putting the capital in the ground?
1:02:45Are we building the infrastructure? Are you putting out the data centers, deploying the chips, building the foundational models that will allow us to deliver incredible experiences that will allow for adoption. Everyone's really focused there. A lot of great proof points there. I think we're going to get there. I think we're going to build the infrastructure we need for the next 10 or 20 years in the same way we built the infrastructure we needed for the internet. Maybe we overbuilt in 1995 to 2001 with Cisco and all the fiber we put in the ground, but that fiber became the backbone of Verizon.
1:03:19And that was required because the requirements of the internet ended up being thousands of times larger than we thought. And so maybe we're at that point right now. But I look at how we're laying the foundation. We may be overlaying it for the near term, but we're probably underlaying it for the long term. And so we're measuring those proof points, those adoption, those laying the foundation proof points. And then on the adoption side, thinking about it on the consumer side, thinking about it on the company side, On the consumer side, we're looking at user growth. We're looking at how frequently people are using these products, the sort of work they're doing.
1:03:53We're looking at the applications and the user experiences and the user interfaces. Are there applications arising that make this feel like magic, where someone doesn't even understand or really care what's happening under the covers? They're just having magical experiences. And most of the time, they interact with these AI-powered features and applications. They're getting incredible results. They're not getting turned off. And so you can really measure that adoption and engagement and then look for those proof points of, are there these incredible applications that have great experiences on the front end?
1:04:28And then on the enterprise side, are real business problems getting solved that are measurable, that have real ROI attached to them? And across many industries and many use cases, we are seeing exactly that. We can look at usage data. We can look at some of the revenue opportunities that have been unlocked by Gen.Ai. We can look at some of the measurable increases in productivity for existing employees. We can look at some of the cost savings that have come about as a result of Gen.Ai. And so, you know, I think on the adoption side, we see, you know, both quantitative and qualitative ways to measure that consumer enterprise adoption.
1:05:07This was such an interesting conversation, Jacob. I appreciate you taking the time. I could do this all day. And we just scratched the surface of the qualitative piece down to the weeds, right? Yeah. And your passion comes through. and I wish I could sit in your seat for a week and be in front of all these great companies that you're constantly analyzing. And to me, just being on the front lines during this technological revolution is pretty fascinating. So thank you. It's never been a more exciting time personally to do this job and it's never been a more exciting time to be in this industry and actually to be back in San Francisco and just the Bay Area in general.
1:05:54where that you can feel that energy in a way that, you know, my peers who were investing in the 90s, it's the closest thing they can describe to that, that sort of spirit of innovation and excitement. That's awesome. Thank you, Jacob. Thanks for listening. We hope you enjoyed this episode. Please visit our website at insightfulinvestor.org to access past shows and learn more about our podcast. If you have questions, feel free to email us at info at insightfulinvestor.org. And if you enjoyed the discussion, please subscribe to this podcast to ensure you don't miss future episodes. And don't forget to forward today's conversation to others you think would enjoy listening.
1:06:37This podcast is provided for informational purposes only and should not be relied upon as legal, business, investment, or tax advice. All opinions expressed by podcast participants are solely their own opinions and do not necessarily reflect the opinions of Evoque Advisors, their affiliates, or companies featured. Due to industry regulations, participants on this podcast are instructed not to make specific trade recommendations, nor reference past or potential profits. And listeners are reminded that securities trading, commodity trading, and alternative investments are complex and carry a risk of substantial losses.
1:07:12As such, they are not suitable for all investors.
1:07:19Listeners should be aware that guests featured on The Insightful Investor may have current or past associations with Evoke advisors or the host, including as an investment manager of a private fund opportunity by Evoke, or access through an affiliated Evoke fund, or as a client. Participation as a guest on the podcast should not be perceived as an endorsement or testimonial with respect to Evoke Advisors, the podcast host, or their services. Similarly, the inclusion of a guest on the podcast does not imply that Evoke Advisors or the host endorses the guest or any company with which they may be affiliated or employed.
1:07:58Evoke has neither paid nor received compensation from guests for their participation.
From the publisher
Jacob is a Partner and Portfolio Manager at Glynn Capital Management, which invests in private and public technology growth companies. The firm was founded 50 years ago and Jacob has been right at the forefront, witnessing AI innovation up close and regularly interfacing with pioneers from top private and public technology companies. With this uniquely insightful vantage point and a talent for simplifying complexity, Jacob summarizes artificial intelligence into easily understandable explanations.




