The Future of AI with Bret Taylor, Winston Weinberg, Garrett Lord and Aaron Holmes | Aug 20, 2025

20 Aug 2025 · 49 min

Ask about this episode

Ask anything about it. ChatGPT or Claude reads this page and answers with the times it was said.

Connect VO and ask about every podcast you hear, including the moments you saved. Add to ChatGPT · Add to Claude

In short

Podcast Summary: The Future of AI with Bret Taylor, Winston Weinberg, Garrett Lord, and Aaron Holmes

Episode Overview Podcast Title: The Information's TITV Episode Title: The Future of AI with Bret Taylor, Winston Weinberg, Garrett Lord and Aaron Holmes Air Date: August 20, 2025 Host: Akash Pasricha Guests:

  • Bret Taylor, CEO and Co-Founder at Sierra
  • Winston Weinberg, CEO and Co-Founder of Harvey
  • Garrett Lord, CEO of Handshake
  • Aaron Holmes, from The Information

This episode dives into the evolving landscape of AI, focusing on the role of AI agents in various industries, the future of work, and the rising costs associated with AI model deployment.

Key Discussions

AI Agencies and Market Evolution

  • AI Tools and Business Demand:
  • Companies are increasingly investing in AI agents for customer service and legal sectors.
  • The discussion highlights a shift from "best of platform" to "best of breed" solutions, where specific products outperform integrated solutions due to superior impact on business efficiency.
  • Market Dynamics:
  • Bret Taylor notes the excitement and high demand in the AI sector, paralleling it to the dot-com bubble.
  • The focus is on delivering impactful solutions that drive cost savings and revenue, questioning how companies differentiate their products in a crowded market.

Insights from Founders

  • Bret Taylor (Sierra):
  • Discusses the need for companies to demonstrate ROI from AI investments.
  • Emphasizes that successful companies will emerge based on delivering tangible results and building customer success over time.
  • Winston Weinberg (Harvey):
  • Describes the challenges of selling AI solutions to the traditionally risk-averse legal industry.
  • Highlights how the ROI narrative differs between in-house corporate legal teams and law firms.

Future of Work in AI

  • Garrett Lord (Handshake):
  • Explains Handshake's evolution from a job-seeking platform to a marketplace for skilled professionals who can provide insights and data to improve AI models.
  • Predicts a shift towards contract-based work and the need for professionals to adapt to a tech-enabled job environment.

The Rising Cost of AI Models

  • Aaron Holmes (The Information):
  • Discusses the increasing costs associated with deploying AI models, even as computational efficiency improves.
  • Identifies a potential oligopoly in the market where leading AI companies may not feel pressured to lower prices due to high demand.
  • Market Players:
  • OpenAI and Anthropic benefit from the sustained demand for their models despite stagnant pricing.
  • Cloud service providers are also profiting as the demand for AI processing increases.

Key Takeaways

  • Importance of ROI: Demonstrating return on investment is crucial as businesses invest in AI technologies.
  • Evolving Role of Workers: Job descriptions and recruitment processes will dramatically change in the AI era, with a clear shift towards skills in technology and adaptability.
  • Cost Dynamics: The cost structure for AI services is becoming increasingly complex, with rising operational costs potentially leading to market consolidation.
  • Future of AI Agents: The competition in the AI sector is set to intensify as companies pivot to providing specialized, scalable solutions that meet specific business needs.

Concluding Thoughts The episode provides a comprehensive overview of the current state and future trajectory of AI technologies, emphasizing the transformative effects they are having on various industries. As the landscape continues to evolve, the importance of cost management, ROI, and adaptability in the workforce will be critical factors for success.

Written by AI. May contain mistakes. Listen to the episode to check what was said.

Hear the part that matters, and keep it.Open this episode in VO. Double tap your headphones to save a moment as you listen.
Get VO free

Transcript

Automatic transcript. May contain errors.

0:13Welcome, everyone, to the Informations TI TV. My name is Akash Pasricha. It is Wednesday, August 20th, and we have got a powerhouse lineup of guests for you today. Brett Taylor from Sierra and Winston Weinberg from Harvey are coming on the stream in just a few minutes for a very special conversation about what AI agents can actually do. We've then got Garrett Lord, the CEO of Handshake, who is going to come on to talk to us about the future of work in the era of AI. And last but not least, we're going to get to a great story that we just published this morning about how customers of AI models are feeling the squeeze again while companies that sell those models are soaring.

0:52Before we get going, I want to highlight a big story that we published this morning in the information. The information is first to report that Character AI has talked in recent weeks to bankers about a potential outright sale of the company. You might recall Character's founders were hired by Google as part of a$2.7 billion deal about a year ago. There, of course, was a company full of employees that remained. That is what this sale would be about. I should say the company is also talking about possibly raising a few hundred million dollars at a valuation of about$1 billion. And so we will see how this story unfolds.

1:28Okay, on to our first guest. We've talked a lot on this show about AI agents and the hype cycle that space is currently in. Businesses are pouring money into these tools, hunting for ROI, and hoping not to be left on the sidelines. Today, we have a special interview with the founders of two of the most closely watched agent startups. Brett Taylor is the co-founder and CEO of Sierra. You may also know him from his role as chairman of the board of directors of OpenAI. And Winston Weinberg is the co-founder and CEO of Harvey. They're going to be sitting down with our editor-in-chief, Jessica Lesson, to discuss the state of their businesses and the state of the AI agent's market.

2:07Jessica, over to you. Thank you, Akash. Brent and Winston, it's great to be here with you. And I'm going to pose a challenge. I'm going to say, let's try to say agentic the least number of times. It's too early for a drinking game, but we could have a coffee game. But no, I'm just kidding. I'm so excited to be on with both of you because you are two of the leaders of the most closely watched startups for actually having products with traction, a clear focus in the AI space. At the same time, there are so many big questions swirling around about how businesses seize this moment and what's really sustainable.

2:50So, Brett, maybe starting with you, you more than probably anyone I know in the Valley have really straddled the big company and small company world. You know both sides well. In your new perch at Sierra, as you're going out to Fortune 500 companies and convincing them to use your customer service platform to build their own agents, what's working? What are you hearing in the marketplace and how are you getting traction over the last even couple weeks? Yeah, it's a really fun time in the market. I've never seen anything quite like it. I was in college during the dot-com bubble, but I think it sort of has echoes of that to me where everyone knows how impactful this technology can be.

3:34I think where Winston and I are working in customer service and the legal profession, if you talk to an economist and you ask them, where will AI have an impact, that would be at least in the top two, three, along software engineering, probably. And so we're in this area where I would say demand is not an issue. I think everyone knows that this will have an impact on their business. And the question is, why your product? Why your platform? And you talked about big company and small. There's this kind of adage in enterprise software, best of breed or best of platform. You know, best of platform means, hey, I've already got an enterprise license agreement with one of the big enterprise software players.

4:11I'll just buy it from them. You know, it's easy procurement wise. You probably get a discount because you're buying a bunch of other stuff from them. And then there's best of breed and it's saying, hey, I want the best solution in this space. We are definitely in a world where best of breed is winning. And the reason for that is the cost of the software is actually relatively modest relative to the business impact, both cost savings and revenue impact that these agents will drive. If you think about you run a really large call center, if you can remove 75 % of those calls versus 50%, the business impact there is so much greater than the licensing costs.

4:48You really want the product to work. If you're thinking about an agent for sales, which is one of the things we also work on, if you can make more sales that's so valuable, the marginal cost of that software is actually not something you fixate on. And as a consequence, I think you're seeing the surge of startups right now just because our products are better, you know, candidly and they work better. And that's what matters right now. But if you fast forward, you know, the way this works, it's like a pendulum, right? And so you'll start to see market leaders come out. I believe Harvey and Cyr will be two of those.

5:19And then you'll start to see some consolidation. So I think we're sort of in the pendulum swinging towards best of breed because our products work. and right now impact is what matters as the market really matures and products working is no longer differentiated as it is really now i mean there's so much snake oil out there right now to be honest with you then you start to swing back towards platforms and the race for uh winston and uh me is we need to become those standard platforms as the pendulum starts swinging back you know and i think that's just the the evolution of the software industry and so i want to sort of same question coming at you, Winston.

5:54But Brett, do you mean when the platform swings, you want to be the consolidator? Or are you saying you envision that Sierra will be consolidated? Yeah, absolutely. We want to be consolidating. You know, that's the thing is, I think you look back at the birth of the web browser when I mentioned being in college in the dot-com bubble, the new companies then, Amazon, Google, PayPal, are now the incumbents today. And I think that when you saw the mobile phone come out, you know, you had Uber and WhatsApp and DoorDash, all starting around that era. And so I think the opportunity right now for entrepreneurs is this market shift driven by technology and driven by large language models changes the power dynamic between incumbents and insurgents.

6:36And that's really exciting for us. And the question is, can you become the next incumbent, which means driving more customer success? And we're powering hundreds of millions of phone calls and chats this year for everyone from ADT, home security to ramp. and it's very exciting, but we need to earn that, right? And I guess let's put this way, AltaVista didn't get to write the history books, Google did. And so, you know, it's, and being a first mover matters, being great for a sustained period of time is actually what matters here, and it has to start with the quality of the product. So, well, I think both Harvey and Sarah are leaders in their respective markets, where really matters are, you know, pace of innovation over the next five years and 10 years.

7:16And I think that's really what's going to determine who has the privilege of becoming incumbents a decade from now. Yeah. Well, to you, Winston, I mean, I don't think of the legal profession as the most tech-forward industry out there. Come on, Jessica. You know, very risk-averse, very, you know, all of those things. I mean, obviously, Harvey has made a splash. How have you done it? And how are you making, I mean, to Brett's point about the ROI case, which I think may be a little fuzzier still than he lets on for businesses, But how are you making that to the biggest law firms in the country? Yeah, so I would say that the ROI story is definitely different for law firms versus in-house.

7:55So for in-house or kind of like large corporates, it's a little bit more obvious, right? Because a lot of the efficiency gains they can make, you can compare that against things that they might be paying alternative legal service providers to do or kind of like smaller law firms in different countries. So I think the ROI makes a lot more sense there, especially if you're building a workflow that does something specific from start to finish. So like my best example here is it's a little bit harder to do an ROI for like a general purpose or even a vertical purpose assistant in legal. It's a lot easier if you're building a system that does like merger control guidance, right?

8:29Like something that is very specific. You can just see how much this costs versus human labor or versus, you know, a lawyer doing this in the loop. For law firms, I think they're also starting to think about this a lot. Like because of the billable hour, right, like efficiency gains don't make as much sense. But if you think about what kind of a problem, yeah, it's a huge problem. But if you actually think about what a lot of law firms want, they actually want like a better leverage model. Right. And so like a lot of it is like profits per equity partner. Right. And so what they're if you can do more work with actually like less on the bottom of the pyramid, that's good.

9:05And I would argue that that's actually good for the junior associates, too, because the reality is like most tasks in legal are not fun to do. Right. And if you ask junior associates, most of them are in the profession because they want to basically go through 10 years of doing these rote and mundane tasks because they really like what the partners do. Or they really like what the – they want to go to trial. They want to advise clients on deals. They want to be in the boardroom. And so it's actually an easier sell than you think because from the top, it's, okay, we have to do this, and maybe we're going to redesign how we basically manage our services, how we price things from the partners.

9:43And from the bottom, it's, oh, wait, you're telling me that I only have to do the boring part of this job in five years for only one year when it used to be that I had to do that for 10 years and slog it out until I get to do what I want. Yeah, it's a good pitch. Where would you say like the industry is, I mean, in this transition or like what what things are starting to tip now that maybe you weren't seeing six months ago in terms of adoption? Yeah, I would say it changes every three months almost. And I think like in early 2023, it was, should we adopt anything at all? Like, what should we do?

10:18There was a lot of self build as well for law firms. And then in 2024, and again, it's like shifted every like three months, every quarter, basically. In 2024, it was a lot more, okay, we have to do something, but should we self build? Should we buy a, you know, buy a platform, a vendor, and then do a combination? And now it's becoming, okay, wait, I think we have to change our entire business model, right? A lot of the calls that I get on are a combination of products plus change management. In other words, these are the things, like we have tons of market data. We work with a bunch of private equity firms, and we have all of this market data that is incredibly valuable.

10:54Is there a better way for us to actually productionize that? And so I think law firms more and more are starting to think about this as, how do we become tech-enabled services? But that can be all over the place. It can be for the lower end work that they do at a loss to get like the big LBO or the big merger. Or it could be, yeah, we're, you know, a firm in a different country and we're competing against the giant, you know, international firms. Is there a way that we could actually design how we do M &A differently with technology to compete with them at scale? Yeah, that's fascinating. So much.

11:30Really a rethink from the bottom up. Yeah. Yeah. I'm curious for both of you, sort of what's happening to your own costs. I mean, I think this is why, I mean, AI is such a tremendous technology to cover because we're seeing the demand. We're seeing the revenue come far faster than certainly other cycles and tests. But so are the costs. Right now, you guys do not develop your own models, I believe, but maybe to you, Brett, first, and then Winston, how are you thinking about, from a product perspective, how to make sure that costs can kind of, you know, maybe over time stay in line with the revenue opportunity and how do models fit into that for you?

12:09Yeah, I think most applied AI companies, and Winston and I have talked a little bit about this, probably shouldn't be building their own models. You know, the pre-training costs of a model, you know, to actually recoup that, given how quickly they depreciate in value, just really requires just huge scale. And as a consequence, I think we'll have a modest number of very, very high-scale players with very big distribution channels like ChatGPT, where you can sort of essentially amortize the cost of that training. And it's why you've seen, I think, in the intro companies like Character and others, like it's hard to sustain a business if you have such high initial costs.

12:49Within the applied AI market, it's actually better and easier. And I, well, I won't tell you our gross margins. They're quite good. You can. They're the interest. And it's because you're not selling AI. You're selling a mergers and acquisitions product in Winston's case, or for ours, you're saying, hey, we can answer your 1-800 number for 1-100th of the cost with twice the CSAT. And you're providing business value, whether that's originating a mortgage or explaining the benefits for a health insurance company or simple stuff like providing technical support for a Sonos speaker or Abyssal vacuum cleaner.

13:32and that is something that you value independent of token costs and i think this is a little bit the way i think about the market playing out as you have the frontier and foundation model companies and they're going to look like i think the infrastructure as a service market where it's really high scale revenue margins will always be a question differentiation will always be a question and just like in infrastructure service there is differentiation there is in the models as well it's just subtle and constantly changing like oh this model is better for coding and this model's better for that. And, oh, these are really great voice models.

14:03It's a competitive market. I think the agent companies will end up like the software as a service market, where it's primarily bought by business teams, not just technology teams. It's valued according to a business outcome, not according to utilization. You don't buy SaaS based on how many CPU cycles it uses in the database, right? It's just not the way you think about it. And I think that Harvey and Sear are selling a solution to a problem, not selling AI. And it turns out that these problems were unsolvable with digital technology before AI. So that's the reason we can exist. But how we talk about our value problems, you talked about Winston transforming the shape of a law firm.

14:45You know, we're transforming the shape of customer engagement. And just to make it like numerical, typically, if you call like a cable company on the phone, it probably will cost them like$20 to$30, depending on how long you end up on the phone. Most customers aren't worth$20 to$30, and most interactions certainly aren't worth$20 to$30, which is why it's impossible to talk to companies. There's entire websites devoted to finding people's phone numbers. You bring that to$0.20 or$0.30 over time,$0.20 to$0.03. All of a sudden, it changes the game. You can just have more conversations with your customers, and it's going to go from treating these things as a cost center to actually, hey, I can have personalized, multilingual, one-to-one conversations with every single one of my customers.

15:28And you look at the market, like say the mobile market where everyone's fighting for a fixed number of customers, mobile phone plans, the smart companies are going to take advantage of this like step change and say, how can I improve retention, lifetime value, grow subscribers, all these things. And so what we're actually selling is just much deeper than AI. And I like that abstraction layer. And I think it's why I'm so bullish on the applied AI market and the agent market broadly is because I think this is how most companies want to buy technology. Like tokens have no bearing on your business, but your cost of your customer experience, the cost of your legal department, the success of that merger certainly do.

16:08And that's fundamentally what we're selling. I would also even say that, oh God. No, go ahead, Winston. I was going to say, other than efficiency too, if you think about a lot of these tasks, and I think I've seen companies like Brett and us and other companies too, a lot of this pitch is beyond efficiency. So if you think about like a merger, like most reasons deals die is because of speed problems, right? They get like massively delayed. And so my point is that a lot of the value that you're going to start providing is actually not just how much did this cost before and versus, you know, and now it's X divided by three or whatever, but it's actually, oh, there's a higher chance that this actually goes through, right?

16:45Or if you're pre-processing a bunch of documents for like an internal investigation, that makes it so that the outcome of that internal investigation, you probably have a better sense of like what happened at the company. And so my point is, I think that in the next couple of years, we'll see a lot more than just efficiency arguments. We'll say, oh, wait, this actually had like a lot of business impact that had nothing to do with cost savings. You also, though, need, it sounds like you're both banking on the fact there'll be enough competition on the foundation model layer that those prices aren't going to go through the roof?

17:14I mean, is that because all of those companies, as you know, Brett, face incredible pressure to make their lines cross as well. But is it just you think that there'll be enough options out there that that's not something that will become a major challenge for this agent software layer? I do. I also think there's not one foundation model that people should use. I think they're becoming more purpose-built. It's a little bit like almost like the data storage market. You have transactional databases, you have columnar data stores for analytics, you have things like S3 and open source. And almost every one of those has an open source competitor and a proprietary one.

17:52We're seeing very similar things. We probably do on the order of 20 inference calls for every message or sentence you say to one of our agents, which surprises most people. Not all of it is rocket science. It's not all GPT-5 high reasoning mode. It's really simple things like, oh, is that a television in the background or is that you speaking? Or you're on the side of the road for a roadside assistance case and there's a car horn. Was that someone interrupting the agent or should I keep talking? And you don't need AGI to determine that it's a car horn. And I think that's how the model matures.

18:34I really think for an applied AI company, not open AI, for an applied AI company, these are reusable pieces of infrastructure and you'll do a price performance quality analysis on what's right for the task. And I think a great sort of full stack applied AI company will be really good at absorbing these new models as they come out, picking the right purpose built model for the task. And to some degree, part of the reason I don't think training or certainly pre-training models, fine tuning, I think may also weigh in an importance over time. that's a whole different conversation but you know i think that you know you really you should like take advantage of the wave of the market of this investment these foundation models and it won't always just be the frontier it might be sort of this boring important task where you can use a really low parameter account model that's fast and cheap and that's great and that's how you're going to sort of build the supply chain of technology to make these agents shine okay i want to zoom out a bit, but first on pricing, Brett, I think you've talked a little bit about maybe pay per outcome or usage pricing.

19:36And it actually reminded me of Quip if we go way back when. But I feel like before you were at Salesforce in the Quip software land, this was a model you were also thinking about. But talk a bit about how pricing might evolve in the space. So at Cira, we charge our customers when the agent autonomously completes the task, whether that's making the sale, solving the customer's customer service problem, of we have to transfer to a person that's free. And we do that because it really aligns our interests with our customers. It's a great way to consume the software. I'm excited about it broadly. I think this is where the industry will go.

20:08If you look at, you know, 1998 to 02 when the sort of cloud market emerged, you had the emergence of, hey, you can run this software in the browser and you had software as a service where, you know, you subscribed to it rather than paying it for a perpetual license. Those two went hand in hand because they sort of had to, you know, So if you're running, everyone has the same version of the software in the browser, how do you pay for innovation? So you need a different model than buying Windows 98 and then Windows 2000. You had to say, okay, let's just change the model. But it also really aligned software vendors with customers because you could stop subscribing to it.

20:45So it created this sense. That's where customer success, the profession was created by, I think, Salesforce. But, you know, you ended up sort of changing in a really structural way the relationship between vendors and companies. I think with agents, because software isn't just a productivity boost anymore, it actually can complete a task. You know, for tasks like sales, you pay people on commission because when you can actually measure the impact of a task, the best way to align incentives is to pay for that job well done. And I think we're in a position with customer experience where you kind of know that it was a job well done.

21:20Did you solve the problem? Did you make the sale? And so we just love charging for that. And I think it will disrupt the industry, but really, really good for companies. Because just imagine the return. You talked about ROI. It's so easy with Sierra to know you're going to do an ROI because you only pay us when we give you a return on your investment. And I think that is the right way to charge for agents if you can. You know, not all agents have quite so measurable of outcomes as we have, and we're just in an industry where it works really well. So I want to ask you both. I think there's been a lot of talk now, okay, we're going to have all these agents.

21:54They're going to need to interoperate somehow. They might need access to things stored in other places to do that. We've seen companies like Salesforce and others try and, you know, just kind of also for platforms, you can't have agents pinging you all day long either. So there's a real tension, I think, in how, if we fast forward, what this software layer will look like. I'm curious for either of you how you sort of think about that. And are there analogies like the app economy, like something else that can help people kind of grok what a very agent-heavy future looks like? Yeah, I think like you can think about a lot of these agentic systems as what is the type of tasks that they're trying to solve.

22:42And then if you have like a layered task, you're just combining tons of them together. Right. And so my point here is, if you have a task like a merger and acquisition, right, that is going to have all of these different agents that are doing different types of research, different types of diligence. They're looking at, you know, some web browsing, different types of external data, internal data, et cetera. But then you're also going to have probably a bunch of agents that are coming in there that are investment banking related, right? Like if you think about some of these very large tasks. PR agents, imagine that.

23:15Yeah, it's across all these domains, right? Yeah, you're going to be inundated. But my point is, does that end up being a bunch of different companies or do the companies that solve one portion of this or like one vertical, or is it easier for them to tap on agents that solve the other parts of the vertical? And I think that's the question. And that's, to me, like where this ends up is that for the very simple tasks, maybe you'll just have one, but for the really complex things that are more like project-based or like if you take a group of humans to do the task today, right? And they're from different verticals, who owns that?

23:51Is it a bunch of different companies that own each vertical or is it actually one company that somehow figures out how to get into multiple? And doesn't that advantage the big guys? And maybe Brett, back to you. I mean, you've worked at Google. You've worked at Salesforce, right? To be the Google, not the AltaVista, right? To be the platform, not the, I forgot what your other analogy was. But like, how do you, and yes, it's having a great product, but can you unpack that a little bit of like, how are you going up against the Googles and the Salesforce's today? And in a way that, you know, you think the gap will widen five, 10 years from now.

24:28Yeah, it's hard to predict, to be honest with you, even as someone, as you joked, I'm probably as much in the middle of this as anyone. It's really hard to predict the future of the software industry. I mean, broadly, thanks to coding agents, just the cost of making software is going down. And I think if you just project forward, the marginal cost of new software will go down by a lot. we haven't really experienced a world where there hasn't been a scarcity of skilled software developers and we will. And I just don't know what that means to our industry as a whole. Similarly, you know, you've always had these sort of core systems of record like ERP systems at companies and they are both databases, but also a bunch of web-based software that are like workflows on top.

25:12And a lot of people think, okay, agents will be doing a lot of those workflows. So what does that mean for the company? How much of their value is in the database? How much was in the workflow? And you'll end up with a sort of natural tension of people trying to, you know, hold on to the value that they had. Plus, you know, companies, you know, fundamentally, I think it's not any company's data. It's like not any software company's data. It's your client's data, right? So I think that's a non-issue. I don't think we as companies have any rights to this data. It's our customers. But I think how it plays out, like what's more important, sort of the agents running on top or the systems that are interacting with it.

Read the full transcript

25:56And I think the way it's going to play out is everyone who is sort of a system of record today will be fighting to make agents. All the agents will be sort of coming from the other direction. I don't think it's a foregone conclusion. I think it really comes down to leadership and execution. If you look at how many of the companies that existed prior to the cloud made the transition successfully, some did. Microsoft and Adobe did a very good job. There are others like Siebel Systems that did not. And so I don't think there's maybe a first principles reason why for any of these incumbents they can't succeed here.

26:27But it'll require business model changes. It might require other things. And then you'll have new entrants like Harvey and Sierra making the case for, you know, why, you know, we should be sort of the gravitational center of that new world. But I think it all comes down to really driving success for customers at scale for a sustained period of time. And, you know, I think you could end up the reason I brought up sort of AltaVista and Google, for those of you as old as me, AltaVista was there first, you know, and they didn't capitalize on that. And Google made, you know, better mousetrap and then ended up with a better business model as well, especially relative to companies like InktoMe and others.

27:04So you end up where, you know, I think we're in the early innings, you know, candidly. And I think, you know, we have the privilege of sitting here with you, you know, five or 10 years from now and being leaders. It will be because, as Winston said, every three months the market changes. Did we react to those changes with intelligence and good judgment? did we continue to drive so much success that when companies say, who am I going to build my IT strategy around? It starts with us and not, you know, one of the existing enterprise license agreements. And we have to earn that candidly. But if you look at the history of technology, as I mentioned, when the web browser came out and the mobile phone came out, new, sustained, durable companies came out as well.

27:45And so I think it's inevitable. I hope, and I believe, because I like Woodside a lot, we will be two of those companies, but we have to earn it. I think there will be a number of them. I think that these technology waves essentially sort of fertilize the ground of Silicon Valley for new companies to grow. And I think it's a really exciting time to be a part of it. And so before we wrap to just zooming out even further, I mean, there's been some discussion lately just about the pace of AI breakthroughs sort of big picture. You know, the models are getting better. Obviously, we're at the beginning of the business adoption curve.

28:20GPT-5 had some fans, some muted reactions as well. Brett and Winston, like, where do you, are we, when it just comes to AI and superintelligence and AGI, like, are we starting to see slowing gains at that level? Or how do you see sort of the technology breakthrough piece of this revolution progressing? Yeah, I guess my one answer to this is actually a lot of the problem here is just how do you get all of the correct context into like an environment or whatever it is to the model, right, or to the agentic system. And so you basically have like, how do you get all the context there, which a lot is a product problem.

29:03And then how do you get the right answer? And that's more the AI problem once you have all the correct context. I actually think the AI problem for way more use cases is actually solved. In other words, like the IQ, like the raw IQ reasoning ability of these models is already 10 times, 100 times what the current penetration is in that vertical, right? So like specifically for legal, the reasoning ability is already there. The problem is you have like 500 different sources of context for each problem, right? And how do you make sure that the models are one have access to that context, but two are actually using that context in the correct order.

29:39And a lot of this isn't like a reasoning problem. It's there is a certain way that a private equity firm does an LBO, right? And, you know, for them, maybe it's reason. But for some folks, right, it's not like randomly the models learn how to do this. This is a certain way that they do it. And so my point here is, I think we will see way more breakthroughs. It wouldn't actually matter. Like either way, there's just so much more that you can develop in these verticals than we have so far. And the blocker isn't the reasoning ability of the models. Brett, what do you think? Is GPT's IQ plateauing?

30:13I'm very optimistic on AGI progress. I actually think one thing Winston said, which is actually really subtle and important, is I think we may see a trend. Let's just say you share my optimism about AGI progress. We will get to the point where the previous generation of model was sufficient for a task. I planned my vacation to Europe this summer on ChatGPT. I'm not sure how much more intelligence would have helped. I had a great vacation, no edits, and so I don't think I need more AGI. But do you know what the super intelligence... No, okay. Yeah, who knows? I mean, maybe it would have been better.

30:48I don't know. But if you talk to someone like one of our software engineers and the coding agents, gosh, we could use a lot more intelligence there. And the difference between Cursor a year ago and Cursor's agent, Cloud Code, Codex today is meaningful, very meaningful and gbt5 in particular for coding is much better than the models that preceded it so i think that you know i really viewed as like as these models become increasingly super intelligent in some domains not everything you do actually impacts those and i think you know a lot of the folks i talked to didn't like gbt5 and we certainly could have done that raw better it was like tone and personality and a lot of things that aren't necessarily correlated with intelligence.

31:30It doesn't mean, by the way, we shouldn't approve it. And so I think that this goes back to the discussion about lots of different models. I think first, we're learning people develop different, I'd say, relationships with these models and things like tone do matter a lot. Second, if we start working on a model that can find discoveries and math that may not impact a lot of industries, like as Winston said, it might not impact his leveraged buyout product for private equity, which sounds fascinating. So, you know, we might reach sufficient intelligence for different domains at different times.

32:05And I think these labs, you know, particularly opening on Anthropic, they're mission driven, right? So like, we're not done to what the finish line, you know, and that finish line doesn't matter to every industrial application equally or every personal interaction equally. I mean, I think that's normal and healthy. And I think that's why, you know, Reid Hoffman talked about the frontier versus foundation model. I really liked that distinction. because we don't need to be at the frontier for everything.

32:34Well, we are at time, gentlemen, but thank you. We can go on and on, and I hope we get the chance to because you both are in really interesting positions, and I think there's a lot of ways this trend can go, and you guys have a front row seat. So thanks very much for being on TITV, and back to you, Akash. That was Brett Taylor from Sierra and Winston Weinberg from Harvey with our editor-in-chief, Jessica Lesson. Okay, you've probably heard all the different ways in which AI is changing how people work, and it is also changing the roles that tech companies need to hire for. Handshake is a company that has seen this change firsthand.

33:14The company has long been a place where many businesses have gone to find highly skilled and advanced employees for contract work. And in the era of AI, that work is becoming all the more important And so I want to bring on CEO Garrett Lord to talk about what's happening with his business. Garrett, welcome to TITV. It's great to have you. Thanks for having me this morning. So Handshake has been around for a long time. And I want you to very quickly just tell me about what the company traditionally has been and then really what it's becoming in the AI era. Yeah, fantastic. So, I mean, the company started 10 years ago.

33:49It's the leading place that young professionals in America find jobs. There's 18 million students and young alumni across most domains, basically every domain of academia in America. There's a million employers that recruit on the network, and there's about 1 ,600 universities and community colleges that use the platform. And about 18 months ago, we started to see this massive influx in demand from a lot of the large frontier labs and AI players trying to find and recruit experts. experts, specifically experts that were more sophisticated in their unique area of domain than the actual models themselves.

34:25So think finance, law, medicine, physics, biology, chemistry. Many of these people at the frontier at a master's or PhD level can actually go in and use these frontier models and spot issues and spot areas that they want the models to be better. And so the core of our business is really reoriented around helping people not only start and jumpstart careers, but also monetize these skills in new ways, which is this kind of evolving economy of you have a skill and there's a market clearing price for that skill of which people can make$100,$200 an hour to come in and create data that helps improve frontier models.

35:05Well, that's a good distinction because when I thought about handshake and AI era, what I thought it was becoming was more in a way for some of these AI companies to find technical talent. And by that, I mean coding talent, engineers, researchers, stuff like that. What I hear you saying is maybe there might be that talent, but it's more so people, like you said, in life sciences, people who might not be able to code, but they have PhDs in biology or something like that. Yeah, totally. I mean, take biology, for example. Many of the labs, or take educational design. Many of the labs are really focused on core capability areas.

35:40You see players trying to really be the forefront model for coding, some models being the forefront model for education. In these areas at the frontier, the models are still, you know, they want them to be better. And so what it looks like on our marketplace is like experts, PhDs and master's students or actual real professionals in the workplace coming into Handshake, basically, you know, kind of getting certified, getting curated, and then actually participating in environments where they're being asked questions and they're actually writing answers or interacting with multimodal videos or images and actually like breaking the model and correcting the model with the correct answers.

36:19And so I think over the next, you know, real decade, what we'll see is a very radical evolution in what it means to actually like find a job on the internet, right? Like there'll be full-time W2 employment, but many companies are actually focused more and more on finding contractors as kind of gig work evolves and companies are, you know, leveraging more of these AI tools. Handshake wants to be the place where people not only find and, you know, start and jumpstart their career, but also monetize their skills in a part-time contract relationship, or actually what's quite additive is kind of augmenting that with ways to monetize your skills from like a human data perspective.

36:55So you might be able to come in for 5, 10, 15 hours if you're a really great accountant and actually produce data that is improving models of the future. Help those customers. So I want to talk about where this is all going, but give us a picture. I mean, what kind of AI companies are you working with right now that are finding talent on your platform? We're working with most of the frontier models, working with seven of the frontier models, of which you probably know most of the names. Okay. So these are big AI companies that names that we know. Okay. Got it. So, you know, what I want to ask you is you're working with these companies, you're seeing the types of talent that they are looking for.

37:30Like you mentioned, some of them are not necessarily what we might think of as technical talent on a coding side. It's a much bigger basket. But broadly speaking, we take a step back. I mean, how do you see hiring changing in this era of AI looking ahead two to three years? Yeah. Well, I mean, I don't think the job role of being a recruiter will exist 10 years from now. Okay. So recruiters are gone. Yeah, I think recruiters will be repositioned as folks that are like curating communities and trying to make it a great experience. But I mean, just like take, I was just talking to a young professional in New York, one of my cousins, and she wants to find a job in tech.

38:10She doesn't, she wants to work in AI. She wants to make more than$300 ,000 a year. Like the classic experience would have been you went on Indeed and like bulk applied to like each one of the jobs, right? The job search in the future is like you have an agent, you're talking to that agent. I want to work in a mission-driven company. I want to be in an office. I want to work in enterprise sales. I don't want to work in productivity. I really want to work in AI. And an AI agent's actually curating each week, each day opportunities for you. It's customizing your resume. It's customizing your cover letter.

38:40But I think that's only just like step one. Step two is the hiring manager on the opposite side is talking to an agent. And the hiring manager is describing what an ideal employee looks like. And I think there'll be a whole kind of AI matching layer built in a job search engine of the future that really unlocks human potential because the current process is so intimidating and frustrating and time intensive that you almost have like a personal coach that guides you through this process of navigating your career. So I hear you on the recruiting side. More what I'm curious about is how does the role of the engineer or the product manager look different three years from now in the era of AI?

39:20How do these job descriptions change? Yeah, well, I think you can just like bolt on an iron man to most roles, right? Like 10 years ago, you, whatever, maybe 15 years ago, you added like Google search as like a skill on your resume, right? And people that knew how to use Google search like significantly outperformed their peers and navigating information and getting jobs done. I think LOMs and AI is like, you know, a factor of 100 more effective than Google search in terms of the productivity it adds to each knowledge worker. But we're seeing, I think, young people really benefit from this wave.

39:52These students and young professionals are AI native. They're using it every single day in their classroom. We just had an intern that put up a pull request and it's like first day on the job, right? So I think across every job role, many jobs will get displaced. Obviously, many jobs will no longer be relevant in the future. But as in every kind of prior paradigm shift, like people will evolve. And I think young tech native employees will be the ones that are putting up most of the points in the enterprise. But before I let you go, I want to get tactical here. I mean, you know, you see all these job postings on your platform.

40:26You have hundreds of thousands, millions of them, I imagine, on the platform. What are a couple of the roles that you have seen on your platform and the job descriptions that you've read that you've really thought to yourself, wow, this is an AI 2025 job. Tell us about some of the titles and descriptions that you've seen that really just couldn't have existed six months ago. Well, yeah, I mean, I think an amazing example, which so many PhDs and master students love, is if you're a PhD, you can make like$22 an hour teaching like the chemistry class for the fifth time over again in your fourth year of your PhD.

41:01and fast forward like on Handshake in our Handshake app product, you can join and be a Moo fellow and no longer teach the chemistry class and make$150 an hour in your area of research, actually breaking the model and providing the right answer. So this is an example where you can work 10 hours a week, make$200 an hour, you know, mixing your actual research, continue working on your PhD and your dissertation, but actually monetize your skills in a way that doesn't look like driving DoorDash, doesn't look like driving Uber. So you're using the model and then you get the answer back and you basically correct it and say, oh, this is wrong.

41:36Yeah, and you're in a community with your fellow PhD peers and you're taking those learnings and actually leveraging more AI tools in your research. So we're seeing there's this, you know, the job search engine in the future, I think, will really marry full-time job search, this whole class of knowledge worker contract work, which looks very different than Uber and DoorDash. monetizing your skills in a part-time fashion in human data as the AI labs are chasing agentic trajectories and tool use data. And then I think there'll also be a huge pillar of like tens of millions of people in America that will need to be upskilled and reskilled to learn these tools to be successful at the frontier.

42:10Got it. Okay. Well, my takeaway is more people need to get PhDs. That's what we're looking at here. So, all right, Garrett. Well, thank you for coming on the show. I appreciate it. I'm excited to see how this evolves. And I know you guys have some interesting developments in the pipeline about how you're scaling the business. So I look forward to having you on more as this story shakes out. That is Garrett Lord, the CEO of Handshake. Okay. Well, we've known for a while that AI is expensive. Many have waited for a long time for things to get cheaper, but the information published a story this morning that found that the cost of buying AI is actually creeping up.

42:47And for more on that story, I want to bring on Aaron Holmes. Aaron, welcome back to the show. It's great to have you. Thank you for having me. So tell me about what got you interested in this story. What got your spidey senses tingling that the costs might be going up here? Yeah, so I think I originally started hearing about this in the last couple of weeks from folks who are using AI coding tools, who basically consume AI models more than anyone else. And a lot of the users of these tools were noticing that the pricing models were changing, and they were suddenly having to pay a lot more to use tools like Cursor and Replit.

43:22And, you know, we also started to hear from the CEOs of those companies that, you know, they were feeling the pressure of essentially people taking up more tokens from AI models, but the cost of the actual tokens themselves essentially plateauing in the past six months. And, you know, the information, my colleague Sri Mopiti has done some good reporting on how the margins of those companies were starting to feel the pressure. So basically all of these people were starting to cry out in pain at the cost of AI. And that seems surprising given we keep hearing that the price of AI tokens is supposed to go to zero sometime soon.

43:59So that's why I started to dig into this. Okay, so you hear about these margins, you hear about these stories. And so you go and you research the report out what's actually happened to these companies. What did you find? Yeah, so essentially there's two things happening. You know, one is that for the state-of-the-art cutting-edge models that you get from OpenAI or Anthropic, you know, if you want to pay for the best of the best, the prices of those models have not really gone down significantly in the past six months or so. And then at the same time, you know, we're seeing an increase of tools like AI agents that rely on what's called reasoning, which essentially is just letting the AI models run for longer and longer to reach better answers.

44:40And as a result, you have this formula for consuming way more AI to do a specific task and therefore paying a lot more to the companies like OpenAI and Anthropic that are selling those models. And that's kind of what's driving this increase in spending among the companies building AI apps right now. Okay, so prices haven't come down in some of these companies. So I want to get into who the winners and losers here. The winners here I see are, I mean, you keep pricing high, that's good for the company selling the product. Are they the only winners here or who else is winning? Yeah, so I think presumably OpenAI and Anthropic are definitely reaping more revenue from people using more tokens through these reasoning applications.

45:23I think the other big winners are the cloud players. You know, the cost of compute itself has gotten more efficient. We heard, you know, Satya Nadella say that they can process 90 % more requests to an AI model on one GPU than they could a year ago. But the, you know, sticker price hasn't come down. So if you think about who's collecting the margin there, it's going to be the cloud providers. And I think that's shown up in the really strong earnings that Microsoft and some of these other cloud providers reported last month. And I just want to dig into the why here a little bit, because something you mentioned is that the cost of compute is coming down from what I understand.

46:02So, I mean, let's dig into the why. Why aren't the costs coming down then? If their input costs from compute are still declining, I would imagine that the model costs would come down, no? Yeah, I mean, there's not really one clear answer. And we actually saw Replit CEO Amjad Massad sort of speculate last week that there might be, you know, pricing collusion between OpenAI and Anthropic or that we've reached an oligopoly where these companies don't have to compete. You know, I reached out to Anthropic and OpenAI for this story, and they, of course, would deny that they are, you know, colluding on price.

46:40But what OpenAI has said is that, you know, number one, they're facing really high demand from customers. And so even if they did reduce the price, it wouldn't really lead to increased usage of the models because they're essentially firing on all cylinders right now. at the same time, you know, Anthropic and OpenAI have said that the models themselves are getting better. So you're still getting more bang for your buck, even if the prices haven't gone down significantly. But it is just a really interesting moment where, you know, it's not exactly clear what is setting the price of these models on the provider side.

47:12So this is actually a big mystery then for a lot of these models. And we don't actually know how or why they're setting the prices where they are. I would have thought that maybe they would be trying to undercut each other in terms of price to gain market share, but it seems that's not actually happening. We don't know why. Yeah. And I mean, I think eventually you will see prices start to come down. Google is one company that kind of stands out because they are optimizing on cost a lot. But Google was a bit later to the game in terms of getting their newest models generally available to developers.

47:46So it will be interesting to see how these newer models change the landscape. shape. But for now, we've kind of reached this odd moment where prices have been mostly plateauing. Right. Well, look, Aaron, I'm really excited for all the further reporting that you're going to do on this because I have a feeling that some of the color here around why companies set the prices that they do, I would love a window into that calculus. So I'm not your editor, but I'm excited for when you do go do that story, what you find out. Thank you for coming on the show and telling us about it. That was Aaron Holmes, who covers enterprise software and Microsoft for the information.

48:21Well, that does it for today's show. A reminder that we are live on this stream Monday through Friday at 10 a.m. Pacific, 1 p.m. Eastern. I want to thank Amazon Web Services, who was our presenting sponsor for this production. And I want to thank you for tuning in. We really appreciate your viewership. I'm already excited for our next show tomorrow. And so until then, bye-bye for now.

48:46Thank you.

From the publisher

Bret Taylor, CEO and Co-Founder at Sierra, and Winston Weinberg, CEO and Co-Founder of Harvey, discuss the capabilities of AI agents and the evolving market with our founder and editor-in-chief Jessica Lessin. Garrett Lord, CEO of Handshake, shares insights on the future of work in the AI era. We also speak with Aaron Holmes from The Information, who uncovers why the cost of AI models is rising.

Articles discussed on this episode:

TITV airs on YouTube, X and LinkedIn at 10AM PT / 1PM ET. Or check us out wherever you get your podcasts.

Subscribe to The Information

Sign up for the AI Agenda newsletter


More from The Information's TITV

All 304 episodes
The Future of AI with Bret Taylor, Winston Weinberg, Garrett Lord and Aaron HolmesThe Information's TITV · 49 min
Listen in VO