In short
Podcast Summary: Why AI Will Create Abundance and Transform Customer Experience
Podcast Title
Training Data Description: Join hosts Sonya Huang and Doug Leone from Sequoia Capital as they discuss AI with prominent builders and researchers, exploring the evolving technologies and their implications for business and society.
---
Episode Title
Why AI Will Create Abundance and Transform Customer Experience: Cresta CEO Ping Wu Description: Ping Wu, CEO of Cresta and former head of Google's contact center business, shares insights on the future of contact centers, AI's dual approach to automation, and the importance of an abundance mindset.
Key Takeaways
- Contact Center Evolution:
- The contact center industry is evolving with technology, moving from traditional methods to incorporating AI.
- AI can enhance experiences by making interactions more personalized and continuous.
- AI's Impact and Human Role:
- Ping Wu advocates for a dual approach: automating tasks that are ready while aiding human agents.
- Full automation may not be possible; a blend of human and AI interaction is essential.
- Abundance Mindset:
- An abundance mindset allows for imagining new customer experiences and leveraging AI for better service.
- Examples include asynchronous interactions with applications, making customer communication more efficient.
- Technical Challenges:
- Deploying Contact Center AI at scale involves overcoming latency issues and orchestrating multiple models in real-time.
- The integration of AI into existing systems is complex and dependent on businesses' IT infrastructures.
- Customer Experience:
- AI enhances customer experience by analyzing interactions, identifying trends, and automating low-value tasks.
- Future developments may allow customers to engage more effectively through AI, such as conversing with applications directly.
---
Detailed Discussion Points
- Evolution of Contact Centers
- Historical context and current state of contact centers.
- Transition from human agents to AI-assisted models.
- Debating AI's Impact on Call Centers
- Ping Wu's perspective on automation's potential and limitations.
- Doug Leone's emphasis on the speed of adoption rather than the extent of automation.
- Challenges and Opportunities
- Overview of challenges faced in the contact center industry, including high agent turnover and customer dissatisfaction.
- Potential for AI to create opportunities by improving service efficiency and effectiveness.
- Technological Waves
- Discussion of historical technology advancements in contact centers.
- The role of language models (LLMs) and their transformative potential.
- AI vs Human Agents: The Future
- The ongoing necessity for human agents alongside AI capabilities.
- Perspectives on when customers may prefer AI agents.
- Role of Data in AI Automation
- Importance of data access and real-time analytics for effective AI deployment.
- Challenges in integrating AI with legacy systems.
- Building a Company in the AI Era
- Insights on leadership, management, and the necessity of speed in AI startups.
- Doug Leone shares wisdom on evaluating founder potential and the importance of product-first leadership.
- Market Cycles and Investment
- Discussion on whether the AI market is in a bubble.
- Insights into where value will accrue in the AI ecosystem, emphasizing the application layer.
- Cresta's Technical Stack
- Overview of the technology behind Cresta's AI solutions.
- Explanation of how multiple models are integrated to facilitate real-time conversation handling.
- Future Goals for Cresta
- Strategies for continuing product development and enhancing marketing efforts.
- Aiming for Cresta to become a household name in the AI space.
---
Conclusion The episode highlights the transformative potential of AI in contact centers through a balanced approach that incorporates both automation and human interaction. With an abundance mindset, businesses can reimagine customer experiences and drive efficiency, setting the stage for a significant shift in how organizations communicate with their customers.
---
*Note: The content of this podcast does not constitute investment advice or an offer to provide investment advisory services.*
Written by AI. May contain mistakes. Listen to the episode to check what was said.
Transcript
Automatic transcript. May contain errors.0:00Today, if you think about the business, they feel like multiple personalities to the customer. So in the sales phase, they call you very, very aggressively. And once you sign up and become a customer, you're dealing with entirely different personalities, right? And you're dealing with service departments. I feel like these are really disconnected, right? And I do feel like AI agents can make this entire experience a continuous, long-going conversation throughout the entire customer journey. And LIM is a perfect tool to do that. And that will really bring the level of personalization, the level of customer experience that wasn't possible before.
0:55Hi, and welcome to Training Data. Today, we're joined by Cresta CEO Ping Wu and Sequoia's Doug Leone, who sits on the Cresta board. Today's episode dives into the gnarly world of the contact center, a giant legacy industry filled with slow-moving incumbents that is responsible for driving the vast majority of company-customer conversations. Ping understands this world deeply, having first built Google's contact center business, before becoming product leader and then CEO of Cresta. ping joins us to talk about the different waves of technology that have hit the call center how he sees the future of customer experience evolving with llms towards an abundance future and why his playbook is to meet customers where they are blending human agent assist with autonomous digital agents doug leone also shares his perspectives from several decades of investing in company building and his hot takes on whether we're in an ai bubble he also shares where he believes the value will accrue in AI.
1:48Hint, it's in the application layer in this gnarly last mile. Enjoy the show. Ping, welcome to the show. And thank you for bringing along our special guest, Doug Leone, as well, on your board. My pleasure. Thank you. Thank you both for joining. Ping, I want to start by asking, a big part of the AI thesis is that AI is going to replace labor globally and that the TAM is in the tens of trillions of dollars. Obviously, the contact center, the call center, is a big pool of labor that, you know, is just begging to be automated. If you had to guess, how much of call center labor spend will actually be automated fully by AI?
2:25Yeah, so we internally, we have spent a lot of time debating about this. The reality is, I don't think anyone knows for sure. And if you ask, depends on really what they're selling. And you ask different people, and they give you different answers. And some people will say that 100 % human will be gone in contact center. And some gardeners' research actually shows that none of the Fortune 500 over the next five years will have contact center gone entirely humanless. So it's also probably falling into somewhere in the middle. And in fact, we got asked this question two years ago when GPT-4 first came out.
3:05And a lot of people will say that maybe in two or three years, there will no longer be humans in the context that are. So at that time, our belief is that probably the transformation, especially for existing Fortune 500 companies, will probably take way longer than a lot of people think. Doug, what do you think? What's your bet? At the limit, it's 100%. But I'm mindful that there are still IBM mainframes and cobalt being used in America in a banking system. So to me, it's not really what percent. To me, it's the speed of which this is going to happen. Is it going to happen within 10, 20, 25 years, 30 years?
3:47Because whether the answer is 30 % or 60%, if it happens in 50 years, that means one thing for companies like Crest. If it happens in three years, it means something else. So the end number is not the relevant metric for me. To me, it's the speed of adoption. Great distinction. Ping, you've been working in the contact center AI space for well over a decade. Prior to becoming CEO at Cresta, you ran the equivalent function over at Google. And so maybe for those of us in the audience that don't know the contact center market, can you tell us a little bit about what it is, how big it is, and how technology has served it so far?
4:26Yeah. When we first talk about contact center, a lot of people will naturally think about call centers. A lot of humans sitting there listening, answering calls. But contact center really is a broader category, including the Omi channel interactions from emails to digital chats and on websites and in apps, and also including calls, of course. And the overall market is quite big. And there are historically around 17 to 20 million agents, human agents, actually work in the contact center. For the software market, it's probably in the tens of billions. And for AI markets, according to some research, it will be in the high tens of billions of dollars.
5:12And is the use case mostly, you know, customers calling in to complain, customer support? Is that what these contact centers are mostly used for? Oh, so, yeah. So, customer call in, there are all kind of reasons they call in, right? Complaints are fixing the issue. But also, I think a lot of people may not realize that there are probably a quarter of the contact center, 25%, is actually revenue generating. They're including selling stuff or collecting money or retaining customers and that kind of conversations. So it's not 100 % customer support. So I have a question for you that I never asked you.
5:47If you look at the contact center, and I'm old enough to date myself, you go back 30 years, you heard names of Aya and God knows whoever else that's barely living in and out of bankruptcy. You go back 15 years, you see genesis of the world. What caused a bright young engineer called Peng Wu 15 years ago to be attracted with this market? And one could have said, it's always been a stodgy market. It's always been of low interest. It always created these slow-growing companies. What is it that interested you now? Of course, now we understand it's a vibrant market with lots of opportunity. But turning the clock back 10 years ago, what attracted you to this market?
6:31First of all, 15 years ago, I didn't even realize that's a long history of slow growth on the market. Otherwise, maybe I would think differently. And second, at that time, I just do remember there's a period of time, there's a lot of excitement of conversation, AI technology, and especially around consumer-facing speakers. And at that time, people think that that would disrupt Google, that would become the entry point for all the consumer interactions. and I happen to really believe that the contact center will probably be the most exciting opportunity for conversation AI to transform. And it's because it has all the issues that traditionally people get excited about, VC get excited about.
7:13It's a massive market, a lot of humans working there and it's in the middle between businesses and customers, right? And it's all the interaction going through. And also no one's happy in contact center. So if you, you know, by no one, I mean there are three different parties. There are customers that call in that most of us may not be too happy because the wait time is very long. And agents, by the way, I think a lot of people may not realize the agent, the workforce attrition in contact centers is massive. It's on average of 35 to 40 percent. In some cases during COVID, some companies have more than 100 percent turnover.
7:47I mean, right. So it's very high stress and it's not a very fun job. And also the business also feel like there are always the opportunity to do more with less. It seems no one is happy and it's a massive market, but I think that's the great opportunity for AI and technology to bring abundance. And abundance is the answer, in my opinion, to solve all these issues. So you were working on this at Google 10 years ago. I imagine this was the small language model wave, the BERT days. Was the technology ready at that point? and maybe walk us through the different waves of technology that have hit the contact center.
8:23Yeah, so that's a great question. Even long before that, there's technology called IVR that you press one, two, three for different routes and for different call reasons. And then since then, there are innovation around the input. Instead of pressing, you can directly speak natural language and that's with the advance of natural language processing and TTS and text-to-speech generation that experience getting better and better. For when we first started in contact center AI at Google, it's even before BERT, actually. It's before Transformers. It's mainly using AI, or at that time, using AI to do classification, intent classification, and entity extraction using pre-Transformer models.
9:09But the conversation experience is still manually crafted. So that's the last generation of technology. And then after that, of course, the Transformer came along. Initially, it's also for classification purposes. Still, the experience is manually crafted. But then the LIMs entirely changed the whole thing. Not only the conversation experience on automation side, but also just you can understand conversation in a way that never was able before. And what does that mean practically in terms of the rollout of this technology inside contact centers? Does it mean that customers were just extremely unhappy when it was IVR and then they were slightly less unhappy when you started to have kind of more transformers in the flow?
9:48and now customers are very happy to be talking to MLM-based agents? Or how has the evolution of technology changed the customer experience? Yeah, I think the way we like to think about it is really from the first principle, right? And, you know, there are a lot of the conversations shouldn't even happen in our view. And, you know, the fact that it happens because the customer is not happy. I think the solution for that is to use the AI to really understand, to bring 100 % visibility into all interaction in the contact center today and using AI to analyze it and then to do deep research and then find out the root cause.
10:25And then that usually reflects some process broken or website updates that freak out people or firmware update that bring down network and all that kind of stuff. So you need to fix that first, right? And first, avoid interaction if it's not necessary. And beyond that, I do feel like their AI can automate a lot of interactions that no one wants to have. Like neither the business nor the customer want to have those interactions. Those are what we call low emotion value interactions that should be self-served. And then on top of that, I do think that contact center AI will enable new interactions.
11:04That's the ones that you cannot afford to do that today. So all these are improving customer experience. Do you think end customers will ever prefer talking to an AI agent over a human agent? And have we reached that point yet? So look, I mean, that's a really interesting question. So I've been thinking about this on my way here. So I never met anyone to have this experience of talking to a customer support agent on the phone and go, I'm really frustrated. Send me your AI, please. And we never had that experience. And in fact, I would encourage people to look up some of the companies and search for their custom service.
11:44The first question that people ask on Google, and Google will surface, what is the most popular question? The first question is always, how do I talk to a live person for this type of custom service? So I think that that time probably hasn't arrived fully yet. It depends on what kind of interactions again. I'm maybe too techno-optimistic or AGI-pilled here, but I feel like I've seen some recordings now where the AI can be emotionally intelligent. It has infinite patience, right? It's not trying to hit some metric on time to resolution. And so, for example, if somebody calls in and they're having a really bad day, for example, your AI can be a lot more patient and empathetic than a human agent even could.
12:28And so I'm sort of optimistic on the side of the bots here. Well, I agree. There's the human component of patience or the subtleties of humanity, but there's also the training of the agent versus the training of the AI. Three years from now, who's going to be much more equipped to answer a question? It's clear that AI is the answer. I kind of think of gold versus Bitcoin. Somehow the analogy came to my mind as you said that. It is clear that Bitcoin is going to win. It is clear that Bitcoin is going to be worth more than gold. Not investment advice. Not investment advice. But it is clear that the agents, by definition, and a lot of which don't even reside in America, there's a language component.
13:16I'm not saying anything bad about the agents, but there's a language component, there's a training component, there's the human component. And I think in all those dimensions, I think AI is going to win in the next two to three years. Bitcoin as digital gold is a really interesting analogy to the agent, the digital agent versus the human agent question. Yeah. From our perspective, we really want to meet customers where they are today. So unlike self-driving cars, you really have to automate the entire thing 100 % of time. Otherwise, you do not have the economic impact. For contact center, what we find is very unique is that the work is very divisible.
13:52So first, the conversation is, you know, those are every conversations independent unit. And you can automate X percent of conversation that's ready to be automated. And for a lot of reasons, we can get into details. And then for the remaining ones, you can still use AI to assist humans and to take away the initial maybe 10 percent of the interactions like authentication or intake or lead qualification. And then take away all the after call work. And also have AI agents to help humans in the middle of the conversation to do knowledge retrieval, to do data entries, all that stuff. So that's not mutually exclusive.
14:29And as long as we feel like customers are not ready to say that we just need to turn on our cloud center today and then go full AI, we feel like there is a long, depending again on what kind of business and what kind of technical IT infrastructure. So I think the journey will probably take a different time frame. But our goal is really meet the customer where they are. So CRUS is in an interesting position because you both have the agent assist product that helps make existing contact center agents more productive. And then you have the actual AI agent product that is directly customer facing, you know, autonomous agent.
15:04Where do you think most customers are today? Are they ready to go full force, just, you know, put the agent on my website, let it go crazy? Are they, you know, experimenting with that? Where is the customer today? It depends on the customer. If you and I start an e-bike store today on Shopify, and we can automate 100%, I'm sure, because it really depends on how complex is your product. It can be ordered or magnitude difference between like a simple product like e-bike or versus a real world touching many different countries and then millions of tens of millions of people. So it's very different.
15:38And then that impacts the complexity of the conversation handled by the contact center. And then the other part is the IT infrastructure. A lot of people may actually realize that before you actually enter the contact center, you will feel like, oh, this should be easily, very easy to automate. The reality is a lot of those things that humans do in the contact center today is optimized for humans. So those system record or the system action ticketing system, these have been around for decades. A lot of them just simply do not have APIs, right? So the only thing that to make changes is through a graphic user interface that optimize for humans.
16:15And without a real-time API, just, you know, again, these are not AI problems. And we believe that, you know, these are the opportunities that we work with our customer to develop those real-time APIs. And so that's why we feel like those transformations depends on the nature of business would take different time frame. Yeah. It's interesting you made the self-driving car analogy earlier because I was thinking about your business earlier this morning. And if you think about Tesla, part of the beauty of them getting to full autonomy is that they have so much data coming in from their cars, even when they're on L2, right?
16:47For you guys, because you are the call center assist, you're the agent assist, you actually get full data of the conversation, whether it's voice, whether it's conversational based digitally. And that can become a training base for customers to automate more and more of their conversations over to the agent over time. Yes, 100%. And in fact, when we first, my first, the journey when I first started seven, eight years ago, it's really automation only. I really believe it should be automation only. Fast forward, we run into all kind of real deployments. And then we really actually broaden my own horizon.
17:24Then I believe that in order to really do the best possible automation, it's counterintuitively. You need to know what actually happened in the contact center. What are humans actually doing? So not only just the conversations, but also what they're seeing on the screen. That's super important to actually build the best automation possible. One of them is the sex appeal. It's the sizzle. It's what everybody wants to talk about, which you have to have, otherwise you're a tired old company. The other is the realities of what business are run and what they need. And so if you are one of these new age companies, you're quickly going to hit a wall because you don't have the data and you don't have the systems that you really need to run a contact center.
18:08But if you're at the former, don't have the latter, then you're labeled as an online company. So here in our case, we understood this a while back and we make sure we invested. we not only we double down on the operational system for agent assist but we also develop the sex appeal product because that that's what a lot of customers want to talk about day one and another aspect of it is really just tied to the uh the point i make earlier um is that a lot of those costs shouldn't really happen people call in there's no way to make them happy it's because they're not happy to begin with right and you know if your product works if your process works, they shouldn't really happen.
18:47So if, look, if this room, we feel really, really cold, maybe the answer is not a heater. Maybe there's a broken window or there is a patio door wide open. The solution is turn on the light and see the root cause and then fix that first before you turn on the heater. Yeah. Love that. Customer support is one of those, you know, canonical examples of where people think large language models will be most transformative. And, you It's almost a consensus category for venture startups at this point. How do you compete? What is it like to compete when everyone has access to the same LLMs and is latching onto the same big picture vision?
19:24Yeah, so again, in order to really deliver value in the context of the transformation, it's not just the models. It's just not a model. The model is a bunch of weights and the data, and itself is not going to provide a value. right and now the question is how much you need to build on top of it to deliver that value if that layer is very very thin then our argument probably um it's you don't have much um opportunity to accue value right and then also if that layer will be gone when the model gets better there's no way you have a durable business but that is not a case for contact centers and um in where majority of the agencies are still on-premise and where a lot of, there are so many, look, on average agents in the Fortune 500, we look at some surveys, they interact with eight to 10 different systems.
20:14Remember, these companies also apply to other companies over years, over decades. Those backend systems may not even talk to each other. You know, it depends on where you book the flight or depends on where you book the hotel. They may need to log into different systems, Right. So that's the reality we're talking about. So that's why, you know, we believe is our strategy is meeting customer where they are and and then drive value on day one. Vertical integration from the stake to the sizzle. That's how you win. What do you think is overhyped and what's underhyped in the kind of contact center AI space right now?
20:49Yeah, for overhyped, I think it's the mindset of scarcity. Is the job displacement, I think in the short term, is probably a little overhyped. And what's underhyped is the mindset of abundance. Think about new experience that AI can enable. For example, can you talk to a website? Can you directly talk to the app? And can you turn a synchronous interaction into an asynchronous interaction? Can you talk to the airline app and say that I want you to do this X, Y, Z, and then call me back when you get it done, right? And then can you have that super, you know, multi-language AI agent to have those conversations?
21:33Or there are so many interactions that today you just cannot happen just simply because you do not have the staff, right? And then the other thing, actually, I feel is really underhyped is people really seem obsessed with one side of the conversation, which is the workforce. And then people ask, you know, how many of the workforce were replaced by AI? But no one ever asked the question is how many inbound calls will be replaced by AI? So my belief is that there will be, over the next few years, you will probably see a race to getting the AI assistant on the consumer aggregators. And then a lot of things that consumer probably will dedicate to the AI assistant, including making the phone calls.
22:19So I think that's maybe an interesting thing to pay attention to. That's really cool. Okay, so you could talk to the United Airlines app and have it asynchronously go figure something out for you and call you back. Is that something that you're working on? We're no comment on that. Okay. Very cool. Okay. I want to transition to talk a little bit about company building. Doug, you've been around the block for a while. You've seen the movie a few times. It means I'm old. That's what you just said. I was trying to say it nicely. Yes. How is building a company right now? You're seeing this live with Ping.
22:52How is building a company in AI different from your last few decades of building legendary companies? It's not very different. What I mean by that is you need a terrific founder, and we'll talk about the Cresta situation a little later, hopefully. You need to plug in world-class engineers at the very start. Unless you start with A-pluses, you'll never move up. You'll only be moving down. You have to plug in salespeople that are not administrators, that are fresh. maybe they were regional sales manager early on because one, you can't get the world-class people and two, if you get them, they're too big for the company.
23:36You have to figure out what the ramp is that you're willing to fund. You have to figure out what the role of marketing is. You have to solve this thing that I call the merchandising cycle that's been getting some play online, which is from product marketing to BDRs to revenue, wherever that's broken, it looks like a bad sales guy, a bad VP of sales, but you have to get that right. And so I think the business fundamentals are very similar. I do think one of the characteristics of the companies that are doing the best in AI right now is they just move with extreme speed. And maybe that's always been the case, but I think it's even more intense right now.
24:15How do you think about instilling the need for speed in the companies you work with and even at Sequoia? So I thought of answering that as part of my answer. And the reason I left it out, all the boards I'm on move with extreme speed. And that's because I paint a picture for the founders of a river, a river with rocks. And the founders and the CEO's job is to remove those rocks. So when you give me next year's plan, I don't care that's 150 % net new AR growth. I want to know why the plan is the plan. and I want to challenge you why it's not 3x that. And maybe the answer is funding. Well, we can get funding in this market.
24:53Maybe the answer is management experience. Well, that's often a good answer. Some people will say market. Well, no way that's market. We're a little company that is. And so in my mind, it's forcing the understanding that these companies are capable of doing things which they don't believe they are capable of doing yet and to remove those rocks. And I push and I push and I push and I said, why can't we go faster and do it in a linear fashion? Because God forbid something isn't going to happen. If you hire 250 salespeople in Q1 and then you realize in Q3 something's wrong with the product, then you're stuck with a burn.
25:35So I'm a believer and I hear, no, we got to train them all the time. Baloney. Give us, please, a revenue ramp that's linear so we can make mid-course corruptions up and down. And let's not be stuck by these numbers. We have 10 fingers, 100 % growth. That's all bullshit. How fast can we possibly grow? That's always been the mantra in all the boards that I've served on. AI is not different. And, Doug, one of your superpowers is you can see through people, you can read people. What do you see in Ping to install him as CEO here? Let me zoom back of the company and then I'll answer the question with Ping.
26:12So I took over the board of Cresta from a partner who left to become the CEO of work. They're a capable man, but they wanted to run a big business. We love Carl Eschenbach. He loves us. We're still very good friends. He still helps us out. and I was told it's all fixed. And I went to Cresta and we had no CEO. Founder had left. We had the office of the CEO. And in 90%, if not a larger percentage of the companies where I've had the pleasure of serving the board, it is the founder that runs the company because once you lose the founder, you lose the soul of the company. And here we were with the office of CEO.
Read the full transcript
26:53What I didn't know that day that I knew three weeks later is that we had a hidden gem. We had a founder, not really a founder, but we had a founder. We had Pengu Ran Engineering, who, as you said earlier, built a contact center system at Google, who thought like a founder, took no prisoner, had recruited God knows how many people from Google. And so it's the only time in my career that I was able to plug in a founder in the middle of a journey who wasn't a founder. So in my mind, Ping is like a founder of the company. So we didn't lose a step. And I may say at the cost of embarrassing you, Ping, it was a controversial decision back then.
27:33Now we've been a CEO, this and that, a founder. But I believe that the CEO of these small, wonderful companies has to be a product person, not a salesperson, not a marketing person, God forbid, a CFO, VP of HR. I apologize to all the CFOs, VP of HRs. So we had that in the building. We promoted Ping, and he didn't miss a beat. You know, we could not have been more thrilled. Ping, you vindicated me. I told you that before. You made me look good because there was some linear thinking on the board. Oh, no, we have to go in the outside. I go, no chance. We have somebody who built a product inside who's a founder.
28:14And so we made the decision. It was a somewhat risky decision. I won't deny that. but after one or two board meeting, it was clear. It was a terrific decision. So thank you for everything you've done and making me look like a genius. That is high praise from Doug. Thank you. What does Crestha need to do next? What does Crestha need to do over the next five plus years in order to become a great company, a legendary company? So, well, first of all, it has to continue to develop product. It has to continue to put one foot in front of the other. It has to always see whenever some people reach a pita principle of their role, it has to be relatively aggressive in making sure it hires people that are capable of taking it from that point on and forward.
29:02Staying away from these, quote, very experienced people that start feeling a bit like suits and administrators. Point one, that's the most important thing. but the other thing that Cresta has to do it is to up its game in marketing there's a lot of companies I use the word the sizzle there's a lot of company with a lot of sizzle and no stake we have a whole bunch of stake we're a modern company we're best in class in one category we're going to be best in class in the other category we have beautiful growing run rate in both the agent assist and in the AI part of the product, in the automated part of the product, I just think we need to attach a marketing overlay so we become a household name out of the market.
29:49Well, glad you're on the podcast then. Maybe stepping back, Doug, you've seen some market cycles. Are we in an AI bubble? The word bubble implies you invest money in and you lose money because either due to lack of supply of companies or abundance of capital. There's certainly an abundance of capital. But I've noticed over the last two cycles, the internet cycle when that's kept going public in 95, two great companies being built in the late 90s in Google and Amazon, a few others names that came to me, then a bit of a pause, even the words I heard, the internet is a fraud, it's not going to do anything.
30:32And then three years later, the world went crazy. That latency was a lot less in mobile. I remember when we first looked at these apps and Jim Getzen and I, a former partner, said, how do you make money from a$19 app? How do you build a multi-billion dollar company? Never thinking of Airbnb, never thinking of DoorDash. A year or two later, we saw Airbnb and DoorDash. Again, that from initial birth to real market shrunk from the internet. I think this has shrunk even further. I think AI is here. I think you have to invest. I think you're the front end of a cycle, which doesn't mean you have to invest in everything.
31:08But one of the mistakes that we made at Sequoia is whenever we see a bit of revenue momentum, we have some geniuses around the partners meeting that say, oh, it can stop. It can be substituted. Keep it very easy. You see a small company with very momentum in a front end of the market. I'm not talking about the SaaS market in 2021 where you're down to niche verticals. At the front end of the market, you start seeing the modicum or revenue momentum you lean in, and you hold your nose on price. I love that. As you think about where value accrues in the market, there's compute, there's other infrastructure, there's the foundation models, there's the application layer.
31:49Where do you think value accrues? Up. Up? It always accrues up. Just look at the gross margins as you move up markets. Look at the gross margins of chip companies. Look at the gross margins of the system companies. Look at the gross margin of this. Well, but that's, and NVIDIA, of which we were the first investor, is a great company. Jensen was able to see the future many years ahead, and he pulled one of the great, probably the greatest coup in Silicon Valley, what he did. It's just spectacular. But if we're looking over time, I think value is going to accrue to, quote, the application layer, what that ever looks like.
32:27You know, it's going to accrue up near the customer, near the money, near the business user. I agree. How do you think the AI wave is different than internet or mobile? I thought of everything else being tools to make us more productive, meaning we all became networked and we all became networked and mobile. I view the eye wave as the industrial, the revolution 2.0. I think this is much, much larger. I remember thinking, boy, we have just seen the biggest market caps five years ago. Why is it? Because it was connectivity that created this revenue growth. Never imagined that there was this thing was going to be much bigger than connectivity and the mobility.
33:21It was a complete redoing of humanity, of how humanity exists, works, lives, enjoys. And I think AI is both going to be a wonderful thing for us and maybe even a kiss of death for us over the next 10, 20 years. Yeah, totally agree with what Doug said. And I think one thing AI is very unique is that there are so many surprises. There are surprises of underlying capabilities that you never seen before in internet or mobile age. If you take, you know, if you take the world view in 2015 and take a time machine to give that to someone in 2007 when Steve Jobs first introduced iPhone, I think someone can resonate with that.
34:10And then same for internet. I think people can kind of foresee what's coming. But for AI, I feel there's so many surprises as the underlying model gets better. There are things that even the authors for Transformer paper will not have imagined some of the capability that just came after the large language models and that continue to surprise us. So I do think that a lot of the improvements is non-linear. It's really from zero to one, continued happening at the bottom layer. So I think that's something that make it even more exciting. You know, I'm going to remind you of something. In March of 2022, which now sounds like an eternity, it was my last annual meeting where we meet with all the investors.
34:57And it was a goodbye kind of thing, you know, where I presented performance and everything. And I had a slide that talked about all the waves back from the chip wave to the to the systems wave, to the land slash land wave, to internet, to mobile. And the next box, a short three and a half years ago, was a question mark. We did not know as a partnership, and we are as advanced as anybody, we are the bleeding edge investor, right, in seed. We did not see the wave coming. And this wave has been a tsunami. And I don't think there's any end in sight. Thank you. Thank you for sharing those insights.
35:38Do you want to talk about Cresta's technical stack, or should we bug Ping on that? Well, in fact, I'm going to have to go in a few minutes because I'm in the process of recoding some of the… Are you Vypes coding the Cresta app? Yes, yes, yes. I'm Vypes coding everything. Ping, tell us about the tech stack. Yeah, so we have a pretty broad surface or product, and I can maybe talk about the voice AI agent. We streaming end-to-end audio bi-directional, and we orchestrate multiple different models. There are speech-to-text model and then noise cancellation model to improve the audio. There are models that detect the terms and the speech activities to handle interruptions.
36:23And then, of course, there's a foundation model and to handle the conversation. And the other side is the TTS text generation model. And then in parallel, we also run multiple smaller models to do guardrail checking and to make sure that nothing is going crazy. And as well as those models will do company-specific kind of checks. For example, never give out tax advice or never give out financial promises, things like that. And then that's the runtime of voice AI agent. and also there's design time. There are components like running large-scale simulation to really stress test the AI agent to cover all the edge cases.
37:05There's test case management components. And similarly, if you think about our voice AI assistant, so it's also streaming audio, but again, so there's a lot of similarity between the infrastructure, but it's not bidirectional, right? It's one direction. and listening to the call and then understanding what's actually happening in the call with two humans, right, and then orchestrating 10 plus more models, actually. And, you know, in fact, similar to Vertex AutoML, we have a platform that can allow customers to build their custom models to detect interesting events in the conversation and then marry that with workflows.
37:45And people use that to detect fraud, even used to detect fraud, call center fraud, to train agents to how to handle objections. There are so many use cases that now with that tool we call Opera, they can express and trigger workflows. And underneath is teacher-student distillation to distill into very small models that we can run in real time and to understand two human conversations. What's the latency when I talk to one of your agents? So it's around below 800 milliseconds. Wow. So it feels like talking to a human. Yes. Huh. Yes. So you're running all these models in your real time then? Yes.
38:24Are you running open source models or are you running, you know, 11 Labs in the equivalent? So across the platform, there are 20 different models. Some are open source and fine QMs. There are small models that, for example, we only do chat or email for human agents. And we auto-complete their sentences and type ahead. Those are very, very small models. And for TTS, we, yes, we use 11 Labs. They're a great partner. We also use other vendors, and we constantly compare the performance. Really cool. And then the actual meat of the conversation, though, the dialogue or the conversational flow, how do you control that in a way that's not so rigid that it's like the IVR systems of yesterday, but not so freeform that, you know, customers can go crazy and get their refunds on airline tickets and, you know, have the bots say crazy things and embarrass the customers?
39:14How do you control the flow and get the best of both worlds? Yeah, so it's really just how you train humans. You give them the specification about what's the goal and these are the tools. And that's the beauty of large language models to handle those messy kind of workflows. So there's a lot of discussion about what's workflow, what's agentic. Workflow is anything you can write it down in code. That's step by step. That's workflow. And car wash. Car wash is actually a workflow. If you think about oboba tea, milk tea, those are physical workflows, but they cannot do other things. For human conversation, it's very messy.
39:51It's nonlinear. So that's how the agentic workflow come in. That's where LLM is really good at. And then on top of those, you want determinism. And that's how we introduce the testing, the simulation, and then the guardrails to make sure that whenever you have a change in any part of the system, the behavior is still expected. Do you tune your customers' models to, because you also have this agent assist product, so you're in the flow of all these customer conversations. Do you tune the agent to that training data or is it completely net new, forward deployed engineers on site, mapping out conversations?
40:30Yeah, so we have a tool that can map from, you know, what's actually in the human conversation to extract the blueprint of the conversation, right? So I think the beauty of that, again, is to discover a lot of unknown unknowns. So there are a lot of topics and there's a lot of things that reason people call in, you may not even know, that may actually contain the call volume, a very large call volume. And then once you have that, you can now look deeper and you can use ILM to do all these analysis and extract what are 57 different ways that people express the same intent and what are the different ways that the call flow will go.
41:06And then we can summarize and extract that. So all these are building the products, and then in fact the tooling gets better, the forward deployed engineers will just be a lot more efficient. And then there are also other ways we use the human side of conversations. For example, we extract a model for the visitors. So that's how you build your simulation. And the simulation is a huge part of improving the AI agent. And we believe that having access to exactly how your real customer humans come in and describe ways in different ways, sometimes it's very messy. you can extract the model and then do better simulation on your AI agent as well.
41:42And then what methods do you use to make LLMs really bespoke for a customer environment? Like, is it RAG? Is it prompt engineering? Is it fine-tuning? Is it all of the above reinforcement learning? Like, what are you most optimistic on in terms of techniques? Yeah, so we use almost everything. So definitely prompting and then RAG and for those simpler agents. but we're still exploring by looking at the human behavior and then the outcomes, how do you use RL to improve this end-to-end performance? But for AI agent by itself, I think the foundation model itself is already pretty good. You just need to get the best out of it, at least for a digital channel for chat.
42:25But for other use cases, there's a lot of opportunity to fine-tune the models and to make them for tasks like summarization, for tasks like auto-completion sentences, and that kind of stuff, I feel like there's a lot of room to extract from the fine-tuning open-source models. What goes into building a successful fleshy demo versus production-ready AI systems? Yeah, so that's a really interesting question because I think one thing unique about AI is that there's a huge gap between the demo and production. And on one end of the spectrum, you have rocket launches. The rocket launches, the demo is the production.
43:05And the production is the demo. You cannot fake it, right? But for AI, it's a little different. And I can just give you an example, right? So auto-summary. Auto-summary feels like a commodity capability that anyone can use ChatGPT to create auto-summary. But in order to deploy in some call centers today that 20 ,000 people across multiple continents call centers, and a huge list of challenges. First, how do you get the real-time audio? In the demo, you can demo very easy on Twilio in the cloud. But remember, 50 % of the conversation happened on-premise. And then sometimes how to access that will cause you a lot of money as well.
43:47And then how do you go around that? And then in the real call, 20 ,000 agent calls, there are transfers. There are a lot of transfers. And then there are third-party, third callers that come in that's healthcare specialist. All that needs to be transcribed and summarized. And sometimes the conversation goes so long. How do you handle like three-hour, four-hour calls that go beyond the contact window, right? And then things like, you know, is there background noise? And then things like, you know, for different core reasons, there can be different templates. You really, really want to extract these type of information.
44:19You cannot miss that. How do you make sure you do that almost 100 % of the time? And by the way, how do you handle PIs? and then you cannot have the personality and information on rest. And then by the way, how do you handle data residency if you're talking to a multi-continental, multinational bank or a healthcare provider? So all these have become additional requirements that make something that would feel very commoditized like out of summary become very, very much harder to do in actual contexts. contact center. And that's why you need a product-minded chief executive officer for one of these companies.
45:01Absolutely. And this is also why all the pain and all the value is in the last mile. This is why the value is in the application layer. Yeah, I tend to agree with that. Yeah. Talk to us about the future. What happens if everything goes right? What does that mean for Cresta and what does that mean for the world? I think that AI will just like any technology before it, like electricity, it would disappear. It would disappear into workflows. And I think, 20, 30 years later, no one will realize that they may actually talk into AI or is a human assisted by AI. There's one thing I'm really excited about is that today, if you think about a business, and they feel like multiple personality to the customer.
45:41So in the sales phase or the marketing phase, they really, really want to talk to you. They call you very, very aggressively. and once you sign up and become a customer, you're dealing with entirely different personality, right? And you're dealing with service departments and they tend to use the terms like tier defense, deflection, and to just refer to the exact person that they were courting just a few days ago. And then even if you have a long conversation on the customer support line and share a lot of feedback, two weeks later, another department will come in, what's your feedback? How about you fill out this survey?
46:19you know, to our business, feel like these are really disconnected, right? And I do feel like AI agents can make this entire experience a continuous, long-going conversation throughout the entire customer journey. And LRM is a perfect tool to do that. And that will really bring the level of personalization, the level of customer experience that wasn't possible before. Yeah. The point that really stuck with me that you said earlier was about kind of the scarcity versus the abundance mindset. And how much can business to customer communications really evolve and app experiences really evolve if you take the abundance mindset to bringing LLMs into this field?
46:57Thank you, Ping. Thank you, Doug, for joining us today. I love this conversation. Thank you. Thank you for having us.
47:14Thank you.
From the publisher
Ping Wu built Google's contact center business before becoming CEO of Cresta, where he's pioneering a unique approach to contact center transformation. Rather than full automation Ping advocates a dual approach, automating what's ready while using AI to assist humans with the rest. He makes the case for an abundance mindset—imagining new customer experiences like talking to airline apps or turning synchronous interactions asynchronous. Ping breaks down the technical challenges of deploying Contact Center AI at scale, from solving latency to orchestrating 20+ models in real-time. Sequoia’s Doug Leone shares his framework for building AI companies at speed and why he believes we're at the front end of an Industrial Revolution 2.0.
Hosted by: Sonya Huang and Doug Leone, Sequoia Capital
00:00 Introduction
01:13 The Evolution of Contact Centers
02:05 Debating AI's Impact on Call Centers
04:07 Challenges and Opportunities in Contact Centers
08:14 Technological Waves in Contact Centers
11:10 AI vs Human Agents: The Future
13:35 Customer Experience and AI
16:33 The Role of Data in AI Automation
19:05 Competing in the AI Space
22:34 Building a Company in the AI Era
24:05 Instilling Speed in AI Companies
24:53 Management Experience and Growth Challenges
26:01 Identifying Leadership Potential
26:37 Cresta's Leadership Transition
28:34 Future Goals for Cresta
29:56 AI Market Cycles and Investment
35:38 Cresta's Technical Stack
45:11 AI's Impact on Business Communication




