In short
Eye On A.I. Podcast Episode #276: Ryan Wang - Building the Future of AI-Powered Customer Support
Podcast Host: Craig S. Smith Guest: Ryan Wang, Co-founder and CEO of Assembled Release Date: [Insert Date]
Episode Overview In this episode, Ryan Wang discusses how his company, Assembled, is transforming customer support through AI without entirely replacing human agents. The conversation covers the journey of Assembled, its services, industry challenges, and the integration of AI into customer support systems.
Key Topics Discussed
- Ryan Wang’s Background
- Previous Experience: Worked as a machine learning engineer at Stripe, contributing to fraud detection.
- Founding Assembled: Started in 2018, with the official launch in 2020 coinciding with the COVID pandemic.
- Evolution of Assembled
- Initial Offering: Began as a workforce scheduling tool.
- Transition to AI Support Platform: Evolved into a full-stack AI platform addressing customer support at scale for companies like Stripe, Robinhood, and Honeylove.
- AI in Customer Support
- Conversational AI Agents:
- Handle up to 75% of customer inquiries.
- Aim to enhance human agent productivity by 15%.
- Voice AI: Identified as the next big frontier, enhancing direct customer interactions.
- Economic Realities of Automation
- Human Element in Support: Emphasizes that automation does not equate to the elimination of human jobs. Human agents remain vital for complex queries.
- Workforce Optimization: Companies are navigating the balance of AI and human resources effectively.
- Competition and Industry Landscape
- Competing Products: Faces competition from companies like Zendesk, Salesforce, and Crescendo.
- Market Potential: Customer support is a fragmented, yet lucrative market with substantial spending on labor and growing demand for AI solutions.
- Technical Infrastructure
- Integration with Existing Systems: Assembled integrates with various customer support stacks and systems to optimize operations.
- Use of Multiple AI Models: Ability to switch between different AI models (e.g., OpenAI, Claude) to enhance service delivery.
- Challenges in Global Support
- Multilingual Support: Addressing complexities in serving diverse customer bases across different languages and regulatory environments.
- Future Outlook
- Continued Growth in AI Agents: Focused on expanding capabilities, particularly in voice AI and the overall customer support market.
- Market Fragmentation and Entry Barriers: Despite competition, the fragmented nature of the industry allows room for multiple players and innovation.
Key Takeaways
- AI is reshaping customer support but does not eliminate the need for human oversight; a hybrid model is likely the future.
- Companies face economic decisions on when to automate versus maintaining human interactions based on cost and quality.
- Assembled is positioned as a versatile platform that integrates various AI technologies to optimize customer support operations.
- The global customer support landscape is ripe for disruption and improvement, necessitating innovative solutions that leverage AI while acknowledging human expertise.
Conclusion This episode provides insights into the evolving landscape of AI in customer support, emphasizing the importance of blending AI capabilities with human intelligence to enhance service quality and operational efficiency.
For more information, visit: [Assembled.com](https://www.assembled.com) Follow Craig Smith on X: [@craigss](https://x.com/craigss) Follow Eye On A.I. on X: [@EyeOn_AI](https://x.com/EyeOn_AI)
---
This markdown file offers a comprehensive overview of the episode, highlighting key discussions and insights shared by Ryan Wang regarding AI's transformative impact on customer support.
Written by AI. May contain mistakes. Listen to the episode to check what was said.
Transcript
Automatic transcript. May contain errors.0:00There will be this kind of like hybrid human plus AI support that companies are going to have to think about. Just because you can automate support does not necessarily mean it would be economically viable to do so across the entirety of the business. If you can auto draft replies for people, and then 90 % of the time they're actually just sending the message without really changing it, then that's like the path to automation. What should go to who at what point in time? Or another way to put it, how do we get the right agent at the right time, the right answer? Build the future of multi-agent software with agency.
0:33That's A-G-N-T-C-Y. The agency is an open source collective building the internet of agents. It's a collaborative layer where agents can discover, connect, and work across frameworks. For developers, this means standardized agent discovery tools, seamless protocols for interagent communication, and modular components to compose and scale multi-agent workflows. Join Crew AI, Langchain, Llama Index, Browser Base, Cisco, and dozens more. The agency is dropping code, specs, and services. No strings attached. Build with other engineers who care about high quality multi-agent software visit agency.org and add your support that's a-g-n-t-c-y dot o-r-g i'm ryan wang i'm co-founder co at assembled and for the ai platform for superhuman support so we help hundreds of customers from startups to enterprises with scaling great support and customers like Ashley Furniture, like Brooks Running, like Robinhood, like Stripe.
1:57We started in 2018. We launched in 2020. So I remember March 2020, you know, there was a Hacker News post and like there was the World Health Organization declares COVID a global pandemic. Assembled launches and then World Health Organization again is kind of like the front page. But yeah, we've been at support since before the AI era. And my own background is I was at Stripe. I was a machine learning engineer. I was working on fraud detection. So that was 2014 when it was an 80-person startup. And the trajectory was like 80 to 800 by the time I left like 2017. And the thesis around support was, well, really, it was an observation like at Stripe at 80 people or so like Patrick and John Collison, the co-founders of Stripe, like, and their apartment is just over there, like a couple blocks from our office now in the mission in San Francisco.
3:00They would have people over to their apartment to do support tickets, like the whole company. It was called like a support rotation and obviously that wasn't going to scale and um at 800 people it was uh like multiple products and kind of 24 7 support and like different tiers and different skills it's just a lot of complexity and so um you know the question back then was just like can we apply machine learning to uh to draw the line between you know the experience at scale and when it was patrick and john and the company in the apartment and we kind of found that a lot of companies were kind of going through similar journeys of wanting to scale great support.
3:37Slack was an early customer of ours. They have the same type of story with like Stuart Butterfield and like the whole company. And yeah, so lots of companies go through this journey. My educational background, like how I got to machine learning is I went to the University of Chicago and I went to study economics and actually econometrics was the fun part. So I got a BAMS in statistics, but my MS advisor was this guy, John Lafferty, who had done a lot of kind of like interesting theoretical work. And in particular, some of the work around what essentially became like one of his early students was this guy, David Bly, who did Leighton Dirichlet allocation.
4:21So like topic modeling. So that was kind of how I got interested in machine learning in the first place. That was like 2012. But that's me and, you know, kind of like kind of working backwards into it, into assembled. Yeah, yeah. But 2012, that's, that's early. So, so from Stripe, you left Stripe to start assembled. And did you say 2018? Yeah, yeah, we started 2018. And it took us a little bit of time to get off the blocks. So we didn't launch until 2020. right at the beginning of the pandemic yeah and and so things were slow presumably uh until uh 2022 or 2023 is that right well it's it's it's interesting so um it was very scary and then immediately it was off to the races um and what i mean by that is in And there was like that immediate, like, okay, you know, everything's frozen.
5:27But customer service actually benefited along with, you know, a lot of other functions, because what happened was there were these companies that were going through, like, you know, the Zerp and the COVID era pull forward of demand. And so companies were growing at kind of like pre-AI, you know, this was kind of wild, like unbefore-seen rates of growth. And, you know, one of our early customers was Robinhood, for example. And when they first started using Assembled, we were actually just a tool to replace spreadsheets for the scheduling operation. And so, you know, they had a couple hundred people in customer support.
6:06And the question was just like, what should people be working on? There's no Google calendar, you know, that works for several hundred people. And so they had this spreadsheet of like every single person, the schedule, like across the top, like days of the week and hours of the day, and who would be working on what. And then it would sum together like, okay, based on Robinhood's forecasting, here's how many people they need. And here's how many people that are actually working there. And it was a good time for us because I don't know if you remember the kind of like roughly 2020, 2021, what happened to Robinhood, like Bitcoin, meme stocks, like they went vertical as a business.
6:46And in particular, it was the need to hire a ton of people and customer support to keep up. And so it went from a couple hundred to a couple thousand kind of overnight. And so, you know, Assembled really got started in that world of like companies going through that type of hyper growth, need to grow their support teams to keep up. And then there was another piece of texture where historically customer support is the call center. And that's a pejorative term. Like now we call it contact center. But the contact center was kind of forced to go digital. And like if you go to like call centers or contact centers, there's huge, sprawling places and they're in like rural Oregon or like Cork, Ireland or the Philippines or India.
7:34and all of a sudden they've got to change the way they approach software that people are working distributed and I remember reading this article in the Wall Street Journal about customer service agents in the Philippines all of a sudden they have to work from home and you could hear chickens in the background so it was really like they had to change the way that they were approaching software so those two trends from 2020 to 2022 roughly kind of really accelerated a lot of companies' growth and assembled, like kind of got started at that kind of perfect moment in time. So from scheduling software, essentially, how did you, what is the ladder you climb to the current product?
8:19Yeah, it's, so like the broader category is something called workforce management. And, you know, I think scheduling is doing it only a half service because if you think about the operation of a large contact center. So one of our customers is one of the largest delivery apps in the world. And they have 15 ,000 people, even with AI, they still today have 15 ,000 people in the contact center. And there's a, you know, put my economist hat back on, a supply and demand question. the demand question is how many phone calls how many emails how many chats you're going to get and there's a queuing theory question underneath that or really operations research which is like how many people need to be working if you want to handle all those calls within say 15 seconds or 30 seconds and then there's a supply question which is the scheduling one and then that gets more complex if you know you've got 15 000 people it's not just like a okay literally like a record but there's labor laws all across the world.
9:24There's people in different locations. You need to kind of line up the hours of working. And there's actually an optimization problem. So if people work like in the industry, there's something called the standard five by eight. You work five days, you work eight hours a day or a four by 10, you work four days, 10 hours a day. You can imagine this kind of like Lego blocks lining up to a demand curve. So like in truth, when I say scheduling tool, It's this workforce management problem, which is an operations research problem, which is about quantifying demand and matching it to supply, which is actually all the way back to machine learning.
10:03So when we talk about AI agents today, we started with automating away support, but that wasn't the key issue that people were hitting as they were scaling in 2020 through 2022. but we came back to in 2022 building AI agents on top of the data that we had on top of the kind of like understanding now of like the deep operational complexities of large support teams and you know we have two billion support tickets in our database so it made a lot of sense when you know November 2022 Chachapiti launched to say oh actually like now's a good time for us to take the data that we have the understanding we have and kind of point AI at it and so that's kind of the synthesis of like all the way from customer facing AI agents to this kind of like really like ML kind of support operations layer.
10:47And, and, and so the current, I mean, are you a SaaS platform? Is that how you're, you're making yourself available? And, and yeah, what's the full gamut of are there a series of products or is it soup to nuts for customer support or how does that look yeah when we say we describe ourselves as the ai platform for superhuman support so like there's a sass part which is that kind of like the planning layer and that's like you're the larger your team probably the harder your planning problem is I think there's some nuance there because as more and more companies have this kind of human plus AI agent hybrid workforce, it starts to be not about headcount per se, but almost about the amount of volume flowing through.
11:45And then all the way to the AI agent, that's not SaaS. It is kind of like this usage-based, outcome-based type of pricing as opposed to SaaS for the AI agent product. So the full platform, you know, it is for customer support. And then the piece is like, how do we price different products? Or kind of like, how do we think about the style of the product? It varies based on the use case. And it's a platform. Who are the customers? Are they BPOs that then are servicing, you know, customer companies? or is it the companies themselves? Typically the companies themselves. So if I go back to the Stripe example, they work with many different BPOs or outsourcers and they have this kind of like meta problem of, well, on the one hand, like doing AI automation, like providing an AI agent that'll be the kind of like tier one first layer.
12:53if you chat them or if you talk to them on the phone or if you email them. And then within the bowels of the kind of support operation, it's like, okay, for working with those BPOs, like how are you going to manage them? So, you know, we end up by way of that kind of like relationship working closely with a lot of different BPOs. And, you know, we have, for example, integrations that reach into a BPO's own kind of like planning and staffing system to extract the data of who's working when and what's the demand look like and stitch together a picture for their end clients of what does this look like across your entire BPO network, but less so directly with the BPOs themselves.
13:34One of the problems that you can imagine that they're solving that's changing over time is if you are a large business that has a lot of customers with a large support operation and you were trying to reason about like how many people or really how many resource, like this resource allocation problem before you were thinking of BPOs in this context of like this cost quality curve. So the cost quality curve is like you could hire somebody and train them and they'd be really skilled. And, you know, that's kind of like one part of the cost quality curve. You could outsource it. And there's different flavors of outsourcing.
14:10So like, you know, there's places like the Philippines have some cost structure. there's new places that are near shore like you can near shore or kind of like onshore but within like rural Oregon for example like there's contact centers in the U.S. there's budding contact center in like South Africa one of Nelson Mandela's grandsons is like creating the contact center in South Africa because it's a good kind of like entry-level knowledge work job and so there's kind of like different points on the cost or quality trade curve trade-off of BPOs. And then you put AI agents in frame as well. And so really what we're helping companies do is like pick a point or pick really not a single point, but like different kind of mixtures of strategies to design their support operation.
14:57Yeah. And the agents, are you using third-party agents or are they conversational agents? What kind of agents on the agent end? Yeah, they're conversational agents. So, you know, we are this open platform that, so like Intercom is a customer, for example, like they produce FIN. So, you know, we help them reason about like their human workforce and their AI workforce at the same time. They even have like a head of human support and a head of AI support. But we also build our own agents. And so those are conversational agents. So some of our customers, like Honeylove, for example, is an e-commerce brand.
15:36If you go to their chat bubble, if you email them, Assembled will do the responses and it's deflecting 75 % of the initial contacts. We're also over voice. We just announced a customer of ours who's actually a very fascinating business that I have just been super inspired by. It's a company called Retention Express, and they help membership management. And in particular, they help PE, like private equity roll-ups of car washes with their subscription management. And they use this for AI voice. And so what's been really fascinating in this space is the conversational AI has quickly moved past chat all the way into voice.
16:20And the voice technology space is just changing so, so, so quickly. And I think as consumers, all of us have been there, right? It's like, if I need help, I'd rather just call. You know, I'm willing to wait on hold to call. And the AI agents have gotten good enough to, like, be pretty useful to people. And then also to be able to, like, intake information. So, like, for this particular use case, you know, we're able to resolve, like, membership inquiries. but for like workers' compensation claims, like that's a common voice use case. We'll say, give us the information, tell us about the incident, when it happened, and then kind of like pass that to a person to finish off the rest.
17:03So you don't really have to like spend a lot of time rehashing what happened. And then also the people don't have to spend the time like asking you these real questions. Yeah. But is the platform, I mean, the voice agents, for example, Are you using a third-party voice agent in the stack or is in the platform, is there the place for a voice agent and you offer a default or an other, people can plug in their own or if they're using a third-party, plug in a third party? I've spoken to a lot of people recently about voice agents and they're all, um, not exclusively, but they're targeting customer service because that's the most obvious market.
17:57Yeah. I, I've also seen a lot of this, um, where people are trying to build their own, like we were at this, um, 11 labs launch event recently for, for, um, you know, their V3 voice model. And so I think, yes, like there were a lot of people there interested in building their own agents. So we help with like managing or kind of really like the orchestration layer of how to route volume to humans versus to AI. But we ourselves have built our own AI voice agent. And I think the distinction there is like, you know, a lot of people can, you know, there's this kind of like, if we put like a bunch of knowledge articles and your public help center and, and do rag, you can answer kind of like a first layer of questions and then you can stack like a text to speech thing on top.
18:51And, you know, that'll work pretty well to, to answer tier one support. But, you know, I think the story with assembled is like, that may not be something that you want to do because um like then you get to tier two you get to these kind of like agentic workflows that are multi-step that require you to ask for billing information and then make some decisions and um honey love one of our customers just to go back to you know everybody says refunds are super easy refunds are not easy like their policy is really complex like you pull up the flow diagram and it's like if you're zero to 30 days out from your order, check these particular variables, and it depends on the customer loyalty and your history with them and whether or not they've already given you a discount or something like that.
19:38And if you're 60 to 90 days out, you go on a different path. So these refunds, even just to execute that simple tier two workflow is actually quite complex. And so then to stack voice on top of that is still more complex. And so when we talk to people who are building it themselves, some of the questions we start to to hear are like oh actually you know what um because i was in this boat myself like building ml tools at stripe somebody built the first pass at this and you know like you know we're engineers we get excited about the technology and then you know you you built the first pass and then you move on to the next thing and the question becomes how do you get from 10 automation on your initial pass to that 40 automation with like the tier two workflows And that's where I think a lot of companies are right now.
20:28It's like between, yeah, like it's exciting and fun to build the first part and then to productize all the rest of it and to kind of keep eking out more automation gains. Like that's where you probably add an assembled agent instead. Yeah. And so you guys are not necessarily competing with, I mean, there's another company, Crescendo. I don't know if you've heard of them or Sierra. Yeah. um you're not necessarily competing with them directly right you're building more of the infrastructure for people like them we are i mean we are competing with them like we have a conversational ai agent through chat that competes with sierra right um crescendo a little less directly but in the sense that like ai agents are competing with um any type like bpo like crescendo is basically like a supercharged bpo right like when they were um they were previously something called partner hero and ironically they were a partner of assembles um partner hero and um you know everything is kind of like fighting over what we want to provide to end customers is you have support tickets and you want to make the problem go away great we'll make the problem go away so i think everybody is doing that we are doing AI agents to do that.
21:56Zendesk, Salesforce, Genesys, like every single provider of ticketing systems also has AI agents to automate it away. So yes, we are competing, but then I think uniquely we have this texture where kind of like Amazon, right? Like Amazon, you can use them, you can use RDS for them to run the database or they can say, here's like a bunch of different databases is that you could turn on. We're kind of like that. Like we have it, or you could turn on somebody else's and we could help you manage it. Yeah, I see. So if somebody comes to you, a company, a big multinational, what's the process to integrate you guys into their customer support?
22:44or presumably they have a BPO and they have, you know, maybe a front end chat bot, text chat bot, and they come to you, then what's the process of, of integrating or replacing chunks of their process? Yeah, it depends a lot on the use case. And I'll say that we've seen a lot of fragmentation on where people want to start. So, you know, our key use cases would be like AI chat agent, AI voice agent, AI email agent, AI co-pilot to help people be more productive, and AI workforce management to kind of like manage the entire support operation. And so if you're in any of the like AI chat, email, AI email, AI voice, it's like, give us your knowledge, give us your SOPs, your standard operating procedures that we can encode into workflows um maybe integrate some of your systems like your billing system through a stripe or your order system through a shopify and then just like you can kind of turn it on and start automating regardless of your channel um if you're ai copilot and one of our interesting customers um is is one of the big uh kind of design brands and a consumer design and um you They care a lot about quality.
24:06So they don't want to automate. And then they also have their own internal initiatives around automation that they want to hook it up to. And the business is in this place where they want to do more with the same. They're growing their monthly active users by 30%, and they're not allowed to hire people. But they care so much about quality that they don't want to just drop automation in. So it's actually make people 15 % more productive and crawl, walk, run your way. Like if you can make people, if you can auto draft replies for people and then 90 % of the time, they're actually just sending the message without really changing it.
24:44Then that's like the path to automation. So like, that's a lot of what we see with AI Copilot is you want to start here and you're kind of like collecting all the information and workflows that are first making people more productive then moving to this automation. And then workforce management, I won't talk too much about, but that was kind of like the earlier part the discussion around like, oh, you have a lot of people. And now you're trying to add AI agents in. It's pretty complex. Like, how are the pieces connecting? Well, actually, to me, that's what sounds unique about you guys. But I'm not versed in this.
25:17Is there a whole workforce management world out there that, I mean, You guys are growing into the, the AI, uh, voice agent and from the workforce management, but is there a world of workforce management that you're also competing in? Oh yeah. And it's a delightfully, uh, niche world. I would call it like, if you think about, um, uh, Dungeons and Dragons, like that would be like the workforce management world. And by the way, we had no idea about this when we got started. Like we had left Stripe and we were like, you know, these ML people, ML engineers, and we were going to actually automate away support with ML.
26:06And the way that we got to workforce management was by asking this guy, Bob Van Winden, who used to run operations at Stripe. Ironically, he went to Bridge and then so he's back at Stripe. But we were asking, what is software that you need to buy or you hate your options? And my co-founder came up with that. I said, you should coin that. That should be the product market fit question because baked into that is something that people need to have that they probably want to buy more of. So he told us about workforce management. And there's a workforce management conference that happens every year in Nashville.
26:39It's called the Society of Workforce Planning Professionals. It's so fun. It's a bunch of people who are really interested in the data and the nuts and bolts of contact centers. There's a Reddit for workforce management. People are pretty passionate about their favorite tools. So yes, we're in competition there with companies that most people haven't heard of, but are surprisingly large. There's a company called Nice. If you fly United, the first time I saw Nice out in the wild, not in my day job, like on the United, you know, they do the little ad before they, you know, you take off and it was like Gordon Ramsey.
27:23It's like nice in contact. I was like, what? But that's a, that's a like 20, $30 billion publicly traded company that's in this, this pretty niche space. And it's in that end of the business is just optimizing schedules. is that I mean essentially that's what it is you have a couple of thousand people and you're trying to figure out you know how to have them on call or or in a chair you know in front of a computer so that there's an even flow of service. Is that right? That's exactly right, yeah. I mean, it sounds so trivial, especially because we're AI ML people, right? It must be this super complex set of AI tools.
28:22And again, I'm very optimistic about that. That's the part of our product suite that I spend a ton of time in as well. but like the fundamental questions of workforce management you're like why are we so busy or you know how come we're so you know over under capacity what happens is when you line up supply and demand people find like oh a bulk of our volume comes in on monday morning but we're kind of like maximally staffed on wednesdays right like there's 20 efficiency gains just from like kind of lining these things up. And then Just is really like, it's actually complex to line these things up because people have different schedules.
29:01They're all over the world. They have different preferences. They have different skills. And so it is this kind of like multi-dimensional optimization problem, actually. Build the future of multi-agent software with agency. That's A-G-N-T-C-Y. The agency is an open source collective building the internet of agents. It's a collaborative layer where agents can discover, connect, and work across frameworks. For developers, this means standardized agent discovery tools, seamless protocols for interagent communication, and modular components to compose and scale multi-agent workflows. Join Crew AI, Langchain, Llama Index, Browserbase, Cisco, and dozens more.
29:56The agency is dropping code, specs, and services. No strings attached. Build with other engineers who care about high-quality multi-agent software. Visit agency.org and add your support. That's A-G-N-T-C-Y dot O-R-G. Yeah, yeah, that's interesting. And in your case, it's applying to support staff globally. Yeah. Is there, so where do you guys go from here? Are you leaning into, is the customer support market so huge that there is market share for all these different companies? Or do you end up specializing in medical customer support or automotive customer support or something like that? Or once you've tackled customer support, I mean, it sounds like this workforce management, there are a lot of other applications beyond customer support.
31:11So what direction do you see yourself going? Yeah, I think AI agents and customer support should keep us busy for quite some time. You referenced a couple of fairly large, well-funded companies that have entered this space. And I think that investors don't always get this right. But it is a reflection of a fairly large market. There's hundreds of billions of dollars spent a year on labor and customer support all over the world. And just to give you a sense of it, we're just in the early days and we have hundreds of thousands of people on our platform. and over 50 % of them are outside the US. So it's just a huge labor footprint.
31:56And yeah, putting like a 50%, 60 % automation dent in that is like pretty consequential from an economic perspective. So I think there's plenty of market. And the other thing that's interesting about like the history of customer support is that there are a lot of really big fragmented, It's a big software market as well. A lot of people don't know this. Service cloud is Salesforce's largest product by revenue. And it has been for a very long period of time now. And Salesforce is not even the biggest one here. The nice company I mentioned, Genesis, came out of Bell Labs. You go all the way back to the 2000s, there's a company called Live Person that went public in the year 2000 doing AI chat.
32:48the conversational AI and so on and so forth. So like, it's a big software market, a mature software market. And one that now is kind of clearly poised for disruption. Satya talked about it. Jensen talked about it, you know, from Microsoft and NVIDIA respectively. Like, you know, what are the applications of AI that makes the most sense coding customer service? But I think that there's a lot of space and it's a market that's used to being fragmented and having a lot of players. You know, what I think is interesting is that maybe even on like the tech infrastructure side, I think in customer service especially, like we talked to a lot of customers where, you know, that question like, how's this different from like a, is this just a chat GPT wrapper?
Read the full transcript
33:40Why can't we do this ourselves, right? it. And I'll say it's not. There are a lot of different elements of this. And we use different models for different steps for sentiment detection. We talked about the voice, stacking text-to-speech, speech-to-text, the answer computation, using Claude versus OpenAI, the reasoning models, and like reasoning across workflows and agentic workflows and then using like different elements of the stack for like the RAG for knowledge answers. So like it's actually like a very complicated set of architectures. And then like ironically, we have found that building an AI, because things are improving so fast, it actually gets harder to, like the model layer, the LLM layer, It gets harder to build at the application layer.
34:38And what I mean by that is, if you think about building SaaS, it wasn't actually that hard. I think it's a little bit harder than most people think, but it wasn't actually that hard. You're like, let's choose Amazon, AWS, or let's choose maybe Google Cloud or Azure. They're going to be around. It's all going to be the same stuff. Database, it's all well-tested stuff. And it builds around what customers need. so you don't really have to make hard technical decisions in a world where like uh what's the best llm going to be a year from now yeah what's the best reasoning model going to be a year from now what's the best voice provider going to be a year from now no clue well then we have to either architect a system that can kind of like pick and choose stuff and it's not stuff it's not directly interchangeable like you can't just like pick up open air and like slot in anthropic without any work like you have to design a system that can do that um and then you have to make technical bets.
35:30You have to kind of go read the papers and say, okay, like 11 labs versus Cartesia is one of the like voice decisions or like a base 10 or together AI unhosted. Um, well, Cartesia says they have a state space model and like, so, so, so where's this going to shake out? Right? Like if you make the right bet, you're golden. If you make the wrong bet, you have this 30 % tax probably for the next year or two years, either like your product is worse or you have to go rip it you know rip out this key part of your infrastructure and put in another piece so um ironically building at the application layer is harder than ever with llms getting better faster yeah have you guys built your system so that you can easily swap llms or other components yeah that's exactly right that's exactly right and um you know i think we were um cogent enough to do that with the foundation models.
36:28And so there was an outage one day, I forget which one it was, but it was a multi-hour outage on OpenAI. We could just press a button. We actually have a literal button in our office. Press the button, flip it to Claude. And the features of it are different. It's kind of like personality or, you know, style is different. And like the way you prompt it is different. Like, so that's some of the technical depth. And then, you know, everybody talks about evals. The evals you need to know what the, you can't just like turn on a model. Like, you know, like when, when Chachapiti launches a new model, you need to know that it's going to work.
37:10And, you know, I knew that at the architecture level, but even just to illustrate, like, you know, I read this tweet from Andre Karpathy and he was like, there's two models you should use as a consumer. 4.0 for easy stuff and 0.3 for hard stuff. That's it. And I was using 4.5 like a dummy. Like I have pro. I was using 4.5 and it was like, you maybe want to use 4.5 if you're doing creative writing, but probably not. And I was using 4.5 for everything because I assumed 4.5 is higher than four. So it's hard to keep up with this stuff and to know. So yes, we've architected our system around knowing what's the best model, being able to slot them in easily.
37:45But it takes a lot of like actually upfront work to get that design right. And I'm certain we haven't gotten everything right. Yeah, evaluation is interesting. I had a conversation with somebody else in the last day or two about that because the benchmarks have sort of yellowed and curled. They're no longer really fresh because people have figured out how to train to the benchmark. So how do you evaluate a model when you guys are looking at new models coming on stream? Or do you just wait until the market is decided? Yeah, we have what we call golden data sets. And so we actually, you know, I think this is like not a new motion for companies, but, you know, the Palantir pioneered forward deployed engineer.
38:43you send somebody um to go sit closely with the team now our product thesis is that actually we shouldn't build the product for you over half of our automations are like built by the companies themselves rather than by us but what these people do when they sit with you is like help you define what good means and so it's like we'll show them how to do evals we'll show them how to find the like ideal form of okay like this is your question on how to uh how to introspect um your refund policy or you know one of our customers is um one of the largest delivery apps the super app in latin america um rapi um and it's like okay if you're a courier changing your vehicle registration and you have this like complex policy this is what good looks like this is what not good looks like here a bunch of examples so we build out these golden data sets um and then we kind of continually run every single time we upgrade models through all these golden data sets and we have different benchmarks for what quality means that's customer specific as well as kind of like generalized yeah um and then there is like a step which um we actually kind of borrowed honestly from open ai when you know when they had the whole like sycophancy um issue um i thought it was a really interesting insight into how they do evals of their models there's a step they call just vibe evals.
40:03I don't know when Vibe entered the lexicon, but for AI it's like, you just check the Vibe. You go through and you look and you're like, whoa, yeah, that's good. No good. But I think there is something fairly deep in that because when I was working on machine learning for fraud detection at Stripe, the secret sauce was not like, I mean, it was partially the amount of data we had and the feature engineering we did. And back then, Hadoop and Big Data was a cool thing. And how great our Hadoop cluster was, and you could compute all these features. But myself and this guy, Michael Manipat, and Greg Brockman, who's now president of OpenAI, was CTO at Stripe at the time.
40:47A lot of people touched this machine learning system. And Michael ended up being CTO of Notion. But just to give you a sense of the people, the intellect working on this, what we would do is just sit there and like click through manual reviews, like, okay, that transaction, like, yeah, looks pretty fraudulent. Good job. Like, no, I don't think so. That's right. Like, it would just do this for hours. And then, you know, just check vibes. Yeah, that's interesting. Yeah, and I mean, just as a consumer, I'll run a prompt through two or three models, you know, on two or three different tabs. And it's remarkable how different the output is.
41:31And there are some that are very clearly, some models are very clearly better on certain prompts. And so the other question I wanted to ask about the conversational element, do you do multi-language and do you do translation? if you have someone calling into a call center in the Philippines that is English-speaking and they're calling from an Arabic-speaking country, is there a translation element so that the call center, the live agent, can handle that call? Yeah, there is. And you get a lot of this for free. with like good choice of LLMs underneath because, you know, they are kind of like multilingual built in.
42:27But there is like getting it, getting the translations right and actually being useful for end customers and useful for like human support agents in the AI co-pilot setting is really important. And there's actually like a bit of a, you know, again, I studied economics before I studied statistics. So like my brain goes back to there. There's an economic part of this where um like 24 percent of our revenues in europe and when you go to europe like you find that the fragmentation is very real um like they have to serve each of these individual countries right each have their own regulatory frameworks and each speech their own individual languages and so um you know one of our customers is a travel company based out of berlin and you need a staff like a handful of people for each of these languages now if you're following the kind of like workforce management part of it and like the operations research, like when you're in the low volume setting, you're going to have to like overstaff just to be able to hit like a good service level.
43:29So you find these teams being like, we have five people that speak Estonian. We have 10 people that speak Finnish, right? Like it just like, it just adds so much complexity to the operation. And so when they can do translation just out of the box, whether it's for their human support agents are all the way to the end consumer. It's pretty transformative to like simplifying the operation. And then US companies as well, kind of expanding into Europe. I mean, we have 20 % of our revenue. We've constantly been thinking about like, okay, how do we do this a little bit better? It's very hard to enter Europe knowing kind of like the fragmentation.
44:07So I do think that there's something that will change there in terms of like when translation has become a lot easier and support is a big part of the operation that holds people back in terms of expansion. Do you know a company called DeepL? Yeah, absolutely. Yeah, I talked to them recently, and they were saying that their solution is embedded in a lot of other customer support solutions, that they're the translation node or nodule. Do you guys use them at all? We don't use them. I think we've competed with them once or twice, but we know of them and you know I think it speaks to the just the ubiquity of customer support like I hadn't appreciated that everybody would touch this a little bit and so yeah it's a really fascinating company instead of technologies but yeah we we've run like a different parallel track in terms of architecture yeah i mean that's interesting what you said that that uh so many people from different ends of the machine learning world or generative ai world are touching uh customer support and as you said even jensen huang was is talking about it uh which speaks to how large a market it is but yeah it's still it still sounds daunting uh you know to compete in that but but how do you uh i asked this before but do you end up specializing in an industry or in a geography uh uh you can't you know the market is so large you can't chase every uh sector uh at once so how do you do that yeah i think um the market is very large and um you know the the trope of you need to have like focus on your ideal customer profile has definitely been true for for assembled throughout our history, but it's less about industry.
46:26There are nuances, don't get me wrong. I was at a fintech conference where they're talking about actually how the regulatory framework affects their stances of business. But if you get down to the latent variables, if you will, of what differentiates different types of support teams,
46:45first of all, every company has support. Every organization even. It's not just companies. We work with the Georgia Department of Human Services. They have customers at 311. So every organization has something that looks like support. And then the variables that actually matter are how transactional is it? Is it high volume, high velocity? Is it super hard? Like Datadog is a customer of ours. It's technical support engineering. That's pretty hard. that's going to look different from, you know, Honeylove retail, like B2C. But so, like, we pretty much end up covering every industry and having segments based on each industry.
47:30But in truth, like, it's not the industry cut that matters. It's kind of the shape of your organization. And that comes down to, like, the velocity and the complexity of the types of issues that you're dealing with. Yeah. Yeah. So in this, the platform and the offering, where are you growing and where are you spending your, putting your investment? Is it in the, on the translation end or the conversational, the voice, or is it more in, on the workforce management or has that been solved? where should we look for new developments? Yeah, with Assembled, my focus is on AI agents, like the AI automation.
48:22And so I think chat is a very competitive space. You mentioned several companies. And then voice is actually the one where I think there's the most space. It is the one where the technology underlying is kind of moving most quickly. but then to go back to the to the economics of customer support um human phone support costs a lot um you know i think some people talk about like 20 per call like some customer of ours like have been able to optimize this actually quite robustly like all the way down to single digit dollars so it's not like people are just like super profligate about phone support but AI is going to make a big big big difference there and it's both it's both the automation and the cost bringing being brought down but the you know like there's some sense in which Jevin's paradox applies here where you know you have cheaper phone support and you're going to use more of it and and what I mean by that is a lot of again going back to consumers I think companies know that consumers want to talk to somebody.
49:33But it just doesn't always make enough economic sense to do that. And so that's why they put people to chat. Like chat, the cost is something like 50 cents up to a dollar per case because you can have concurrency. You can have people working multiple tickets at once. And it's just less mentally taxing. You train people for phone support. It's like, prepare yourself. But I think with like AI voice, we're seeing more companies wanting to bring back phone support. And with AI chat, if you kind of like remove some of the work, then you can actually upscale people into phone support. So there's like a lot more texture around what's happening with AI agents.
50:18Now, I think also what's interesting in the space and where I spend some of my time thinking about is like, I think we're still not off the kind of like headline of like, AI is going to make people go away. You know, like there was like this kind of like the news cycle of like Klarna had, you know, introduced AI customer service and, you know, fired 700 people and they were going to get rid of everybody. and then they immediately rolled it back um and that wasn't surprising to me um because support is hard yeah um it's not like people are sitting around twiddling their thumbs and just like doing it like pressing buttons inside of a you know kind of like knowledge equivalent of a factory no it's like they are exercising judgment and um when you go when you go shadow support agents in these contact centers from all over the world like they're really good at what this they have all the keyboard shortcuts sorted out.
51:19They know the knowledge base backwards and forwards. They know like the weird intricacies of your product that nobody else knows. They know where the bodies are buried. Right. So there's like, they're getting through this really, really quickly. And so our thesis has always been like, there will be this kind of like hybrid human plus AI support that companies are going to have to think about. And, and, and so like, you know, when I say like I'm focused on AI agents, Like there's the literal higher quality agents, higher quality within voice where there's a great opportunity, but also like connecting it back to what happens with the human operation.
51:53And that kind of like what's going to happen with the upscaling of the rest of the people, because I think that's the missing link. Everybody's kind of focused on like this part of it, but like you got to connect this to back to what humans are still doing in the rest of support. Yeah. And because you're not managing call centers, right? You don't have your own call centers. No. So how do you ensure that the call centers are, that the human agents are using all of the data that you're feeding them so that the customer doesn't have to repeat himself or whatever? Yeah, that is the routing layer.
52:37and at the kind of like, how do we pass the right information out of the AI conversation into a ticket that makes it to the person that might have to be escalated to. So that's how you kind of like skip repeating. Like we, in this like workers' comp use case, we gather the information. There's an integration into like the underlying telephony system or the underlying ticketing system. So like a 5.9 or a Zendesk or a Salesforce service cloud. and you kind of have to do a little bit of like integration work to get this handoff fairly seamless and so they they see in context like boom okay here's everything that happened and it's like summarize as a form as possible and now here's what's next for you and by the way here's the playbook if you don't know it so i think this is where like the ai agent automation and the ai co-pilot start to collide the other part that you know gets me excited the operations research or at the kind of orchestration layer or system level thinking is um um support is kind of like this very data-driven space like moneyball is the best equivalent i could give you like we're used to messing around with data and like if you think about like designing a support operation and um you know before you had a couple levers like okay we'll hire people we'll move people around between queues.
54:00Maybe we'll cancel meetings and shuffle people's calendars around. And now you can turn on an AI agent. Well, there's this kind of routing question, what types of volume, what parts of the conversation, the first part, all of it, the middle part, are going to people with which skills? So I think that really is, aside from the direct experience at the system level, the design that we are most excited about And it's like, okay, what should go to who at what point in time? Or another way to put it, like, how do we get the right agent at the right time, the right answer? And we're intentionally overloading the agent term there.
54:39Do you think that agents, I mean, the customer support experience from the customer's point of view, right now maybe 5 % of their, I don't know what it is, I'm making that up, but of their issue is handled by an agent, you know, companies that have deployed agents, that that will increase to where agents will be handling 75 % of their issue And then 25 % will be, as you say, sort of these upskilled human agents that can handle more complex issues. Yeah, I think that's about right on the volume perspective, like plus or minus, you know, a handful of percentage points. it's like I've talked to enough people and seen our own results that's like, yes, there's 75 % like automated resolution of support tickets, which, you know, kind of like perhaps implies 25 % going to people.
55:57But there is a paradox that I don't know how to synthesize yet, which is that like a lot of the support leaders we talk to, you know, they're like we have this bot 75 you know resolution and it's not that people are making it up like there is some sense in which i think there's like overblown claims but then you like inspect you check vibes and you're like oh that's pretty good yeah that's like a pretty good answer um it's not totally made up and then and then you go look at the amount of work going to humans and and this is kind of like a unique vantage from our workforce management products like we know the total handle time of work the total volume of work and it's kind of the same yeah and then you go look at like the the cost like the labor spend and it's like it's the same and and so like all these other downstream metrics like you would presume that if like all this automation is happening like this stuff is you know kind of like decreasing that's not happening so i don't know how to square these things quite yet.
57:01But just to observe that, you know, that further informs our thesis that like, okay, I don't think humans are going away. We still have to unpack like why, but even with automation, people are not going away. Is there anything I didn't touch on that you want to, you want to say? And, and what's the URL for people that want to get in touch? yeah um so we're just www.assembled.com and i've debated with people internally about whether that should be assembled.ai or assembled.com we just stuck to our guns assemble.com um you know one last thought that i would leave you with is um we all get excited about the technology and the automation potential and if there's one kind of like common current throughout this whether that's the human plus ai kind of like stitching together of that frame or or just like what what happens with ai adoption um i think the economics matter like many of our customers you know just to go back to that point of like they have outsourced people they have optimized their operation it's been decades of people like coming to support being like okay let's optimize this let's like automate this let's do this so is not new.
58:22And so just because you can automate support does not necessarily mean it would be economically viable to do so across the entirety of the business. We are seeing people start to question now, like what they're looking at ROI. Okay. Like, you know, the AI agent is charging 50, 60 cents, but Hey, we're in Columbia, like, you know, and the wage is not that high. And you know, they can do it for cheaper. People can do this for cheaper. So, like, I think that would be a question that comes to a lot of industries now. I think support starts with it just because the data is so obvious. Just because you can automate it does not necessarily mean that you should.
From the publisher
AGNTCY - Unlock agents at scale with an open Internet of Agents. Visit https://agntcy.org/ and add your support.
What happens when AI meets the chaos of real-world customer support?
In this episode of Eye on AI, we sit down with Ryan Wang, co-founder and CEO of Assembled, to unpack how AI is transforming the future of customer service, without replacing humans.
Ryan reveals how Assembled went from a workforce scheduling tool to a full-stack AI support platform used by companies like Stripe, Robinhood, and Honeylove.
You’ll learn how conversational AI agents are handling up to 75% of support inquiries, why voice is the next big frontier, and how AI copilots are helping human agents become 15% more productive.
But this isn’t just hype. Ryan shares the hard economic truths behind automation—why humans aren’t going away, how companies are navigating global workforce optimization, and why hybrid AI + human systems are here to stay.
This episode gives you a front-row seat into how the smartest companies are rethinking support at scale.
Stay Updated:
Craig Smith on X:https://x.com/craigss
Eye on A.I. on X: https://x.com/EyeOn_AI
(00:00) Preview and Intro
(01:37) Ryan Wang’s Journey from Stripe to Assembled
(04:55) Launching Assembled
(09:49) From Scheduling Tool to AI-Powered Support
(12:11) Who Uses Assembled: Companies vs. BPOs
(14:57) Building Conversational and Voice AI Agents
(21:10) Competing with Zendesk, Salesforce & Crescendo
(23:07) How Assembled Integrates with Customer Support Stacks
(25:40) The Niche Power of Workforce Management Tech
(31:16) Why the Customer Support Market Is Ripe for Disruption
(33:47) How Assembled Swaps Between OpenAI, Claude & Others
(37:56) Evaluating LLMs with Golden Datasets and 'Vibe Checks'
(41:20) Multilingual Support and the Challenge of Europe
(45:11) Industry Focus vs. Complexity Focus
(47:43) Voice AI: The Next Big Frontier?
(50:18) The Truth About AI Replacing Jobs in Support
(54:39) The Automation Paradox: Why Labor Isn’t Shrinking




