SaaStr 849: How We Built Our AI VP of Customer Success with SaaStr's CEO and CAIO

8 Apr 2026 · 1 h 6 min · 26 chapters

Ask about this episode

Ask anything about it. ChatGPT or Claude reads this page and answers with the times it was said.

Connect VO and ask about every podcast you hear, including the moments you saved. Add to ChatGPT · Add to Claude

In short

SaaStr’s CEO and CAIO discuss building “QB,” an AI VP of Customer Success agent that replaced a sponsor project-management portal and now automates sponsor onboarding and daily follow-ups (emails + Slack), using Replit/vibe coding and agentic workflows.

Guests (backgrounds)

  1. SaaStr CEO (Jason): leads SaaStr; previously built AI tools for startup valuations; co-led agentic “AI VP” initiatives at SaaStr.
  2. CAIO Amelia: built early AI VPs (VP of Marketing first), then took over and expanded QB; focuses on agentic operations for SaaStr’s sponsor/customer workflows.

Key claims

  • QB ships customer-requested improvements faster than off-the-shelf software (“build it now”).
  • QB reduces human/agency effort dramatically (claimed ~70% fewer billable hours; “3x multiplier”).
  • AI hard costs are capped: ~$200/month token usage across multiple SaaStr AI apps; not yet exceeded.
  • Better compliance/engagement because customers don’t need to set up or manage extra tools.

Notable examples

  • Sponsor onboarding: 13 core tasks with subtasks; QB identifies gaps from uploads, reminds sponsors daily, and sends individualized updates.
  • Personalized weekly sponsor emails: QB generates sponsor-specific instructions and registration codes in minutes (vs newsletter-style generic links).
  • TikTok sponsor example: uploaded nearly everything in a day; QB tracked remaining tasks and codes.
  • Speaker submissions: QB prevents overbooking time slots by graying out full slots.

Written by AI. May contain mistakes. Listen to the episode to check what was said.

Chapters

Tap a time to open that second in VO

The Magic of Instant Solutions

0:45 to 4:00

Discussion about the flexibility of custom-built AI solutions over off-the-shelf software.

“but if you get something pretty good into production working, your ability to enhance it for what your customers want, it is magical.”

Building the AI VP of Customer Success

5:00 to 8:00

Overview of the development and features of the new AI VP of Customer Success.

“I'll let Amelia drive, and then I'll kibitz and comment.”

Evolution of the Customer Management Tool

8:00 to 13:00

Insights into how the project management tool transformed into an AI-driven customer success tool.

“And so, you know, having Vibe good at a few different other apps already, we thought, you know, we could probably make something better.”

Enhancing User Experience with AI

13:00 to 14:02

Discussion on how the new tool improves user experience and operational efficiency.

“And it was also one of those things where if one person on the team of a customer of ours submitted something, like if I submitted something, Jason couldn't see it.”

Automating Onboarding with QB

14:02 to 15:55

Learn how QB automates customer onboarding and management processes.

“A lot of the onboarding work customers don't want to do.”

Gaining Insights with Automation

15:55 to 17:02

Discover the insights gained from automating customer management tasks.

“it was a big unlock for us to see like something like this one, we previously didn't have this level of insight into, right?”

Dramatic Reduction in Human Hours

17:02 to 17:48

Hear about the 70% decrease in hours needed due to automation.

“And it was dramatic, the amount of hours we've reduced not only internally, but also with our agencies and production teams.”

Cost Analysis of QB Implementation

17:48 to 20:54

Explore the cost-effectiveness of implementing QB for customer management.

“Like basically across the board, I saw something like a 70 % decrease of literally billable hours.”

Personalization in Customer Communication

20:54 to 24:55

Understand how QB personalizes communication to improve engagement.

“And there's some good questions in the chat I'm going to get to next.”

Comparing Old vs New Approaches

24:55 to 28:00

Learn how communication strategies evolved with the introduction of QB.

“Like we couldn't get people to really log into the one last time.”
Show all 26 chapters

Automation of Sponsorship Processes

28:00 to 29:00

Learn how TikTok improved its sponsorship process efficiency.

“linked folks to you know boo selection is kind of dated here it says it started we'll email you once the window opens.”

Developing a Specification for QB

29:00 to 30:40

Understand how to write a spec for a Vibe-coded app effectively.

“But they did almost everything in a day.”

Iterating on Application Specs

30:40 to 34:20

Discover the process of refining application specifications using AI.

“That would suck because then that person would be like, oh, great, you're giving me a free speaking session.”

Testing and Production Deployment

34:20 to 36:20

Learn the importance of thorough testing before deploying applications.

“So for us, we took our spec, we loaded it into our Fave Vibe Coding Platform.”

Managing Sensitive Data in AI Applications

36:20 to 40:00

Explore best practices for handling sensitive data in AI systems.

“It's got to actually freaking work in production.”

Challenges in App Deployment

40:00 to 42:01

Understand the common challenges faced during application deployment.

“Would it be the complete end of the world?”

Deployment Insights for the AI Customer Success Agent

42:01 to 45:50

Learn about the deployment challenges and solutions for the AI customer success agent.

“So hopefully that's more secure, knock on freaking wood, than most things.”

Enhancing Customer Interaction with Real-Time Insights

45:51 to 48:10

Discover how real-time features have transformed customer interaction and satisfaction.

“That's basically how we turned QB from a somewhat generic customer success portal slash project management tool into an agent.”

Building Connections and Overcoming Challenges

48:11 to 50:10

Understand the intricacies of connecting different systems and managing data.

“I think, too, how we evolved QB into the name was, yeah, a little bit of the play on the QBR.”

Daily Maintenance and Management of AI Tools

50:11 to 52:10

Explore the importance of daily oversight and management of AI systems.

“And obviously there's data in there, but there's not that much data directly in QB.”

The Value of a Human Touch in AI Deployment

52:11 to 55:56

Learn how human involvement enhances AI solutions in customer success.

“Whether it's little, whether it's things that will break, like the initial version of Salesforce integration kept breaking.”

Building Custom Solutions vs. Off-the-Shelf Software

56:00 to 56:50

Learn about the balance between custom software development and using existing solutions.

“If you decide that there is a use case where it's worth your time, and again, it has to be above the line.”

Leveraging AI for Enhanced Customer Success

56:50 to 57:50

Explore how AI can automate customer success tasks and improve client relations.

“Anytime with off-the-shelf software, someone asks you for something that isn't obvious how you do it in the app, the answer has to be no, unfortunately.”

The Hybrid Approach: Balancing AI and Human Interaction

57:50 to 59:00

Understand the importance of combining AI with human support in high-stakes customer interactions.

“Again, maybe for maybe smaller starting up, you've got one CSM for 50 accounts.”

Adapting to Customer Preferences in Communication

59:00 to 1:02:00

Discover how customer communication preferences shape support strategies.

“the 95 % of stuff that can be automated.”

Identifying and Addressing Customer Success Gaps

1:02:00 to 1:04:20

Learn how to identify areas for improvement in customer onboarding and support.

“But at least you got the emails of what you needed to do.”
Hear the part that matters, and keep it.Open this episode in VO. Double tap your headphones to save a moment as you listen.
Get VO free

Transcript

Automatic transcript. May contain errors.

0:01Welcome to the official Sastr podcast where you can hear some of the best Sastr speakers. This is where the cloud meets. Up today on the Sastr podcast, the magical thing that Amelia said, it's so magical, is that unlike off-the-shelf software, when a customer asks you, hey, could you do this? Instead of saying no, or asking your CS person if it's on the roadmap for the next 24 months, if it's not that complicated, we go into Replit and just say, build it now. we can ship it that day and we're not engineers. To say that is magical is an understatement. Anytime with off-the-shelf software, someone asks you for something that isn't obvious how you do it in the app, the answer has to be no, unfortunately.

0:42We're stuck with what we got. So it's not a reason to start there, but if you get something pretty good into production working, your ability to enhance it for what your customers want, it is magical. Hey, everybody. Saster Annual will be back May, 2026, the world's largest SaaS and AI gathering for executives with 68 VP level and above attendees, 36 % CEOs and founders, and 25 % were AI first professionals. It's the very best of S tier attendees and decision makers that come to Saster Annual and AI Summit each and every year. Lock in your spot today. Use my code Jason100 for exclusive savings.

1:22Get your tickets at podcast.sasteranual.com or just use code Jason100 when you check out. See you there. Saster Annual and AI Summit 2026. It will rock.

1:35Welcome, everybody. Welcome. All right, sweet. Let me share my screen. Maybe for a little context before we start. Amelia will drive most of this. Just I know a lot of you have followed our agentic journey. we started off rolling out a bunch of AISGRs. We built a bunch of AI VC tools that did a million startup valuations. And then we started building our own agents. We talked earlier on AI Workshop Wednesday, and we'll do another one on our AI VP of Marketing. We've written a lot about it. It really runs our team meetings and every day logs into Slack and tells us what to do and stresses this out and nag this it's pretty good and then amelia built that she built i built the early ones then amelia took it over built our ai vp of marketing for what she needed and then built and she'll she'll drive talk you through this what now we see is our ai vp of customer success it started off as a project management tool for our sponsors at saster annual saster annual in may please everyone come we'll have 10 000 folks the best of ai and b2b may 12th through 14th and it quickly grew into this AI VP of customer success tool.

2:48And I just want to highlight two things and then I'll let Amelia show it to you so you can see it. One is just at a meta level, this is the best thing we've built so far, this AI VP of customer. It works better. It has fewer bugs. It adds more value versus you didn't have time increased. So I think the obvious reminder is if you're going to build your own apps, five of your own apps and replit and lovable or v0 or others just understand you'll get better and better as the journey goes on like everything and i started this journey amelia took it over took the baton the vp of marketing is pretty good but this one's even better and the next one will be even better so it may take you six months to build the ai agent of your dreams you may need to build multiple agents and apps to get there but ours just keep getting better and better okay and the second point, this one is so important.

3:39We're going to show you everything our AVP at customer success can do. And I know a lot of you, and what I want you to do is see what we built because you can build it yourself. If we built it, you can build it. We built this with no engineers and it adds dramatic value to our little tiny team doing eight figures of revenue. What I think isn't helpful that I see a lot of folks do on social media, and it's fine that they do it, but I think they're missing the point. They're like, oh, well, that only works for Saster. Oh, that only works for a media or community or events business. No. First, anything we do that is so niche to us, we don't think will help anybody.

4:09We don't share that stuff with you. We don't, we don't want to share like the hyper niche stuff that only helps if you want a popcorn machine in your booth. Okay. We're not sharing that stuff for the most part. We're sharing stuff that if you think about it is universal to software and B2B companies that what is universal is going back to a larger install base than you can realistically touch with humans. Going back to them when they have hundreds and hundreds of deliverables and things to do that is difficult for a human to follow up. So what I want you to do today, and then I'll let Amelia take it, is not look at some of what we built and say, oh, that's an N equal one app specific to SaaS.

4:45Or it is, that's true. It is an N equal one app we built, our own AVA. But think, wow, what if I built my own version of this, customized to my business, not an off the shelf piece of software. Could I tweak the workflows that Sastra has built, the follow-ups, the dashboards, the agent, and do my own version? Because you probably can. That's the better learning from this. You probably can. So I'll shut up. But think more about this at how can you make a prime version and iteration of this for your own business rather than take shots at how any individual marketing campaign or workflow we do isn't what you need in your vertical Sastra dentist.

5:19That's not the point. So thanks. I'll let Amelia drive, and then I'll kibitz and comment. yep love it thanks for the thanks for the tee up i think it's super helpful for folks to have some context i added some context here as well just more specifically on our ai vp of customer success that we'll get into in detail and then i go through the steps of how we actually built this so first and foremost if you want to see keeping in action just to see like what we've built you can go to sassresponsors.com we've shown it before it's changed a lot since the last time we've shown it. You won't be able to do everything because if you're not a sponsor, you can't sign in.

5:58So if you're not one of our customers, you may not be able to do everything in it without signing in. But it was one of those things where we did decide when we were building out this platform and then it turned into an agent that not everything needed to be gated. Some of this is still, you know, folks have multiple people on their teams that are part of, you know, our customers, our sponsor teams. They have agencies, they have folks who are CEOs, They're not going to want to log into something like this. And so we purposefully only gated things that required, you know, data entry, hotel, you know, things like the registration codes you can't do.

6:33You can't submit anything until you log in. Keeps it a little bit more secure, but you can go to sassresponsors.com and see what it looks like for yourself. the other thing you can do to jason's point if you do make something like this for yourself is you can actually give this url to your your vibe coding agent and say hey this is one i saw that i liked or i like this format if you're if you're going to do something similar that's like a customer portal or customer management tool or whatever just at the very start you can't actually give it urls like this because it can pretty much copy it so you can use it as kind of like a format too so feel free to use it as a format so let me go full screen for a bit now and then we'll jump around between the live front end of qb which is sassresponsors.com there's some other things too i'll show you that are not just contained in the website and then the back end which in this case lives on replit but we go slideshow all right great all right so yeah something jason touched on which is important is QB did not start this way.

7:37That was not his name. He didn't start this way. He was just meant to be a custom, basically project management tool that I wanted to use with Vibe Coding in this day and age to replace an existing tool we literally paid for for the last two years that had no AI functionality at all. It had no AI functionality, nothing agentic. it was very much just a portal. It was just like a customer portal. People could log in and submit us things, which they can still do now, but you'll see the key differences in a moment of, you know, why it was worth putting all this extra effort into VibeCoding and putting, making it so much more agentic and hooking it up to different things.

8:21And so you'll see that in a second, but that's, you know, that's really what it started as was we took something that wasn't working that great, didn't see any vast improvements on, was kind of hard for both us and our customers to use. And so, you know, having Vibe good at a few different other apps already, we thought, you know, we could probably make something better. But it did evolve from there, right? So I say that as a, if you see everything that Kiwi does now, that he didn't start that way. And we built him in January. So he's had almost three full months now. I add things to him all the time, every week.

8:57Sometimes it was daily for a while in the beginning, just as folks were starting to use it in production. And so he didn't start this way. He didn't start fully agentic. That was actually not even my end goal. I didn't even think about that. I just wanted something better to replace something we were using that wasn't all that great and was kind of causing some friction. And I thought we could save time by doing this. I didn't realize until after the fact how much time it would save us, how involved QB could get with our customers, how much of a better experience it would be not only for us, but for them.

9:27And so, yeah, that was kind of some downstream effects I really did not engineer in the beginning on purpose. That was more a, because it was agentic and built as a native AI platform, we could do different things with it. And so it just evolved from there. So, yeah, it really began as just a simple, you know, let me just vibe code a project management tool. I want to be able to, you know, my initial spec was, let me just be able to assign people's tasks. You know, we're going to need some single sign-on. And we're going to need to make sure it has some light automations so that people can, you know, get reminders, know what their next task is, basically so that they have a guide for their success at Saster as a customer slash sponsor of ours.

10:09so when we deployed qb into production back in jan that's all he did right so i'll preface that like even if you're playing around with him now if you're looking at sass responses.com while i'm chatting like you're not gonna see the full magic of it because you're not a customer you're not logged in and i'll show you some of those things in these slides but that's all he did for a couple weeks and that was fine right that was absolutely fine i was like you know what this is already better than what we were using previously which was like a sass tool we were paying for this is already better than what it was and so I was happy with that but then I realized he could do a lot more so a couple weeks ago I basically had a moment where you know for years and I'm sure you guys do this too or many of you probably still do this now I started doing I started to write my weekly sponsor email right I was like okay it's Sunday I usually send this on Sunday night or mondays people have it before they get too busy of you know as a customer of ours what is basically their tasks or deliverables what are high level things they know like we launched the agenda or like attendance is 140 of last year like i include some context at the beginning but then it's pretty much like a laundry list of the things they should be doing need to be doing doing a coming and then just various information right about being a customer of sastras and what would make them successful as a sponsor of SaaS Reinal in particular this year.

11:33You know, how to register their team, how they could do customer passes, how they can market their presence at the show, booth locations, all that kind of like periphery stuff. So that was all built into the initial spec, which I'll show you again in one of the slides. But once we actually, and this is, I think, key for folks to remember before we get into how we do it and reverse engineer it is again, it didn't start this way. And it definitely stair-stepped it once we deployed to production. I think a lot of what we see is people buy good apps and they never get to production or they get to production with 10 people or just their internal teams, right?

12:07Like our AI VP of marketing is just for our internal teams. And so it's built out a lot different because it never needed to be forward facing. I think one of the things we unlocked here was like once we went to production with our actual users, actual customers, and they started adding more people on their team. That's when I was like, oh, we can do a heck of a lot more with QB. since he actually is, he has agenda capabilities. We just haven't built into him yet because that wasn't his original spec, but we could do it, right? Now that I see people are actually using it, now that we see how they're using it, like we started to see, okay, who's logging in, who's not logging in?

12:44What are they doing at certain times of day? What are they not doing? We just didn't have that level of granularity before, right? Like we would just have whatever they submitted to us. That was literally it. Like our old portal didn't even tell us if they logged in or not. Like it was so hard to use. We had no insights on anything. And it was also one of those things where if one person on the team of a customer of ours submitted something, like if I submitted something, Jason couldn't see it. Like it would, it wasn't persistent and had a lot of flaws in it. And so we just never had a lot of visibility into what our actual customers were doing until we had Quby because we built it in a way.

13:23you know we use clerk in this instance you can use other things but between how we did single thine on and how we built it into our vibe coded app we got a whole lot more granular visibility on what people were actually doing and then again what they weren't doing maybe amelia just to help folks on the screen this chart on the side this task completion yeah amelia will go more into this but to simplify this this is basically a sophisticated onboard automation okay there are And this may be more complicated than some of your onboarding or less, depending on what you're doing. But there's a lot to do.

13:57But there's essentially 13 core tasks with subtasks that each customer sponsor has to do. And you can see rather than hoping that a human does it or an agency or a third party, QB just does it, manages it, reaches out to them, tells them all the deficits, kindly reminds them, identifies the gaps, uses AI to analyze all the uploads to make sure they're the assets and data that we need. manages it each day and then pushes a slack update and an email update every single day with the gap so it follows up it manages it does it all for us and this if you have the world's perfect group of humans and they do every task they're supposed to do every single day and they update your task management tool and it's all there i guess i guess that would be as good as this but we could never find a core of humans that wanted to do these hundreds and hundreds of of onboarding management every day, especially because for us, our customers, our sponsors, a lot of times they don't want to do the work, right?

14:54And that's why you see it. And this is why it's so clever. A lot of the onboarding work customers don't want to do. They get busy. They don't know why they have to do it versus you do it. And QB just manages it all without judging or drama every single day to completion. So at least progress meters all get there. And it's fabulous. And this is, Amelia went through it, but if you think about, hey, hey, do I have any gaps like this either on my onboarding or post-launch to manage the customers after? And one of the reasons QB really means two things. But one of it is like a QBR, but a QBR every day.

15:26Instead of maybe someone does it once a quarter, QB is checking in as often as the customers can take it every single day to make sure things happen. So think about could you use an agentic product to make your onboarding better so everything happens and everyone's touched? and can you make post-onboarding more successful? That's what QB really does for us for context. And that's what you see summarized in QB itself here. And Amelia will show you more of it. Yep. Yeah. So it was kind of, you know, it was a big unlock for us to see like something like this one, we previously didn't have this level of insight into, right?

16:01Okay. At a glance, this is my admin view, right? And this is in the email that our whole team gets. So like Jason sees this, David on our team sees this, our production team can see this. Okay. These are where folks are at. And, you know, for some of these people, I'm like, OK, I just, you know, some of our diamond sponsors, I get it. They have agencies they're working with. They're getting the agencies, you know, logged into the platform. At the time, I took the screenshot. And so they were like a little bit behind. But again, I still think it's good to keep them honest, right? Like usually our top tier sponsors always also have more deliverables than others.

16:32So it was important to see that. But this is something, again, we previously couldn't get this level of insight. But then the big unlock was automating this insight, right? So to Jason's point, making sure that these folks would get the emails as often as they kind of wanted or we thought they needed. Hit this point to get their things done and also be successful, right? Like the whole point is to help them deploy it faster in a timely way that helps them hopefully do it with less stress. so for us you know this is this is what it's become now for qb and then to jason's point i i went back and looked for this time last year because we did saster annual in may of last year basically around the same dates and weeks i looked at the amount of human hours and inputs and the amount of emails we sent last year for you know the first quarter basically so january through March 31st yesterday and the same first, you know, Q1 of 2025.

17:37And it was dramatic, the amount of hours we've reduced not only internally, but also with our agencies and production teams. And so that's, you know, kind of a 3x multiplier there of how much human hours was needed. It was dramatic, right? Like basically across the board, I saw something like a 70 % decrease of literally billable hours. Like these are, again, these are agencies and production teams we work with. You may have something equivalent with, you know, CSMs or internal teams. You may do that internally just to make it more, you know, comparable for some of the folks on this call. But again, that's a huge difference.

18:15Like it's a lot. I'm like, that's literally thousands upon thousands of dollars each month for the last three months. And it compounded, right? Because January, maybe folks aren't as caring about their SASTRA annual sponsorship that's in May. You've got to think just naturally in February, March, more people cared about what was going on with their SASTRA annual sponsorship in May because it was coming up. And you might have a similar where, you know, maybe getting them deployed is a little bit slow at the start, but they've got a big launch or something, or you've got a big release coming up where you want to push them to sort of get to a finish line, right?

18:51And so that was super important for us to see that so dramatically just such a huge dip i'm like okay if you if you even weighed out the cost of us building kubi versus the amount we save it's not even comparable it's like apples to oranges you know i know people sometimes drag on all these live cutting apps take money and all that i'm like yeah but it's a couple bucks you know it's probably we've spent i don't know how much now on kubi maybe a couple thousand but we've saved tens of thousands of dollars on human input hours And so you do come out ahead in the long run. But not only that, I don't even look at it on a pure cost basis, but just from our team's perspective of how much we've needed to input with folks has decreased alongside the amount of like physical hours it took.

19:40And so for us, that's like a big jump in how we were operating with our customers in the past. I should have written more about this and I want to keep going, but on cost, because I got this in the chat, I get it a lot. how much does this cost, right? Beyond what we pay for Replit or other platforms. I put, I don't know what the AI costs are on QB, but I put a total$200 a month cap on all token usage across these apps. We can afford more, but I just wanted to not worry about it, right? That's the allowance. This is for Sastra.ai, the pitch deck uploader, valuation calculator, all the apps we've built for all times, 10K, QB, and we haven't hit the$200 a month cap.

20:21on AI use yet. So that just isn't, we could talk about it more in a way. There are certainly applications that will burn lots of tokens, you know, massive coding sessions and, and, and, but within these apps, within all the apps we built, we have not hit$200 a month of tokens. So just realize for many use cases like this, the soft costs are material. You've got to build it. You've got to maintain it. Maybe we'll touch on this or do a session. We're gonna do another one on what it takes to maintain these apps, but your hard costs for AI are probably going to be pretty low for 95 % of these apps.

20:53Yep. And there's some good questions in the chat I'm going to get to next. But I just wanted to, you know, preface of, again, I think I see some good comments and chatter in the chat of, you know, thinking about this as an unlock for, again, it's going to cost you more at the start to build it with anything like a Replicit-lovable versus LB0, of course, because you're spending more time with the agent. But I'll actually show you a couple of things where you could probably get it down things like giving it a website like ours actually super helpful for your agent if you just give it a spec and know hey i actually like the design style of this website or i like some of this functionality and the more time you build i'll get into it next but like the more time you build out that spec to be as granular as possible actually the better your agent will be and it will keep your cost down because then you don't have to keep iterating with it but that's just a little bit aside okay so i'll show you a couple more things and then i'll show you how you can reverse engineer it.

21:45So this is also another good example, right, of how QB actually went from customer slash project management tool, a little bit of both, to fully agentic. So back in the day, I put a little then and now on the screen here, but back in the day, right, again, static, no single sign-on, no way we could really track anything in any sort of, not even a dashboard, not even analytics, nothing, right, just kind of hope for the best. So minimal reporting required A lot of manual human hours, as you saw, that we had to supplement either with ourselves or with our, you know, outside third parties, which cost, you know, significant amount of monies.

22:22And then when we email, this is the important thing too, when we emailed folks of what to do for the last eight years I've been at Samster, it was always newsletter style, even for customers, right? Even for diamonds sometimes, which now I would never do. But the set of information, again, not individualized, not customized, due to either lack of time because things got really busy at faster or lack of want. And I think this is important, too, because Jason put this in the article. Like, I tried to get more of our agencies in your past to do something that QB has done now, which is why don't you take every single customer of ours that's a sponsor, email them, you know, their registration codes.

23:04Every sponsor has a set of at least four registration codes, so they already didn't want to do that. And she also, you know, give them a little update about where they're at in either, you know, if they still need to pick their booth or not, where are they at in the queue, if they haven't logged in yet, can we see that, you know, we would try to basically finagle the data, which nobody wanted to do because it wasn't all in one spot. So I literally just couldn't find, I couldn't find people to do this. I literally tried. I could not find people who were like, okay, I can sit down. You have a hundred sponsors.

23:36I got four links for sponsors. That's 400 links. I got to go and find. Then I got to see if I can figure out if they've been invited to the portal or not sort of manually. I can't really see if they've logged in unless they submitted something. That's really the only way to tell. And they didn't want to do it. So like in years past, I've had kind of hit or miss on folks actually doing this with their customers. And when it did happen, I would say it only happens maybe once. And it took that person a week. QB in the screenshot on the right, you'll see sent all my sponsor emails for the week, individualized, highly personalized, highly customized.

24:14In minutes, literally, you can see these are all at 1111, 1112. You know, he's got to go to Resend and send these. but that aside cubie was done with this in 10 minutes 100 people got a highly customized personalized email saying exactly what they needed to do exactly where they are unique sponsor and like updates like we have people who don't do boosts at sastra they do things like lounges they have custom deliverables or they have extra signage because they're on like the lanyards they got all that i didn't they didn't have to go look for i didn't have to have a human go look for or forget that they were the lanyard sponsor cubie just remembers all this and he remembers everything about every customer of ours, every like little niche thing that they have going on.

24:54He just remembers all this and he does it instantly. So again, just a huge unlock here that it's now, you know, so personalized to the degree that our engagement, I put it in a previous slide here, but like our engagement to our users, to our customers has gone up more than tenfold. Like we couldn't get people to really log into the one last time. And to some degree, I was like, you know what it's fine like we'll just send them their registration codes they can just upload they could just email us their booth graphics that's how people were doing it last year now i have outside of the screenshot you saw i have basically everybody but three people vlogging that's a dramatic uplift in how people are also like interacting with us and how they don't mind that it's an ai i don't even know if they've realized until this webinar that most of it was It's an AI and not us.

25:47I think a lot of people thought it was me and David. They're like, because we're copied on QB, on the things that QB does, they're like, oh, hey, or they'd be like, hey, Sastr team. I'm like, yeah, you're just talking to QB right now, but that's okay. I think you hit something that I didn't fully realize. So you said it, this unlock, which is think about on the other side when you're buying a product, right? And then some vendor sends you another product you've got to log into and train and set up. Like, you just don't want to do it, you know? And the fact that QB has epically higher compliance means even if it wasn't better than off-the-shelf software per se, it would be worth it alone because it removes, we've been able to build it, you've been able to build it in such a way it removes all that friction, right?

26:31It's not another, you know, when someone, like I was asked the other day by one of our partners to log into Asana and set a bunch of stuff up for them. I'm not going to do that. I pay you five figures a year and you want me to create another Asana account and upload stuff for you and then use some weird, you know, Okta account to log into your Asana. Like, I'm paying you, right? And so, so many of these post-sales products, post-sales motions put too much of a burden on the customer. And so, no one just does it. Like, forget about, one, the humans wouldn't do the work prior to QB, right? But the software we use, people didn't want to use either.

27:11right? They didn't want to use it. So that's a line. Another reason to do it, to vibe it yourself is that people just won't use the now mediocre software because you're asking too much of the customer. You're not making their lives easier, right? You're making their lives harder after they give you money. Yep. Okay. So this is just a quick example of one of those emails I was just prefacing, but you know, the screenshot before is basically QB doing this all in a matter of minutes. and then here you can see the before and after right so here is what we used to send people again and this is literally i took the screenshot from march 3rd 2025 this is just a year ago we are sending it newsletter style you can see it here here's a generic link to our portal which most people didn't bother to log into here's a link we do also weekly webinar just for sponsors that i linked folks to you know boo selection is kind of dated here it says it started we'll email you once the window opens.

Read the full transcript

28:08I'm like, now everyone's picked for activations. This is a huge pain in our butt that we've been able to automate with QB separately. Things like travel schedule, all that stuff. So again, very generic to if you go to the one on the right. And I picked one of, I picked TikTok, who's a newer sponsor of ours. They've, they've, I should say they sponsored in the past or they're, they're newer signing on to Sastre Annual specifically, but they got everything done in like a day. And again, this is something where TikTok specifically, last time they did London was very slow to submit stuff. Big company, right?

28:40Like slow to submit stuff. We couldn't get them to really turn anything on time. I remember going to London and being like, TikTok stuff is not done. Like I don't have logos. I got nothing. And so even just the dramatic increase of TikTok went from being kind of a pain in the butt sponsor because I couldn't get them to do anything to they literally uploaded everything, almost everything. You can see they skipped two. They still have to do two more things. But they did almost everything in a day. Again, just made it so much easier for them. This is, you know, screenshots of their email. They can see exactly what they've already completed, the last two things they have to do.

29:16Their ticket codes are in here specifically. That's not in the newsletter style. They click this, it goes to their TikTok-specific registration codes. It goes to their TikTok-specific discount code. Again, just things we couldn't do. All right, so I'm going to get into how we deployed it, because I see you all asking about that in the chat. So if you want to reverse engineer QB and make your own and deploy your own similar agent, here's what you should do. So let me back out of full screen for a second. And if you're wondering, the slides I did put kind of in the chat, closer to the beginning, but they are there.

29:51So I see you guys here. But yeah, once you access it, first write a spec. So you can see here, I actually put two things. because I put my original spec, which is the one on the right. It's actually not that good. I looked at this the other day and I was like, it's terrible. So, but it's still a good example. So if you've never written the spec for a Vibe-coded app, this is still a good basic level example, I would say, of how to write a spec for your Vibe-coded app. Basically tell it everything you want, right? So when I was going to build QB as a portal, I thought, I was like, okay, he needs some user flows.

30:24He needs a dashboard for me. He needs a checklist for all of our customers. he needs to be a hub for everybody right all the information they need so for us that's logistics details any speaker sessions etc he needs like an asset library right he needs some sort of training he needs to be able to have uploads single sign-on everything in their contract you know QB should know so that he's never okay I'm going to send he I what I didn't want is that we have some sponsors who have speaking sessions and some that don't I didn't want him to send you know somebody who didn't an email saying, hey, time to submit your speakers.

30:59That would suck because then that person would be like, oh, great, you're giving me a free speaking session. No. As much as I would love to, we don't have that much time at Sanster. So there was some very important nuances there and I'll show you how I did it. I did not load those contracts directly into the portal. I'll say that right now. Do not load your customer data directly into the portal. I'll show you how I agent hop later, okay, for a security layer, but just a preface there. Things like badges that you just saw, registration, FAQs, support information. They can actually do add-on orders.

31:29Anyways, you can see everything I wrote here into it, the technical requirements, blah, blah, blah, blah, blah. You know, it needs a database. It needs single sign-on. We use clerk. MVP in future phases. And then, okay, all this. Okay, so that was V1 of my spec. There's a link. You can see it. If that looks intimidating, if you don't know how to write a spec like that, it's okay. Just start in Claude. Don't start in Reqlid or Movable. and just say, I need help writing a spec for a sponsor portal. And it will help you do it together. You can do it in the Vibe Coding apps, but we both have found you get a double benefit if you write it in Claude and then get a spec out of it and then put that in the agent and then kind of tweak it again, right?

32:09That's how we like to do it. But you don't have to know how to do all the bullets and everything that Amelia said. Just iterate it, right? And you don't need, and to be clear, if folks haven't done this themselves or they haven't done it well, in 2026, you don't need to be a prompt engineer. Like you don't need to know. That is dated when you need to be a prompt engineer. Okay. You just need to talk with Claude or I guess chat GBT. We prefer Claude and just say, I want to build the spec for an application. Here's what I wanted to do and write up all the things you want to do and just iterate it.

32:39You don't need a prompt magician. The agents are so good. AI is so good that that's dated. Iterate it. Make sure you understand everything is it, then give it to your vibe coding app and let it run with it. Amelia, go through it. But yeah, it is not, this is, you do not need to be an engineer or some prompt wizard in 2026. Those days are long behind this. And again, that was my simple one. That was one I started with. If you're intimidated by it, then just use that one, right? If I'm just going to try and recreate Amelia's first original thing, that's fine. And that's my, and the thing is too, you can give it other people's, you could say, hey, this is the one that Sastra did.

33:12You could say, hey, this is the one that Sastra did. Here's the prompt that they use. Here's the website that it ultimately ended up as. Give it Sastrasponsors.com. You will save yourself a ton of time from the work I already did. So do that too. But second, here's my, I asked KB this week, right? To give me what it would consider the spec now. And you can see it's a heck of a lot longer. It's got a lot more to the tech stack because we added some agent hopping stuff. It's got some more theming and design. It's got some more nuance basically, right? Because like I said, as we started using it, we saw that we could use it as more of an agent and less of a straight up portal.

33:48So you can see it. There was literally nothing about emails in that original spec. Now it has a whole schema for emails and email blasts and how it's going to route things to people. Public faces versus, you know, not public faces. Like the task lists are more built out. So if cost is one of your concerns, I would say you want to get your spec closer to this one than my original one. Because again, benefits of doing this in Claude versus doing an agent. At the end of the day, it's still gonna be a little cheaper to write this with Claude or ChatTBT. more fully baked out for you than it is to put it into any of you know the major vibe coding apps directly into the agent so you guys can produce this it's linked in the it's linked in the slide so you guys you can use it again if you want to use it to your benefit so all right so first things first write us back again the more granular you can get the better but this is not how my spec started so if you don't get it all perfect it's fine the bigger thing here is to get it into production.

34:45That is really the goal. Just getting into production. Specs aside, but specs do help. Two, right? Okay. So for us, we took our spec, we loaded it into our Fave Vibe Coding Platform. Again, you can use Replit, Lovable, Versalvi Zero, any of them. They're all also going to be at Sastr. So you can talk to them there too, and they will show you how to do it. If this intimidates you, they're going to all be there in May. It's only five weeks away. So you can also just do a follow up there with them. Just go to their booth. But what you're going to do next is you're going to give the agent and your Vibe Coding Platform the spec.

35:21You know, you can give it some high level design. Again, I gave it a website I already liked that we already had when I first gave it to the Replit agent in this case. And I said, here's my spec. Here's my kind of like websites that we already have going on because I like the design. I like the look and feel. Here's some other, I saw other people's like customer knowledge bases that were really good. I was like, these are the ones that I want to copy. And so give me, hit me with your best shot. And Keebee does not look the way he does today, but he looks pretty good. And so the first thing I did, and this took the longest amount of time, is I had to test literally every single function.

35:59Everything. Sign in, upload your logo, you can see here, submit your address. I tested all of these one by one to make sure that before I sent it to our first customer, it wasn't going to break Because my biggest fear when I was rolling this out was this all seems really fine and dandy, but what if it breaks? If it doesn't actually get into production and people can't actually submit to us the information they need or get information back from us, agent or not, then what is the point, right? It's got to actually freaking work in production. And so I tested everything one by one, basic or not, using AI or not.

36:32I tested every single input and output in Quby. some folks are asking the chat can you see qb in action just go to sashresponsors.com you could see it now you won't be able to log in but you could see what he's doing then we had to hook up email capabilities right and i at the time i was like i'm just gonna hook up email so i get an email then obviously we realized he could email everybody personalized you know create a database most five coding apps will do that by default sometimes you just need to make sure you make one you know port over any content any knowledge you want again this is a big thing sometimes you can crawl your website if you need to move some you know if you've got faqs lying around that's just like a google sheet it's fine just give it all give it all to the agent except you know sensitive data don't give that to the agent give everything else to the agent that's not going to be sensitive but yeah i literally tested everything and then this asian hop thing i've i've said a couple times is for sensitive data, never give it to your agent directly.

37:34Never, ever, ever. I did not, again, this is a, we call him QB now because he does real-time QBRs, but at the very beginning when I wanted him to know all the contracts, all the customers who was going to need access to the portal, I just did a Salesforce integration. I was like, one, all that data's already in Salesforce. We already marked these things as closed one with the contacts, one they close. So one, I'm not going to have to read about the wheel if I just do a custom. I forget what it's called. It's in here somewhere. I just did a custom Salesforce integration too. Then QB directly does not have that data.

38:12He has to call up Salesforce. So he doesn't have, you know, a hundred contracts just sitting in his knowledge base, which would be scarier. So I definitely agent hopped his original customer database and ongoing database. is mostly in Salesforce. And then in terms of like specific users and people who folks add, again, we use clerk for single sign-on. So all that lives in clerk, he doesn't have that directly to the point where sometimes he forgets who's in clerk or actually he doesn't forget who's in clerk. He just does this annoying thing, which is super nuanced, which he sometimes will not send it to people that are pending.

38:50But in single sign-on, he'll be like, I'll send it to Jason and Amelia because they logged in as part of the Salesforce team, but I won't send it to Justin because he hasn't logged in yet. And I'm like, no, no, no. You need to send it to everybody. But anyways, that's how I agent hop. There's other things like, you know, all the registration links, that's from Visabo. So he doesn't have that information directly either. So I think the agents, we try to, we use Salesforce as our hub for all our agents. We've talked about it. And so there is inherently an additional layer of security by having that be our system of record.

39:25It's not perfect. The agents are still going to touch the data, right? it's beyond the scope of this. I think that if you need to store sensitive information in your app, it's okay. Just realize the more you do, the higher the burden it's going to be on you to become a security expert, right? Which you don't want to do. You're going to, instead of testing things once or twice, you're going to need to do constant security on this, constant reviews, try to break things. And we can do a different session on what we've learned there. I just don't think most folks want to become security experts. So to the extent you can, if you have your most sensitive data, like for us, we just don't want contracts leaked, right?

40:04We just don't. Would it be the complete end of the world? No, but it'd be bad, right? So we store them in Salesforce, right, instead of the agent. I think that's a good practice. But if your use case that doesn't work, I wouldn't say don't do it. Just realize you're going to have to spend a lot more time than just using the default way the app is built. You should budget hours and ongoing maintenance to making sure your app is secure as you can make it. But I wouldn't say you have to do this agent hopping, but I think it's a great best practice. Yeah, it's. It's I know it's a it's a new term. I don't think I coined it, but I just call it agent hopping.

40:43I'm just it's and it's not again, it's not that it's anything magical or that I'm in this case, I'm not even calling up agent force, which I think some people thought from the name. I was calling up agent force. No, I'm just hopping data with all my different AI tools, agents, whatever you want to call them. Again, so it's more secure and that nothing is ever in one spot. And then we do, you know, we have Zapier keys that are secretly stored, other API keys that are stored that, again, we just load different sets of data and things from other tools that are more compliant and more secure than the built-in agents.

41:20So, okay. So that's just one to number three and only go through this. Just pick how you want to deploy logins, right? If it's something like this, where you're going to have customers logging in, listen, it was a pain in the butt to do this. And candidly, I think it's gotten easier now. I know for a fact it's easier and lovable and V0 because they have a built-in. But again, just decide how you want your single sign-on system of record and decide how you want that data to get there, right? Maybe don't load it all in one spot. I segment our data a lot so that it's always hopping between different things to call, you know, it's got to call all these different APIs to figure out the full picture.

42:05So hopefully that's more secure, knock on freaking wood, than most things. all right again i've touched on this but maybe more importantly here what the biggest thing on a on a on a vibe coded app like qb is to deploy him so i just deployed him to a few folks at first i basically picked one customer at each of our levels and i said okay i'm gonna deploy to them i'm gonna see what breaks what doesn't and definitely stuff broke definitely some stuff didn't work like i learned in the first week that you know we had a i think it was a gold sponsor was submitting some tasks and they're like it's not really working i'm getting this weird error i was like okay send me a screenshot because apparently as qb's master i also have to do all the troubles i was like dang downsides of this is i can't just send it to someone and say hey fix this i was like oh it's me fixing it but i was like send me a screenshot I loaded into the agent and I was like, hey, what happened?

43:04Why is this person getting this error before we roll it out to everybody? And they go, oh, it's because you did not build in a timeout. So because this person was like, they logged in the first time and it just never timed out their login. They were just logged in for five days at a time. When they went to go actually upload something, it broke because it basically timed out. It didn't reauthenticate them. And I was like, oh again not something i thought of so i'm not perfect if i could i guess not something i thought of and so once i figured that out with the agent we built in a i think it's like 15 minute time out now so that you know you sign in to sash sponsors if you don't do anything for 15 minutes it'll boot you so that every time you log back in you're re-authenticated then you can upload stuff again things i learned from it actually being in deployment with people not things i i didn't even test for that.

43:55I was like, I don't know, because I was testing every task all at once when I was logged in. Again, not something I came across. And so that was really important to see what did and didn't break. And then also to see what people wanted to add to it. Every week we got like new requests for, hey, do you guys have email marketing company I can use? Do you have, you know, actually people, stuff like that, right? They were like, do you have more information on networking? That's always a big question we get. So we've made a whole section for networking in QB. Like we just kept adding to it and adding to it.

44:27And then people were like, oh, I want to just submit my activations to QB and not email you like I used to have to. So then we built a whole submissions and then we built a whole speaker submissions path where for the sponsors who had speaking specifically, you had a whole section of SASTR sponsor speakers and it would give you exactly what you needed to submit all of our speaker guidelines. But also, and this was magical, it would let you pick a time which i know sounds really basic but qb would let you pick a time when you were submitting your speakers and then when he saw that there was like three or four speakers at one given time he would gray it out so he'd say okay listen all the sponsors are going to submit this task on the same day when it opens because they all want to speak on wednesday they all did okay and so qb would say all right i've already had four people submit in the nine to ten o 'clock slot i'm going to gray that out so that the next fifth person who does that can't pick nine to ten because it's already going to be full.

45:20So again, things we had to do in an email back and forth that cost a lot of time that QB just did agentically because he's built that way. So we added, again, how QB is now is not how he was and he won't be that way in a week. Like now that we're getting closer to disaster, I've gotten more of these requests in the last week for even, here's the thing, now people want even more out of him. They're like, oh, hey, could you add this? Can you add that? And I'm like, we're so busy right now. But yes, I will add all these other features and functionalities to QB because I'm glad that you guys are using it, again, a lot more than you used to.

45:51So, all right, number five. Again, if you're going to reverse engineer something like this or build something like this for yourself with the Vibe Coding app is, again, understand where you can leverage the data you're going to get out of this to be more agentic. That's basically how we turned QB from a somewhat generic customer success portal slash project management tool into an agent. Like, he still does those things. He is still a project management tool. He's still a consumer management tool, but he's also more of an agent now, right? But again, he didn't start that way. He didn't get that way.

46:25You know, it's understanding where you can leverage things like this that are built this way, that has different APIs that you can have for yourself to say, okay, how can we get him to do things automatically? Even if you don't want to say Genetic, just automatically, right? Like in this day and age, again, are you doing things like sending unique links to people when you're onboarding them? Or do you send them custom kind of things throughout the day? If you're like, hey, I saw you're not using this feature that we just rolled out. Here's some tips on that. Let the agent do it. Are you sending reminders?

46:58Or are you not sending reminders and workflows that you want to be when they log in or do or don't do certain things in your SaaS tool? Let the agent do it. Are your CSMs or aren't they checking in regularly with people? Because guess what? But Kubi can do it as many times as they slash you want. As Jason said earlier, that is one of the most magical things is he will do whenever you want it to. Or you can let them pick right away. Hey, how often do you want an update? And then maybe just force some emails or updates or however they want it. If they have things to do. Honestly, Kubi this week has started doing things like collections.

47:39I was like, yo, you need to get on this because we're humans. are really slow and faster is coming up. There's other things that you can build into it. But again, if you see something's not getting done regularly, the agent will just do it, man. Like it will do it without question. It will do it very quickly and it will do it for all your customers at scale. You know, we did this for a hundred people. You could easily do it for a thousand, easily. Like maybe you need multiple agents to do it or multiple QBs, but it can do it, right? I think, too, how we evolved QB into the name was, yeah, a little bit of the play on the QBR.

48:18But QBRs have always pissed me off as, hey, customer, because, like, why am I waiting once a quarter for super generic stats? You're not telling me anything in real time. Everything in a QBR has already happened. Whereas QB, the agent, is in real time. It is what's happening now. It is not waiting for a magical quarter of a window to pass before I give you any sort of freaking insights. He is now. He is real time. He is live. He has access. He has all the data. Wouldn't you want that instantaneous versus once a quarter before you know this customer is going to maybe turn from you because you don't know?

48:57I don't know. I feel like there's a lot of power in that of, you know, again, we were guilty of this too. Like last year, we waited till after Easter annual to check in on some things. And now Kubi can just do that before the event. He's just a lot more proactive. And so, again, it's not where we intended him, but that's kind of where he is now. And I think that's really powerful to see with our customers, but it's, I'm sure, will be powerful for your customers, too. Okay. Agent Hopping, I'll talk a little bit about more here. But yeah, you know, again, we don't store everything in the native Vibe Coding Agent.

49:30We store things in different tasks for the API. I built out a custom Salesforce connected app. Had I done that before? No, but I asked the agent and Claude how to do it. I was like, hey, actually our Salesforce integration kept breaking. I was super frustrated. Jason knows this. I was like, every day this Salesforce thing keeps breaking and then he forgets a bunch of stuff that I don't want him to forget. And so eventually I was like, hey, Agent and Claude built this so that he doesn't keep breaking and that he has data more persistently. And so it led me to build out a custom agent, sorry, custom Salesforce connected app.

50:08Took me maybe 20 minutes. Wasn't that bad. And now he doesn't break. So it's great. And obviously there's data in there, but there's not that much data directly in QB. So that works really well. okay last couple things and then we'll do any sort of last q night till we run out of time the agentic piece i built out again one layer at a time it started as okay let's just do you know an email to me on who hasn't logged in or not and then not the rest of the team and i was like oh no we could do one for each sponsor then we started doing one for each customer and they got you know they're getting now as they can attest to if they're some of them are on this call I saw as they can attest to they get these weekly emails from QB and that David and I are copied on with the sponsor production team where it lists them out everything they have or haven't done what's due what's upcoming things like that and so again it just it will just trigger certain actions it will also tell me when people submit something so this week for instance all of the booth graphics are due for everyone's boots because it takes time to produce those things and again we're like five weeks away so it'll tell me every time somebody gets their booth graphics which is great i go through i check them actually previously i used to just check them myself now me and claude co-work check them with illustrator on my computer which is also very nice that saves me a bunch of time as an aside but again for our internal team it's just so much better visibility for everybody we just share this with you know our production teams that need to get like a basic report.

51:44Folks who are new can onboard really quickly now versus very slow. So a lot of agentic pieces there, but I didn't build that all at once. I think this is great. One thing just to remind folks, you can build your own version of this. Hopefully that helps. The slides are there. You've got how we built them. You do have to maintain these agents daily. We say this every single time we do it, but there is no set and forget, right? Whether it's little, whether it's things that will break, like the initial version of Salesforce integration kept breaking. Whether like today, like it sounds like 10K gave triple updates in Slack instead of one, which is a recurring issue.

52:28We know why it happens. Or you will see regressions. For example, if you haven't built software today, Amelia tested every button, every link, every upload in the app, right? as your agent gets more complicated, as you add features, it may break those links and upgrades, even though you'd be like, why I added a totally different page. Why did it break the upload button? Beyond the scope of today, these regressions will happen. It is life. And so you need to budget, not only just like when we've talked about our AISDRs, have you have to review their emails every day for a long period of time, you have to do it.

53:03When you build your own agents and your own apps, every day you have to check in on how they're working, check in on their functions. And my hack is make sure you have them send you an email status update every single day. Have them build that because you'll see stuff break in the email and then you'll realize things are broken that you can't see. But just realize anything that's as good as QB, it is great. It has replaced many humans that would not do the work. It gives us 10 times the scale, gives us everything. And between the million and me, we're checking in on it every day. Right. Just like you're humans.

53:34And so just realize if you want to do this, do you need an agentic deployment expert, as I've talked about before? Maybe, maybe not. But you need a human who cares enough to manage QB and 10K every day or it will fail for you. Yeah, it's really, I know I put some before and after slides in there, but it's really been night and day. And that's why at the end here, I officially call him QB1 now because he is literally a quarterback. he is our whatever you want to call him our AI VP of customer success QB1 QB this dude is his what I rely on now like I I can't see myself going back to how we were doing it I wouldn't want to but also I think just for the lift we've gotten from our side of the fence but also as our customers and sponsors have seen where again it's more tailored people can still talk to and again And maybe I didn't say this enough in the first 58 minutes.

54:28People can still talk to us. It's not like we said, hey, here's just QB and that's it. We weren't like, we're going to drop you totally into the AI. And if you can't solve your problem, you're on your own. There's a reason we're copied on every single QB message that goes out to our customers. Because when they reply to it, sometimes we reply. Sometimes it's like something nuanced of, yeah, to Jason's point today, like somebody's like, hey, I submitted everything to the portal, but it looks kind of funky. And I was like, okay, let's go take a look, right? It's not like we're dumping them solely onto the agent to deploy, to be successful at Safster.

55:06It's something where we're backfilling. We're very supplemental. You know, sometimes they do want to talk to us through ideas of what they want to do with their booth. A lot of our diamond sponsors, we still do weekly calls with them. I still do weekly webinars for all the sponsors. I get on, I probably was on 10 sponsor calls last week and I'll be on another 10 this week. We're still doing all those things. So I do want to say that too. Maybe I should have said it sooner, but it's not like we drop everything in customer success. It's just, we're doing a heck of a lot more of it with QB. And I feel like that's also true just from the fact that people keep asking us to add stuff to him, right?

55:41It's okay. So it's, it's not only helpful for us, but it's become more helpful for them because now folks actually ask for features and want to get more things out of it in a way that we previously wouldn't have been able to do and serve because we would just run out of time or I just couldn't find people who actually would send 100 sponsors for unique links each week and keep them on task, right? We just couldn't get that done. If you decide that there is a use case where it's worth your time, and again, it has to be above the line. It has to be worth... If you can do this all the notion and it works great, don't build it yourself.

56:17The 90-10 rule applies. Buy 90%, buy 10 % at the most. But if you decide to build something like this and you get into production, you get it working, you invest time, the magical thing that Amelia said, it's so magical, is that unlike off-the-shelf software, when a customer asks you, hey, could you do this? Instead of saying no or asking your CS person if it's on the roadmap for the next 24 months. If it's not that complicated, we go into Replit and just say, build it now. We can ship it that day and we're not engineers. To say that is magical is an understatement. Anytime with off-the-shelf software, someone asks you for something that isn't obvious how you do it in the app, the answer has to be no, unfortunately.

56:59We're stuck with what we got. So it's not a reason to start there, but if you get something pretty good into production working, your ability to enhance it for what your customers want it it is it is magical that might be the biggest the second biggest lift of all is the ability to to to add to vibe additions not to vibe the 1.0 but to add things you didn't know you could automate before because your eight your rep a lovable v0 can do it in an hour not not a second not and it needs some testing and qa but if it's important now you can just like anything you want that is sass you can pretty much build for your customers if they want it.

57:37So that might be reason number two to do it. Yeah. I think, again, we have literally fought with even people who don't want to do this either internally, outside agencies, you probably find some of your CSMs and external teams on how much coverage they've got. Again, maybe for maybe smaller starting up, you've got one CSM for 50 accounts. That's never viable, right? Unless you do it with an agent. Now I do think that's viable with person plus agent. Then you have enough coverage. Then I think, again, that's something where you don't drop it and you don't drop them just only into an agent, but it can alleviate a lot of tension between you and your customers and focus on the things that matter, like deploying things.

58:22When you take the friction out of it, right, it's just the QB takes all of that friction away and he's going to win every time because he's 24-7 automatic. Again, as often as they want updates, he can do it. All right. Question we got, which is, do you tell folks it's an AI? I think across all of our agents, we don't tell folks it's an AI traditionally. I'm not opposed to it. I don't think there's anything wrong with it. I think our folks, I think, listen, our average deal size is$100 ,000. So this is still a bespoke process. Amelia, David, even me, to some extent is involved. We're not trying to take humans out of the loop.

58:58We're just trying to have the AI handle the 95 % of stuff that can be automated. So right now our customers are fine getting an email that's a mix. They will reply back to the human if they want the human or they will just do it themselves with QB. If your deal size was 1K instead of 100K, you would want to automate all the inbound and we don't have a chatbot on QB, but we have a chatbot on 10K or AIVP marketing that could be added in an hour. So we could add a chatbot. We could do all these different stuff. But at 100K, people actually want a hybrid of humans and AI. And there's kind of a meta insight there, right?

59:32People want to reach Amelia or David instantly. But they also enjoy the fact that for 90 % of stuff, they can work with an agent that's better, right? They know. And I think there's a lot of our views are very 2025 or 2024. If the agent's really good, people are smart. Like they understand the benefits of an agent versus a human, real time access to data. and very, Amelia can speak to it, but very rarely have we seen that frustrate anyone. They like that combination and they get it. They get that. Well, I think they would be frustrated if they couldn't reach a human. For sure. They'd be mad. We all get mad when we log into a poorly trained AI bot and we can't reach a human.

1:00:10I want to blow my brains out, but we don't need to do that at a hundred K price point. No. I think the thing is too, and something I hadn't thought of until now too, is like with our very top tier accounts, So we're talking, you know, multi six figure deals here, like more than 100K. We go to where they want. OK, Salesforce, no surprise, likes to work in Slack. Duh. Let's pick their company. They have Slack bot. There's just so many things you can do. And so we're like, great, get in our Slack. So they're in our Slack. You know, they have QB. They get the automated emails. They see them. They respond to them.

1:00:44They'll literally bring them up on calls. They'll be like, OK, let's go over our tasks that we're missing. They'll be like, OK, great. I didn't have to tell you. like QB told you. But also we're in there in our Slack, which I 100 % come in our Slack. The water's warm. That's how they want to operate. The Google team likes to be on Google Meet and Gemini and Google chats. And they also link to text me. And that's fine. That's what they want. Right. So again, QB is not the end all be all. I should have said it sooner. But for our very top for for majority of our customers, it is night and day. And for folks who want supplemental help, they can email us we respond very the thing is too like now we can respond so much quicker because we're not bogged down with all the little nitty-gritty stuff that we used to have to answer ourselves that we can actually it frees us up to answer the more important things when people ask us questions and then yeah again to the point of you know we still i still get on dedicated calls with folks i still do a weekly sponsor webinar and i for our top tier customers i go wherever is easiest for them.

1:01:43I don't presume, I don't even, you know, QB is great. I don't presume the log, you saw a couple of my diamonds haven't logged in. That's fine. That's okay. If that's the way they work, we'll figure out what works for them. And for them, it was like, like one of our diamonds was like, okay, this is great that I'm getting all the emails, but I'm just going to reply to you with a visit folder of everything. And I was like, that's fine. But at least you got the emails of what you needed to do. And I didn't have to tell you. So I think, again, there's a mix there of part of what we've done too is this has freed us up to be a lot more lenient on how we engage with our customers and the way they want.

1:02:15Whereas previously, I would have been like, no freaking way. It is all or nothing. We're too crazy. We're stretched too thin. We don't have the bandwidth. They got to just conform to us. And now we're going to where our customers want, which is what you want too, right? You want to go to wherever is easiest for them. So it's freed up a lot of our time to do that too.

1:02:40I think we hit most of it. Okay. We'll do, we'll, it'll take us a little while. We'll, you can come build your own at Sastra Annual. The folks will be from all the Vibe building platforms will be there to help you. And we'll do, once we get through Sastra Annual, we will collect all the data and we'll do a part two of this. And we'll show you what worked, what didn't, all the analytics compared to humans. So, and you'll see where we kind of landed on all of this. But again, I would challenge folks. I got to say, I've done a lot of investments. I work with a lot of high growth B2B companies. Very few people do this well.

1:03:15Very few people do this well. And when I meet a leader, especially chief VP of customer success at Telemedia, everything is perfect. They're always gone in six months, 100 % of the time. They don't do this well. I think there is, in every enterprise, there is low hanging fruit here. There is something broken in your onboarding, retention, follow-up, customer education process. Find the most broken one or two things. And even if it isn't broken, be honest. Go through your flow. See where you have gaps in coverage. See where only 50 % of your customers are covered or 30 % or 20 % or where there's gaps.

1:03:50And think about what you would build to get that to 100 % coverage. And I think it's worth just building that. What would get you to 100 % coverage in a segment? And I think you can copy Amelia's prompts and copy our work or just go into the leaders like Repple and say, just copy faster sponsors and see what you get. Have some fun with it because the software in this category is mediocre and it's difficult to configure and it's dated. It's dated. So I think that this is a low hanging fruit for vibing. So thanks, everybody. We'll see you in May. Yeah. Thanks, everybody. Just as a last little bit here.

1:04:25to Jason's point. I'll just, I haven't really promoted this, but the agenda is up on Saster Annual if you guys want to see what we're doing. All the Vibers will be there. Anson from Lovable, I'm Chad from Replit. Gene from Verzell is going to be there on Tuesday. I have to do my own hard. But one of the top performing sessions is I'm going to do a version of this with our AI VP of Marketing, but I'm actually going to have my FDE from Replit join me so I can show you guys how to do one in real time. So we'll do a version of this, but a little different where I rebuild an AI VPN. I'm not going to use our data.

1:04:57I'm going to use probably fake data. I decided was for the best for this because we're all going to record it. But so yeah, that'll be a fun one too. You can come ask me questions there too if you're coming in person. But yeah, all the vibers, everyone's going to be, Anthropics is going to be there this day. There's a lot of - Yeah, it's good. Our goal, if you come on Tuesday to deploy day, whether you fully use it or not, you can walk out with your own AI VPN marketing. That's my goal. That's the goal. That's going to be awesome. Yeah. It's the last session of the day for that reason. So you guys can ask us a bunch of questions.

1:05:27But that's my goal. So you can walk out with one. I'll see you guys there. Thanks for tuning in.

From the publisher

SaaStr 849: How We Built Our AI VP of Customer Success with SaaStr's CEO and CAIO

Amelia and Jason walk through QB1, SaaStr's vibe-coded AI VP of Customer Success that started as a simple sponsor portal replacement and evolved into a fully agentic customer management system. The result: 70% fewer billable hours, 10x more customer engagement, and a hundred sponsors getting hyper-personalized weekly emails in minutes instead of days. They break down exactly how it was built, what broke, and how you can reverse-engineer it for your own business.

Slides linked here. 

----------------

Hey everybody - we are just about 30 DAYS out from the biggest B2B and AI event of the year. SaaStr Annual is coming back to the SF Bay Area this May, and if you're not registered yet, what are you waiting for?

This is where the real deals get done. 68% VP-level and above. 36% CEOs and founders. 25% AI-first professionals. This isn't a conference, this is THE room where S-tier decision makers show up to figure out what's next.

But here's the deal: ticket prices go up FAST. Like, actually hundreds. Don't be that person who waits and then pays full price.

Lock in your spot TODAY. Go to podcast.saastrannual.com and use my exclusive discount for SaaStr AI SF 2026.

May is closer than you think. See you there.

More from The Official SaaStr Podcast: SaaS | Founders | Investors

All 68 episodes
SaaStr 849: How We Built Our AI VP of Customer Success with SaaStr's CEO and CAIOThe Official SaaStr Podcast: SaaS | Founders | Investors · 1 h 6 min
Listen in VO