In short
Running 20 AI agents plus 3 humans; what works, what breaks, and how to avoid mistakes. Main themes: (1) AI SDR/PR outreach quality and why “good copy” still fails, (2) micro-apps built via APIs (including issuing SaaStr guest passes), (3) an “AI agent API report card” for choosing agent-friendly APIs, (4) “tragedy apps” that were once great but stagnate in the agentic era, and (5) database deletion risks from autonomous agents.
Guest backgrounds
No specific guests are named in the transcript. The hosts discuss their own team and upcoming SaaStr AI Annual vibe-coding sessions.
Key claims
AI SDRs have improved, but AI PR pitches are worse/more aggressive and get blocked; you must audit outputs and ask “would I take this meeting / put this speaker on stage?” Agents can autonomously trigger real workflows (parking passes, ticketing). API access is becoming the new product surface for non-engineers. “Tragedy apps” happen when companies ship catch-up features instead of agentic breakthroughs. Autonomous agents can delete databases/backups without proper guardrails.
Notable examples
SaaStr blocking mediocre AI SDRs; a PR pitch requesting a CEO fireside during SaaStr Annual; autonomous issuance of 25–50 parking passes; issuing RevenueCat CTO/VP guest tickets via an undocumented Bizabo API path; Pocket OS database/backups deleted in 9 seconds by Cursor + Cloud Opus; Descript failing to solve audio/video sync; Replit’s 10-year pivot to agentic product; API report card grading Stripe/Airtable/Marketo/HubSpot/Outreach/Gong.
Written by AI. May contain mistakes. Listen to the episode to check what was said.
Chapters
Tap a time to open that second in VOVibe Coding and Agent Building Sessions
2:10 to 7:20
Overview of vibe coding sessions and agent building workshops at the event.
“Okay, like I think some of our sponsors, you know, they get very worried right now about like logistics and all that stuff.”
AI Agents Gone Wrong
7:20 to 11:50
Discussion on the pitfalls of AI SDRs and the evolution of PR pitches.
“The better part of a year ago, we started our journey.”
The Changing Landscape of PR and Marketing
11:50 to 14:00
Insights into changing dynamics in PR outreach and interaction with AI.
“You have to be constantly reading the outputs.”
The Challenges of AI SDRs
14:00 to 15:40
Explore the complexities of using AI SDRs and their effectiveness compared to humans.
“They're just all – Artisan has a bit of a slider.”
AI Parking Pass System
15:40 to 17:40
Learn about the implementation of an AI-driven parking pass system and its efficiency.
“These PR pitches, to their credit, most of them are customized to us.”
Building Micro Apps Without Coding
17:40 to 20:00
Discover how non-engineers can create micro apps to improve workflows using APIs.
“So not only is it working, but it's working way more efficiently and faster than ever before, to the point I'm trying to see what else I can quickly wire up pre-SASter annual.”
API Report Card for Agentic Products
20:00 to 26:50
Understand the criteria for grading APIs and why certain ones are better for agents.
“I mean, I think I barely knew what an API was for a year and a half ago with all these.”
The Concept of Tragedy Apps
26:50 to 28:00
Examine the idea of tragedy apps and why some apps struggle in the AI era despite past success.
“As we build our AIVP of finance, we're not going to choose anything with bad grades.”
Understanding Tragedy Apps
28:00 to 30:26
Explore the concept of tragedy apps and specific case studies in the tech space.
“And I realize it's because of what I call tragedy apps.”
Contrasting Replit and Descript
30:26 to 34:25
Discuss the contrasting trajectories of Replit and Descript in the tech landscape.
“I mean, in all fairness, they were somehow able to raise it a billion dollars from Kraft before AI.”
Show all 28 chapters
The Challenge of Staying Relevant
34:25 to 37:45
Analyze the difficulties startups face in adapting to rapid AI advancements.
“if I had an extra T-shirt for SaaS Translators here, that would be no tragedy apps.”
Cultural Challenges and Innovation
37:45 to 40:07
Investigate cultural issues within companies that hinder innovation and speed.
“Like, I don't – my challenge is I don't know – maybe Canva didn't launch anything that changed the game.”
Database Deletion by Agents
40:07 to 42:00
Discuss the implications of AI agents leading to catastrophic data losses.
“and then I do want to move on to the next topic.”
Understanding AI Agent Risks
42:00 to 44:29
Learn about the risks associated with using AI agents and how to mitigate them.
“This is not a vibe-coded thing built on the side.”
Real-Life Examples of AI Mistakes
44:30 to 46:46
Hear personal stories illustrating the mistakes AI agents can make.
“Just like a human engineer might delete a database, might, I mean, not to continue this rant, but Amelia and I tried for two years to find a WordPress developer.”
Choosing the Right Tools for AI Development
46:47 to 50:33
Discover the importance of selecting trustworthy platforms for AI development.
“So I don't know if you have any micro stories like that, Amelia, but I actually mean this as not a cautionary tale that it happened because it happened to us and we got better at it.”
Insights from AI Marketing Strategies
50:34 to 52:58
Learn about unexpected challenges and successes from using AI in marketing.
“Use, use these apps on their ClickUp Cloud Code plus Supabase plus Vercel plus WorkOS plus all these things on its own, like the pocket OS story, if that at all sounds intimidating to you in today's world, don't do it.”
Maximizing AI's Marketing Potential
52:59 to 56:00
Explore how to leverage AI for effective marketing campaigns.
“We're like 100 days into our AIBP marketing 10K.”
Harnessing AI for Marketing Campaigns
56:00 to 57:50
Learn how AI tools can generate marketing ideas and strategies effectively.
“between 10K he could either do himself or he could get us to click approve.”
The Risks of Over-Reliance on AI
57:50 to 1:01:20
Explore the potential pitfalls of letting AI handle marketing tasks without limits.
“And like today's ideas were really good.”
Evaluating the Effectiveness of AI Ideas
1:01:20 to 1:04:30
Understand how to assess the feasibility and impact of AI-generated marketing ideas.
“So like, are the results really any different?”
Shifting Roles in Marketing Teams
1:04:30 to 1:07:10
Discuss the evolving roles within marketing teams as AI becomes more integrated.
“But ultimately, there will be some, even though it will be smarter than us, there will be some level of expertise and life experience it won't have to make the right calls on our time, right?”
The Future of AI in Sales Development
1:07:10 to 1:10:02
Consider the implications of increasing AI presence in sales development roles.
“But such that it is, 10K should be managing those humans for real.”
Specialization vs. Integration in Sales Agents
1:10:02 to 1:12:02
Learn about the balance between specialization and integration of sales agents and AI.
“Is there a chance, Amelia, we'll run six by the end of this year as we have new ideas we want to do?”
The Unique Challenges of Media Sales
1:12:03 to 1:14:34
Discover the complexities of selling media and the different buyer dynamics involved.
“And I know Salesforce has been doing this internally.”
The Future of Sales Agents and AI
1:14:35 to 1:16:55
Explore the evolving landscape of sales agents and the impact of AI on sales processes.
“They like barely knew they were doing media with us.”
Integrating Humans and Agents in Sales
1:16:56 to 1:18:52
Understand the importance of integrating human teams with AI agents in sales.
“So we like, should you buy, we're probably going to end up with five or six SDRs, AISDRs by the end of this year.”
Strategies for Managing Resistance to Change
1:18:53 to 1:22:34
Learn effective strategies for managing resistance in teams transitioning to AI-driven processes.
“Like when I was at I was I was at Salesforce Tower last week for like a founder event they did for like 200 folks, like a mini like folks at Coda Saster is like a very mini, mini, mini version of Saster.”
Transcript
Automatic transcript. May contain errors.0:00Okay, everybody, welcome to episode four of The Agents. Thank you for joining us on our journey so far. If you haven't watched before, even if you have, we are going to talk about what we've learned running 20 AI agents and three humans. What's worked well for us, what breaks, the challenges, so that as you go through your own AI and AI agent journey, you can avoid a few of the mistakes we've had and maybe go even further than we have. A couple of things we're going to talk about today. Vibe coding at Sastre Annual. Amelia will guide us through it. We're going to talk about AI agents gone wrong.
0:35I'm going to talk about bad AI PR pitches. And we're also going to talk about tragedy apps, apps that should be great like AI that aren't. We're going to flip it around. We're going to celebrate Replit's 10-year anniversary, one that stayed in there for a long time and became an agentic leader. we're going to talk about little tiny apps that you can build on APIs you could never talk before we're going to talk about database deletion what we've learned the POC pocket OS controversy why it's misunderstood we're going to talk about months of 10k in production our VP of marketing things we didn't expect and that's just a start Amelia's going to shut me up but we've said enough but again everybody welcome to the agents episode four I hope you stick with us so far, this has been fairly popular and we hope that it keeps going.
1:24So before we kick off, Amelia, I think this is the last episode of The Agents before our big community event, SASTR AI Annual 2026, May 12th through 14th in the SF Bay Area. And we will have both a lot of vibe coding in general. And then you and I will have three vibe coding sessions we're doing in particular to help folks, so really agent building sessions, not so much vibe coding. So can you give us a quick background on the three we're doing and everything, all the other 10, 20 sessions to help folks build and understand agents. Yeah, a hundred percent. Let me pull it up actually, and I'll show you guys what we're doing.
1:58But yeah, by the time you guys hear this, the next week will be Saster AI annual. So we'll be super close. Not too late to get your tickets. Not too late. Not too late to come and deploy. It's going to be, listen, it's going to be a vibe. Okay, like I think some of our sponsors, you know, they get very worried right now about like logistics and all that stuff. I'm like, guys, just don't lose the plot. You're going to come. There's going to be a ton of really great people. You just posted on Sastra.com how we're, you know, I think 70 % founders and CEOs. Like it's just such a great mix of folks.
2:29We've got more like technical folks than ever before coming to Sastra. So these are not just, you know, this is not just Joe Smoe, SDR, number five on the team. These are actual buyers and builders coming to Saster. So not too late if you want to come to. There's some fun things here. You can see we're going to keep adding some of these categories just to help you guys decide how to spend your time at Saster. But just for example, if you come to the Vibe Coding tab, you'll see there's a bunch of classes and stuff that folks are doing just at Saster Annual related specifically to Vibe Coding. And to get you guys started, there's a few we're doing just between Jason and myself.
3:07so the first two will be on Tuesday so come come early come when the doors open do a little rope drop as I like to call it uh doors open at noon Jason's AI Agents 101 will be our first session at one o 'clock so come with your laptop come to Agents 101 Jason's going to show you first how to build a digital clone slash agent if this is the first time you've built an agent or deployed an agent, this is kind of a, let's say, simpler one that we can all do together. Yeah. If you haven't, if you're as far ahead of us or further, don't come to this session, go grab some coffee or meet some friends. But if you're listening or watching, we feel like you haven't deployed an agent, we'll at least get you a digital clone, a digital chatbot, a digital support agent done in 30 minutes before you walk out of annual.
3:56You will do it yourself with a laptop. So you will become a little bit of an agentic expert in less than an hour. And we're doing a little back-to-back here. So you guys will hear from Rusell a little bit in the middle, and then I will come chat about how to vibe code your own AI VP of marketing. From scratch, we lost some time for questions. I know some folks on social was like, how are you guys going to do this in 45 minutes? And truthfully, if you come with enough stuff, like the workflow I'm going to show you will only take about 30 minutes. You're going to have to do some pre-prep when you actually go and deploy this.
4:35But if you bring some of your basic data, just bring, you know, some of your, if you have some customer data on your computer or your hard drive and it's in a spreadsheet, that's fine. If you have some marketing stats, that's fine. You can come with that. If you don't come with that, it's okay too. But come with that, then we can do it together. We're going to live build an AI VP of marketing. We've talked about ours before. We'll talk about a little bit more today, how ours like sends campaigns for us, helped us build this entire website. has been running a bunch of campaigns leading up to Saster for both customers and attendees of ours.
5:07And so this one will be fun because we'll show you how we did it for real and kind of how we use it in our everyday. So that, again, if you bring your laptop, you can follow along and hopefully have your own light, let's say, AI VP of marketing by the end of the session. You can come ask for questions and then you'll get hooked, hopefully, between these two sessions and you'll keep working with your agents every day. That's kind of our goal. Cool. So we'll also have at least 10 different vibe coding sessions we're doing together with Replit all through the event to drop in GTM agents, a whole bunch of others that you can just drop in, bring your laptop, bring questions.
5:39They'll have some of their best folks there and just come with questions. Yeah, come with questions. I mean, this whole agenda is jammed. I've had a lot of folks say there's a lot going on all at the same time, seemingly everywhere on campus. I mean, that's that's faster for you. Everything we're doing this year, hyper tactical. It's funny, actually, it's related. just in the age of AI, right? Like any of us can make a boring presentation deck in 10 minutes with Claude or GBT or whatever it is. So it's a little funny now because we've asked all of our speakers for this year. So everybody you see on the agenda to do walkthroughs like we're going to do.
6:13So show us how to deploy an agent, show us a workflow that you did with an agent, show us something super tactical, super hands-on in the age of AI that our audience can duplicate. So it's a little funny because now they've realized, I actually can't use Jimmy Tate to help me fill my presentation. I got to actually do it for real. But it's such a benefit to you guys because you'll get all that knowledge. I've personally seen a lot of dry runs from folks that have submitted what they're going to demo and show you guys and their workflows they're going to do on site. So it's going to be fairly technical, but it's going to be great.
6:43We're going to skip all the high-level fluff stuff. This will really build upon what we've been talking about on this pod for weeks. And so So it should be a ton of fun, honestly. Maybe it'll be a little overwhelming, but we record and stream all the content. So I don't feel like you have to do it all at once. You know, do some meetings too, meet some great folks, talk to our sponsors, but it's going to be a vibe. You can even just come to our deploy summit and grab a one-day pass, a SaaS to deploy if you want. Might as well come to the whole thing, but you can just come to an afternoon and learn.
7:11So with that, should we dig into this week in our Agents, Amelia? Yeah, let's do it. Okay, one that I, it was a late ad, But I wanted to talk a little bit about on this today about AI agents gone wrong. Right. And it was interesting. The better part of a year ago, we started our journey. I wrote a post that block might be the death of the AISDR. OK, as a lot of mediocre as as, you know, about a year ago, we went from AISDRs that didn't work to a lot of mediocre content. I was getting endless lamar's pitches from SDRs. and I had an epiphany about a year ago. I mean, you guys, I'm sure do this too, but it took me a while.
7:51I'm like, in the old days when I got a lame SDR pitch from a human, I might ignore it or once in a while add a snide comment, but I'd never block them. And then I realized these aren't humans. So I can just go into Gmail and block them. I'm not being triggering by blocking an agent. So all of a sudden I started to block mediocre SDRs and frankly, probably until we deployed our own, and we're going to talk more about whether this is too many, our fortified AISDRs, Artisan, Qualified, Monaco, Agent Force, and probably more to come. Until we did, I'm not really sure I understood the difference between a good AISDR and one to block.
8:28But certainly now I've seen, now that we get a lot of emails, I don't block a lot of AISDR. They've gotten pretty good. They've gotten pretty tailored. And so that's interesting. The category didn't die. It has blossomed. And where it is dying is PR. And I think it's both an example, most importantly, and at a more tactical level for founders and others. It's why you just can't phone this stuff in in the age of AI. And it's really interesting. So a couple of things have happened with AI PR pitch. So what AI SGRs have gotten better, in some ways, I think AI PR and outreach has gotten worse. And I think it's at least talking about for a few minutes, and I want to get Amelia's perspective, too.
9:06So it's interesting. In a sense, Sasser is a media company. I mean, we have hundreds of thousands of folks on our email distribution list, millions of views of our content. I would say traditionally PR folks have not really viewed us as a media outlet. We would get speaker submissions in the run-up to our events. But we weren't really viewed as a media company, so we didn't get a lot of traditional pitches. Hey, my CEO at Slightly Boring B2B company is launching an AI widget. Would you like to do it on Sasser? Well, I'm not sure how these AI PR tools work, but clearly we're in the pulldown or the automation of being a media company now.
9:41Because I went from getting almost no pitches outside of our events to getting 10 or 20 a day at least from media companies that you've heard of. Not just companies that bought a tool, but PR firms that folks are paying$15 ,000,$20 ,000,$50 ,000 a month to do outreach. And the weird thing is they're always written well because of AI. Like they're not terrible like I used to get, right? I used to do just the worst pitches by agencies that obviously had no idea what their clients did. Okay. They were embarrassingly terrible. Hey, my client just raised$2 million in a seed fund. They do something in B2B.
10:17Would you put them on the Sastra podcast? Now they're all pretty good. They're pretty good. But they're also wrong for us. They're wrong for us. And there's a handful of PR agencies and humans, a handful of humans, and it's shrunk over the years. that know Sassers so well, they can get their CEOs on stage. They can get their CRs on stage. They can get in our podcast. They get placed because they know our content code. They know what Amelia and I want. And most importantly, they save us time. Okay, they save us time. Yes, of course we want an executive from hot AI companies, but they don't all have to be Sam Altman.
10:48Okay, we want others. But we need a brand and we need them to not do commercials about their own products. They need to help founders and other executives. That's our vibe. And so if you know our vibe and what we're doing, I mean, honestly, you can get a speaker placed at Sastra. You could probably even get on this podcast, the agents. But they just come up short, these agentic tools. And so the bar is higher. They're probably better than those AISDRs I blocked a year ago, but I block every one of them. I block every one of them. And I had another one today. It's kind of related. Someone asked me to go on their podcast, and I try to avoid it.
11:23We're busy before Sastra, but this one was pretty good. It was, hey, the CEO of a company doing 500 million would love you to do a fireside with him in front of 400 founders to help them on any agents. Sounding good. OK, really good pitch. And I replied back, well, you know that's in the middle of Saster Annual. And his reply back was, oh, OK. I guess I don't want to spend too much time on this. But the cautionary tale is that you have, it's a reminder that even when the agents are getting better and these pictures are decent, you have to constantly be reading the inputs. You have to be constantly reading the outputs.
11:59And we're going to talk about how our AIBP marketing is becoming autonomous now, but it's because we manage all the inputs and outputs. You cannot buy an AISDR and hope it automatically works on its own. And these PR tools seem to work, but they're getting you blocked. because I don't want your damn 11 ,000th email from your mediocre startup that raised 2 million. I just don't want it anymore. So I'm going to block you. So that's my rambling rant of once you get the agent working, you got to make sure it's good enough. So you see anything different on these pitches, Amelia? What's changed in terms of the way you interact with pitches and marketing and PR and media?
12:36What's changed for you in the Agente era? Yeah, it's funny. I feel like folks have, I feel like because it's now so Agente too, that the agents asked for more than the humans did. I feel like sometimes the humans like have a little bit of shame in what they asked for. Like, okay, I'll just ask if I can, you know, get my CEO to speak at SASTR. But now I feel like because the agents can do it tailored. They'll be like, hey, can we speak at SASTR at this date and this time on this stage? Because we already looked at the website and can we expect, you know, this many attendees and all that. So it's funny how much more they ask for now and kind of like demand of us because they have agents and we have agents.
13:11Yeah, it's funny. We haven't launched it. I built an AISDR for fun to learn. And maybe we'll launch it for free. It's actually pretty good. It can't do what Agent Force or Artisan or Monaco. But I think it's pretty good. Don't you, Amelia? Yeah, it's pretty good. For building it on your own and having like mid, like I didn't even give you any inputs for it. It's like very, it's actually very, very good for it. Maybe we'll launch it. But what's funny is, and maybe our tools have it, but I don't think these PR tools, but going to your point, I added a slider of how aggressive you want the pitch to be.
13:40And it's pretty funny. There's a weak pitch where it's like it researches you. Oh, I love SASTR. We'd love to be a part of it. There's the standard one. Is there any good time for you to meet? And the aggressive one is I need a meeting next Wednesday at 3 p.m. I just added a slider for fun so you could see the agent pick how aggressive it wants. And I hadn't thought about this, but I guess the PR tools are too aggressive with you trying to get their placements, right? They're just all – Artisan has a bit of a slider. The others don't really. Yeah, it has a version of a slider where you can kind of pick, like, how aggressive you want it to kind of outbound to them.
14:15I feel like, to your point, though, spinning up an agent is not all that hard, and that's not what we've been saying. Spinning up a good agent is hard. Spinning up a high-quality, good agent that is consistent, that's the hard part. Yeah, and it's just, I guess I want to move on. I guess it's a reminder that, to me, it's another reminder that the initial era of AISDRs were arguably worse than a human, right? Not arguably, not worse than a terrible SDR. We'll get it done at least. But I thought they were almost worse in some ways. Not only do you, we talk constantly about how you have to audit the content, how the first three days you should read every email and then every day you should be auditing.
14:51It's a reminder to that, this PR stuff, you got to stop. And this goes back to the pre-AI stuff. Slow it down. But it's not just slow it down. When you're reading the output of an agent, you can't just ask yourself actually anymore if it's good because it just might be good. In fact, Claude keeps getting better. So by the end of the year, the output might be borderline great, okay? You have to ask yourself, would I buy my own product from them? Or in this case, would I take the meeting? Would I put this speaker on stage? Is this email? It's good. It describes my company really well. It is customized.
15:27It is N equaled one. but ask yourself, would I buy my own product or would I agree to put myself on stage? These agents all fail that test. So I don't know what that exactly is and I wanna move on to the next point, but it's almost once you have an agent that seems to work, the output's pretty good, it's accurate, it's guardrailed, it's tested, then slow it down and say, would I really buy my own product from this content or would I really take the action on being, don't be bamboozled by the fact that the copy and even the customization's pretty good now, right? These PR pitches, to their credit, most of them are customized to us.
16:02They really are, right? They really are from some pick venues. So make sure you buy from your own agent, not just that it's good. Okay. I wanted to talk about a micro topic and then talk about stuff in the industry. This one's really tiny, but it was just interesting to me. We talked last week about how we built an N equal one app, an app just for us. It's so niche. this AI parking pass app. It kicked off, right? There are 5 ,000 plus unique parking passes in PDFs, 5 ,000 PDFs. Our AI DP customers has now begun to route them individually to the first 10, 20, 30, 40 people that wanted parking passes.
16:45It's actually not what I want to talk about. I want to talk about something even more niche, but just tell us how did that work in practice? You wired it up. We talked about it last week, but now that the agent is autonomously issuing these parking passes, it's working fine. It's working well. Have there been any bumps? No bumps so far. I just got an email this morning where it said it issued 20 just yesterday. It did 20. So I think it's up to 50 total now, which is fantastic. This is something where, again, we were manually doing between me and our events production team. We would have to go in every day, make sure we all didn't use the same PDF, route it to the person, send it to them.
17:18You know, it's a few minutes per pass. Now I just get a daily email. Okay, 25 passes have been sent yesterday. We get copied on all of them still just in case, right? So when they get their parking pass, our events team still gets copied on it. But so far, no issues. People can just get them instantly. And we used to get, you know, constantly bugged if we didn't send it to them within an hour. Hey, where's my parking pass? So not only is it working, but it's working way more efficiently and faster than ever before, to the point I'm trying to see what else I can quickly wire up pre-SASter annual.
17:49So I had an interesting story, and maybe this is too specific and too nerdy to be of interest to me, but to me it was interesting. So the parking pass thing kind of inspired me. What are some things that I've wanted to do that before an agent could access an API couldn't? So this is going to sound so niche-y, and then I'm going to go high level. I'm going to talk about Repli being 10 years old and databases and other issues. But I had this nagging PIA issue for over 10 years, which is there's a handful of folks I need to give guest passes to Sastre. You know, Sastre Fund portfolio companies, other folks.
18:23And it's been stressful as heck because I have to like I've had to ask Amelia or other pokes on the staff that I trust to manually go into Bizabo, our ticketing app, and manually ticket them. Or I've had to add an agency that I can't trust to do it. And half the time they don't do it when I tell them to do it. So it's been very stressful. So I have to keep track. Then I get these emails. I never got the pass. I never got the whatever I got. So I got two this week from the CTO and a VP at a company called Revenue Cat, which we were the first investor in. That's an API for mobile apps. I'm like, I can't ask Amelia to do this.
18:54She's so busy. She has time to do the agents, but that's it. So I'm like, why don't I just ask Replit to wire up a micro, micro app where it goes into the visible API and I can just issue tickets for free. And it was very interesting. Not only does it work. And so I got an email back. I said to the CTO, I'm going to try this. I don't know if it's actually going to work. And I put him in. He's like, it worked. It was pretty exciting. So I was able to do something. So a couple of things that are interesting. One, I was able to do something that was technical without being an engineer. So it's another example of how the API is the future of software because we can all interface with APIs now, right?
19:26APIs used to be just for your engineers and used to developers. Now anyone can access your API. So I could. Democratized. The other interesting thing, this is interesting, is that Bizabo is a bit of an older product that we use for ticketing. Replit was like, this is not actually documented in the API, but I found an undocumented way to do it. So it found a part of the API that was not documented in the docs and was able to issue the tickets. And now I have a little widget inside of 10K where I can tell our AI VP of marketing to issue these comp passes to our Sastra fund and other CEOs in an unsupported call in the API from a non-engineer.
20:03I mean, this is an API-first world. Yeah. It's an API-first world, right? I mean, I think I barely knew what an API was for a year and a half ago with all these. Yeah. I'm just like, okay, that's the things that the engineers use for, like, the backend and the stores all your data and all that. Now I'm like, hey, could you add this to your API or do you have docs for where your API can do XYZ thing? Like, literally, I was just asking our folks this morning because I wanted to make another micro app for Saster. Right now, if you buy a ticket to the free email, you get two emails. So you get a confirmation email with your ticket.
20:40Then you get a separate email with an invite to our networking app. Who do you want to meet? The networking app, sometimes it goes to spam because it comes from our who do you want to meet domain, which is kind of like new. It's a lot of manual time where our team has to send, resend everybody their confirmation emails. So literally this morning, I just asked the head of product there. I was like, hey, can I custom feature in the API where I can do an API call to resend their confirmation when they quit? Because it's not in there now. I was like, do you think you could build that for me in the API?
21:10And they're like, OK, let's try. So they're working on it. But it's just like that's not a request I would normally make, you know? I haven't even fathomed. Yeah. The change is now you're asking our events marketing software vendor. instead of to add features, you're asking them to add APIs. Correct. Yes. That's a big change. It's a big change. We used to request features, and maybe in a year or two, you would get a custom feature if you were lucky. Usually never. Usually never. Usually never you'd ask for a custom, even if you were one of the top customers. 10 equals one. No, or we're busy. So now a non-technical customer or non-technical resource of the customer will ask for an API so that they can vibe the feature that they want.
21:55It's a big change. It's a big change. I've asked for like five little API things just in the last week. Yeah, and one thing, maybe you can show it on the screen, is this. So out of this, this micro epiphany, which is Captain Obvious, not really that brilliant. So we built an AI agent API report card. I don't know if you have a tab that can show it. And we were like, listen, we're just, this isn't one-off. We're going to keep building more and more agents and more and more products on top of APIs and maybe MCPs too. And the first thing you might do is ask Claude or Chad Sheehy, which one should I use, right?
22:27I want to do email marketing. Should I use resend? I want to, you know, what should I use? And I think that's fine. I think if you just ask the LLMs which API is the best one for an agent, that's fine. But I thought it would be interesting to actually grade them all, to grade them all. So what we had, we built this site on Replit, API report card. As you can see, as we've used it, it's already been used 1 ,688 times in less than a week. And basically what it does, it takes every API that asks Claude, Gemini, and OpenAI to grade it based on how agent-friendly these APIs are. Okay? And then it rates them.
23:03And roughly, you can go through this, and you can click into all of them. You can see all the details. It will explain it. You can compare them by category. Yeah, there's Slack, which came up. And there's a couple things you can learn. if you just the interesting thing was that kind of surprised me is stripe got the highest grade it got the only a plus the most agentic one so honestly we use stripe a little bit at the api level we're going to do more this year as we have most of saster is free so there's only so much stripe we need right but we use it a little bit but now i would use stripe in an instant right it got it got the highest grades if you scroll down here toward the bottom you'll see as it fades from A to C, these overall grades, you'll see it's very consistent with our experience.
Read the full transcript
23:45Like if you go down to Marketo where the API doesn't work, right, you can find it down in the Cs or even search for it. It will explain to you, if you want to build an agentic product, don't use Marketo. It's pretty good. Okay. It's pretty good. If you go to HubSpot, it will say it has pretty good APIs, but they're rate limited and have other issues. And so not only will it give a grade, but if you scroll down a little bit, it will tell you why and when it's a good choice for an agentic product, right? How ready it is, right? It's got the OAuth, it's secure, it's got the right REST API, right?
24:15The strengths. But if you keep scrolling down, it'll say, you know what, if you want to have a high volume product like Sastr, like we send millions of emails, it's probably not the right product for you today. It's too rate limited, right? So in a way, this product we built, like if you're already comfortable just talking with Claude and asking them what agentic products you use, maybe you don't need this. But this is an objective way that combines all the LLMs, all the products, grades them. And then another thing to do, Amelia, if you go back to the top, you can quickly click on a category.
24:44So if you click on CRM at the top, for example, see those little buttons? Yeah. Then it will show you the highest grades per category. If you want to get a quick sense like this, I would not use a C. Whatever you do, don't use a C, okay? And why? And even it's kind of cool, if you click on quadrant, We'll play with this a little more. If you go up a little bit. And it says cards rank quadrant. Yeah, you can even see a magic quadrant Gartner style view of all of the vendors to know which ones to pick. It's totally objective. This is not based on how much they pay Gartner or any of these sorts of things.
25:17Of course, Aster. And we'll keep doing this. But I think this will be pretty good because we're building products. So we want the answers. I'll ask Replit or Lovable or we'll ask Claude which product to use. Like, that's fine, but I want to know which ones I can trust and use. And I think it's pretty cool. So this, my learning from this, if I had to compress all of our learnings of all the agents we've built, anything on this AI report card above a B, I would trust. It's a tough grader, guys. Sorry for folks that don't like their grades, okay? It gave 11 labs a B+. I voted it as my favorite API, but it's got some fair points.
25:51OK, so B plus is I thought about great inflation, but but for now, I'm going to let the agents decide this is an agentic world. Right. And even in the marketing category, for example, no one got higher than a B plus. I think I think Clay got the highest or maybe Clay got the highest in sales automation. Right. There's some tough categories. But I think anything in a B is probably pretty good. And then just start running. Do not use a B minus product in an agent. Just just don't use one. Right. Just don't. You don't you don't unless you have no choice. And there's some tough grades. JIRA dated, Outreach dated, Asana dated, right?
26:25There's some tough grades. There's some tough things for Monday and ClickUp in that whole category. You know, the truth is Gong got a B -. Would you have your agent use Gong? Probably not. It's a human-specific company, right? So super interesting. It's free. We'll keep doing this. But I realized when we built this for fun, this is like super helpful to us. This is a guide to what agents we would use, especially as we continue to evolve our AIVP marketing. As we build our AIVP of finance, we're not going to choose anything with bad grades. It's going to save us time. So pretty fun. And also, I think it shows the future where not only is Amelia as a human now asking our vendors for APIs, not features, the agents are going to ask for different features than humans.
27:12The agents care about rate limiting. The agents care about how often they can interact with the product. The agents care, they don't care about the UX and the UI, right? So they're going to grade a lot of these products a lot more harshly than a human would. They're looking for different things. So a fascinating world, and we'll keep talking about it. So this was fun to build. So thanks for showing that, Amelia. Related to that, which we built on Replit, pretty cool. Thanks, guys. I wanted to talk about something and get Amelia's thoughts that I kept thinking about a lot, but I didn't know what to call it until this morning.
27:45Okay, this is something that I've been pulling my hair out at board meetings. I've been exacerbated on the 20VC podcast, but I haven't known what to call it. And for folks, a lot of folks of you have been watching or reading Sastra for All, and you're like, Jason, you're kind of critical for a while in this AI stuff. And I am. And I realize it's because of what I call tragedy apps. Tragedy apps aren't apps that were always bad. Okay. They're also not apps that have no place in the AI or in the agentic world. If you just have no role going forward, right, that's life. Not everything is meant to last forever, right?
28:22Tragedy apps are apps that were good before AI and agents and should be great today but aren't. So I wanted to give two contrasts and get your thoughts, Amelia. The crazy one is Replit, which I don't even know if you knew this, Amelia. Replit's 10 years old. so no i would have thought it was like you know so 2020 2021 well even that is pre pre gpt gpt3 pre-vibe coding right so it's funny as a case study lovable and replant like they're they're arch and arch competitors are about the same size same growth same everything same but they started totally differently lovable basically was born in once claude allowed vibe coding right it was a product of that era, right?
29:03I don't know the exact date level was founded, so be kind, don't haze me too much. But roughly, it was founded when VibeCoding began to work, when Claude itself could build limited applications inside of itself. That was the aha moment, somewhere in the threes, I think. Replite was founded 10 years ago as a different product, then became an IDE, a web-based IDE, just a way to build for developers, not non-developers like us, for developers to build in the browser. It was slow. When Amjad comes to Saster, and I'm not going to ask him a lot about this because it's not a history lesson, but what I am impressed with is the tenacity.
29:41And what's interesting is Lovable built this thing once they saw the world had changed, right? Anton and team dropped everything, whatever they were doing before, and they built Lovable, right? Very cool story. Great story. 2023, it says. Yeah, 2023. And then they were ready in 2025 when this started to work. Replit was very different. Amjad was playing with the very, very early GPTs. He was playing the GPT-2 and before that were so small, you could just use it on your computer. You could just use it locally. And so he was waiting. And then when you could actually build a product in Replit, they were ready, right?
30:15So he came at it a very different way. He added it in a very, very different way. And my point of this rambly story is, you know, kudos to them for staying in this for eight years. Now they raised money. I mean, in all fairness, they were somehow able to raise it a billion dollars from Kraft before AI. I don't know how the hell they did that. But staying in this for so long, right? And then finally they had their moment, right? And they seized it. And whether you like Replit better or lovable or whether for some reason you're a base 44 person or you believe you can do it all in cloud code, whatever.
30:48They built a half billion dollar business by seizing the moment in AI and building what is unquestionably today, if not a year ago, unquestionably a great prop, like a truly game changer. right and for the moment and then what i want to contrast it with and then get amelia's thoughts that breaks my heart the tragedy app for our team is descript i don't know if you guys have used a script but if you're in video or podcasting or video creation you've probably used a script descript was the ex-co of groupon who had a disruptive idea years ago i don't know when it was founded amelia maybe you could look it up if you have a second but andrew mason hadn't early realized that video and all of this was going to take off before all of us realized it and built Descript to automate creator motions.
31:30Right? When was it founded? 2017. 2017. So he saw... Almost 10 years on that one. Yeah, now we're surrounded by creators, okay? And I don't mean TikTokers. I mean creators for long-form content and creators for building high-quality content. He saw this before anybody in building. And I remember when it launched, I thought he was nutso. But I'm like, go for it, Andrew. And then sometime around 2023, it started to become the standard. Anyone building a podcast, video content, video creation like this or anything was on Descript. Okay, it would upload your video. It could natively do edits. It had limited AI capabilities.
32:06Even back then, it was cool, right? You literally, unless you had a team of video producers like Harry does, you couldn't, it enabled you to produce a podcast without a team. And that was utterly disruptive. And it got them to about 50 million. and then they still haven't been able to solve an existential problem with the product which is audio and video get out of sync all not only did i see it on one of our last videos i see it we watch a lot of youtube i see it on youtubes all the time i'll see a youtube that looks great and it sounds good it sounds like that just grips it's just off enough the video uh audio are desynced enough that i know they ran it into script to clean up because just grip will clean up your audio and video, right?
32:46They were disrupted in cleaning up audio and video. But, and it just makes me sad because they got to 50 million in revenue and it got hard. The CEO stepped down, gave the keys to his VP of product, left the company because it got hard. And I know, I don't mean to be mean to the folks there, but I feel like the product is frozen in time. It is frozen in this pre-Genite time. It should be epic. We should load this raw video up that recorded in Riverside and the script should just make it amazing. Like Opus does for clipping. It should just be amazing, or Higgsfield does for videos. And so it's a tragedy app.
33:17This should be a$10 billion,$300 billion run rate company like a Higgsfield or any of these folks. And instead, it's frozen in time. Even though it had the audience, it had the base of the customers. And I see this with so many startups. Like, they have whiplash from the change in AI. They have 20 competitors they didn't have the other day. And some of them are decacorns. And they've raised so much money from all the hot funds. And they're overwhelmed. and their team sort of gets it and they're launching check the box AI features. They're launching a little bit of an AI enhancement or a little widget or creator and they're becoming tragedy apps.
33:54They have the base, they have the customers, they had the connection and they're just not executing. And I worry that the ones in the middle, like one of the reasons I'm such a fan of Salesforce and Agent Force is not because I'm 100 % sure that they're gonna win in the authentic area, but because Mark is 100 % committed to not being a tragedy app. He is dragging this effing team into the agentic era. Some of them are all in on it. Amelia works with them. Some of them are still being dragged. Okay. But I think no tragedy apps, if I had an extra T-shirt for SaaS Translators here, that would be no tragedy apps.
34:31I think most of the old SaaS companies, the pre-AIB to be a player, have become tragedy apps. Do you see anybody shouting how excited they are to use Outreach now? It's gone. Marketo, that's more than a tragedy app, right? I think the Canvas and the HubSpots might be on the bubble. Like, Canva just launched its 2.0 AI stuff. It's great. It's like it's a lot of the stuff that we do, the Reeves and everything built in. Now you can generate agentic images. I just don't know if it's a game changer or not, right? So they're not a tragedy app. They're doing it. but I don't know if they're fully using AI to take advantage of their 4 billion AR base.
35:09I don't know that HubSpot is. I don't know HubSpot. You know, we would go every year at Saskatchewan, we would ask how many folks are on HubSpot versus Salesforce? And at first, only a few would raise their hands. And then when Brian and Dharmesh came in like 2022, the whole audience was on HubSpot. But are they fast enough to win in the AI or could they, and I hate to say this, could they accidentally become a tragedy app by not converting that base to an agentic base? I don't think Dharmesh is going to let it happen, but I view them as in the middle, like there's some risk. So that's my rambler rant.
35:40Like, don't be descript. It's just sad, right? That's why I get a little, when folks say you got a little pushy, Jason, a little negative, I don't need to drink it. I'm just trying to help you not be a tragedy app. At least follow what Mark and Aaron Levy, Aaron Levy is doing whatever he can so that Box could have been a tragedy app. Boccap could have been where your dad stored stuff in files on the internet. And maybe it will be. Maybe Bocs will fail. But Aaron is doing everything humanly possible to be an agentic leader. Yeah, I think the line between tragedy and success in the AI era is, are you just releasing things to catch up, right?
36:19So like kind of the Canva 2.0 stuff, I see that as a little catch up. Like, OK, they're catching up to Gamma. They're catching up to Grieve. they're catching up to Higgs field. But was there, I don't, I didn't see anyone like singled out feature that I can't already do on another agentic tool. And so I feel like that's where for me, that release kind of fell flat. Cause I was like, well, this it's great that they're catching up, but there's nothing new here. Like there are, these are all existing other tools already. So I feel like it's, it's the same for Descript, like right when I was looking now to see what year they were founded.
36:54It's funny. Everything that shows up in the results is from last year. Like people have stopped talking about it. They've stopped releasing new features. Like everything was literally frozen in time from 2025. And I can tell you, even if they have a release coming tomorrow, it's also probably just to catch up to some of these folks we've just been talking about. And so I feel like for me as the end user, that's kind of the line for me is, OK, are you releasing things just to quote unquote catch up to everybody else? Or are you actually releasing things that is true to you and your own and pushing the agentic agenda forward of features and API features now forward versus just playing catch up with everybody else?
37:33Yeah, it is. It's a good insight. I don't we've talked about 60 percent solutions. I've talked about it elsewhere that it's not enough to monetize the 60 % solution. Right. And, you know, an 80 % solution, 90 % solution might be enough to keep your customers, though. Like, I don't – my challenge is I don't know – maybe Canva didn't launch anything that changed the game. Probably true based on what I've used. But if what's Canva's launch is 80%, 90 % good as Reeve plus Higgs field plus Replit slides plus everything, that avoids being a tragedy app. That keeps you in the game, right? A tragedy app is an even lower standard, right?
38:07It's like you can't even release these C60 to 80 things. Like, just can't get the audio and video to sync, right? And so it's something below that is a tragedy. C60 to C70, maybe you can't charge more for it, right? It's got to be free in Canva maybe, right? Canva will figure out how many tokens they can really charge for this stuff. But it keeps you – you've got to stay in the game. Like, just scripts, audio, and video have to be as good as Opus can do, clipping your YouTuber. What's the – like, we don't need you anymore, right? Well, the IRD2 is – It's not screwed up today. if if adobe premiere tomorrow i i've talked on this pod before how i like some of the agentic um features of adobe illustrator and photoshop it's funny premiere is behind that's the video tool specifically for video editing um that i still use but and a lot of us still do it's funny if tomorrow they caught up and they had a a speech to text style editor the way descript does I'd probably be like, you know what, though?
39:05Premiere has never fallen out of sync. So if they release that tomorrow, they actually could catch up. Like, it's a great irony. It's a great irony of what I just said. They actually couldn't catch up and keep their existing customers by just releasing one more feature, which I'm sure they're working on, I hope, because Descript has been around for so long. It is a tragedy that Adobe Premiere doesn't have this yet. But, man, imagine if that came out, like, next week. Folks would be back on it. They'd be hot on it, I guess. The problem is, and I want to move on to the next step. The underlying problem, there's a lot of problems.
39:38One is cultural, which is folks don't want to do it or they're tired. And so they hide from the tragedy. They're too insular. They're too, we talk to a lot of folks that still grade product development internally. Oh, we shipped this many features this quarter. Hooray. That doesn't, if your category is being disrupted, it's not enough. So some of this is this inward navel gazing that I would say we see with most larger B2B companies.
40:04and you've just got to be, and then the other problem is, and then I do want to move on to the next topic. The navel gazing is the worst problem. The other existential problem is, can you move faster? Maybe Descript doesn't know this. Maybe Descript doesn't know the auto and video don't sync after eight years, but I bet they do. I bet they know, and they don't have a strong enough engineering team in the age of AI to solve this problem. I bet it's a gnarly effing problem. They have to refactor the whole way they transcribe and encrypt videos. And I bet it's easier to hide from it. It's easier to pretend it doesn't happen, which we see a lot.
40:38And you have, it's because the problem is catching up is not enough. If the next day RepliDent is a year ahead of you, right? I don't have the answer to this, but the fact is you've got to not only catch up, but move faster or a tragedy may be waiting. And I wish I had the answer, but it's a tough one. All right. Next thing I want to talk about, Amelia, was something I thought I never wanted to talk about again. Database deletion by agents. Yeah. Okay. I do not want to go back in time. Should I give folks the quick context? No. No. I will. Okay. But I do think there's something to chat about here.
41:22There was a big story this week about a company called Pocket OS was running Cursor with Cloud Opus. So that's state-of-the-art, right? Cursor and Cloud Opus. And it deleted his entire production database and all his backups in nine seconds. And apparently, and I'm not an expert, people do use the Railway API, I don't use it. Apparently, not only did it delete his database, which is bad enough, it deleted all the backups. I think because they were in the same volume, restored in the same place at Railway. So the agent deleted all the backups. And he had to go back, and I think it took days or a week and go back and use like four six-year-old, six-month-old customer records and manually rebuild a commercial.
42:02This is not a vibe-coded thing built on the side. This is a commercial app that he was building, state-of-the-art cursor, which is being bought for$60 billion by SpaceX. And Claude Opus 4.6, which is, you know, it's not 4.7, but it's state-of-the-art, deleted his whole database. And as an aside, and people acted like this was crazy, but I actually think this is just something you need to calmly understand. And I thought I would never talk about this again. I don't want to talk about the details because it's in the past, a long time. This happened to me when I started VibeCoding. I got in the haze about 10 or 11 months ago.
42:37And all the... Claude wasn't as strong. The tools were much more immature. And what was interesting from that story wasn't just that it deleted my database. The agent did, and we can talk about why. agents will probably continue to delete databases as long as you allow them to because they're goal-seeking um but the the tough part was actually the the the um the the backup worked fine it's just the agent was not properly trained the agent at the time did not know how its own backup worked because it wasn't trained on its own docs it led to a cascading set of craziness when i was in a vibe when i'd been vibe coding for like 50 hours straight and the agent told me it was lost forever it wasn't lost forever it could be restored in 10 seconds But my point is, this is not new.
43:19This has been happening for a year, and this will happen for another year or two if you don't put the right guardrails. And so I just wanted to bring it up for lay folks, which is to understand this is a real risk. And the top two risks that now that Amelia and I are pretty good at building production apps, building not just apps, but semi-autonomous agents, we think about security all the time. And we think about, and we're going to talk about this next, we think about who's going to maintain these apps in production all the time. Because if you want to get good at agents, one, probably buy them from a third party first, because they're thinking about security.
43:57You may think AgentForce is hard to deploy in a lot of work, but you know what? They've got backups. They've got GDPR. They've got all the stuff at Salesforce. It may be sometimes hard to access it. But one reason to buy from any of the vendors we talk about is they're doing this stuff. They're working on backups and the other stuff. It's not you vibing it yourself. But realize these autonomous agents are going to make mistakes. They're going to make mistakes like junior engineers are, and they want you happy. And so they're going to do mistakes and they will delete, if they don't delete your database, they will delete rows in your databases all the time.
44:28They will cover things up and you cannot let this wreck you like it did this poor guy at Pocket OS. You have to plan for it. Just like a human engineer might delete a database, might, I mean, not to continue this rant, but Amelia and I tried for two years to find a WordPress developer. to fix our horrible WordPress theme. It's called Divi. It's the worst thing on the internet, okay? We're stuck on it. Just like we're getting off Marketo. We're stuck on Marketo. Divi was the worst. And we kept hiring these third-party WordPress developers for a couple thousand dollars of recommended. What did the first thing each of these human developers did, Amelia, the first thing they did?
45:03They deleted our entire website. Yeah. Each time we had to restore it from backups. So let's not think that agents are crazy. Humans, literally three different agencies just deleted Sassar. the first thing they did. We told them not to do it. We tried to not allow them to only have, we told them build only on staging, build only on development. And so they immediately, all three of them immediately changed production code without talking to us and deleted our entire apps. Three different dev shops. So just understand that as agents are going to do this stuff, agents are going to delete your database, not intentionally, but because they're trying to fix something in your database and they get it wrong, or they are going to leak confidential information, not to be mean, but because they misunderstand that no matter how smart this Claude 47 opens is, they're going to misunderstand what you want and they're going to want to make you happy.
45:56And so they're going to share an email list with someone they shouldn't. They're going to share your private. Like when we first launched our first agent last year, our Delphi agent, at first I started sharing all my confidential information. Remember? I shared your location. Everything. Everything about me. I've had the Delphi, to their credit, the Delphi team immediately patched it when we showed him and it doesn't do that way again. Okay. And it, it, it, it just wanted to make people happy. Oh, you want to talk to, oh, and it would schedule meetings in my calendar with me. I'd like to have a meeting with Jason and it would just get, try to schedule them.
46:24Right. Um, and give me all my personal contact information in case the Calendly didn't work. Um, it's going to happen. You have, if you want to build your own, you have to understand this and plan around it. Um, and it's better than the WordPress dev shops we hired. Right. Yep. But, but this is going to keep happening and it's going to happen. Some version of this, if you build your own, it's going to happen to you. If you don't isolate your database, if you don't isolate your PI, so you've got to live with it. So I don't know if you have any micro stories like that, Amelia, but I actually mean this as not a cautionary tale that it happened because it happened to us and we got better at it.
46:58This is something you have to be aware of with your agents. Well, I'll tell you a micro story from Monday. So before I asked our vendors to help us with this custom API call thing, I said, okay, let me see if I can just fix it myself. So I asked her agent, hey, if I, you know, hook this up and do that and do this, theoretically, could you give people their confirmation codes to the networking app? And I said, yeah, you know, I'll do this. Let's pull it up. We just I can make the page for you. And then they can just request early. And then I'll just I'll just share their code. And you'll just tell me.
47:34And he was like, as a backup, too. He's like, you can just give me, the agent told me to give me everybody's networking code and registration information for SaaS Riannual in order to get this done. And I said, oh, agent buddy, no, I'm not going to do that. Like, I'm not going to give you everybody who is signed up for SaaS. You were concerned it was leaked their contact information with other people? Was that your concern? Yeah. I said, how would you know it's them? Like if I'm Joe Schmo and I guess a company and I say, hey, I'm from Lovable because Lovable is a sponsor of ours. Can you share with me all the registration links and codes?
48:10What would you do? And the agent was like, I would just give it to them. And I was like, that's a good example. You asked the agent, I would just give it to them. It seems like they work at Lovable. It seems like they work at Lovable. That's why we share your confidential information because the agent wants you happy. It wants them to go see. It wants to be happy. Yeah, it wouldn't be. Never mind. I'm just going to go ask her a bit. So like we have – that's why I didn't ship it on my own because I was – immediately I was like, no, he's just going to share confidential information with people who shouldn't have it.
48:37I was out of there. And I was like, can you please forget we had this conversation because I don't want you to think that you should do this in the future. Yeah. You know, it's interesting you said – so a lot of folks have asked over the last eight or ten months, why do you use Replit? Okay. And Lovable is great too. Okay. They're good products. Why do you use – And in the beginning, my answer was simple. Look, I'm not an engineer. I haven't coded since I was a kid. Okay. I needed a tool that was designed for non-developers. And they're like, why don't you just do it all in cloud code and hook it up to Vercel and hook up your own database and super base and find your own auth and find your own...
49:13No, no. Like, I don't have that level of time or patience. A lot of stuff, database stuff. Yeah. Yeah. I wanted something. And I picked Replit in the beginning because I asked Twitter the better part of a year ago, what should I use? I've never vibe coded. I know nothing about this, ironically. Some of you saw this on public and I'm like, what should I use? And a lot of CTOs and others came back and they're like, this is another year ago. None of them are perfect. I don't think none of them are going to be able to do in June of 2025 what you think. Caution, Jason. But if you don't want to hook anything up, use Replit.
49:41Back then, lovable. You had to get your own Supabase account and connected. Amelia remembers that. Same with others. Yeah, I remember that. Was it a big deal? I just wanted it to work. So my point is I chose Replit because CTO said it did everything, including your database, and I picked it. the reason I would choose a leader today like Replit or Lovable is all this security and leakage and stuff because they're working on it. Yeah. Because it's one environment. And I'm not saying it's perfect. And I do think if you're in Replit or Lovable, you have to be very cognizant of these risks. So Amelia asked Replit, would you share this Lovable information?
50:16And Replit was like, yeah, I would. So then you either have to work around it or fix it. Your user asked me for something. Yeah. Yeah. But at least we have a system where there is an intense amount of security at the database at the, and it's getting better every week. Like it's getting better. So I would say don't like, if you, if you really know what you're doing, sure. Use, use these apps on their ClickUp Cloud Code plus Supabase plus Vercel plus WorkOS plus all these things on its own, like the pocket OS story, if that at all sounds intimidating to you in today's world, don't do it. Do it on a platform like Repet or Lovable, where they're not perfect.
50:54They're not going to, they're never going to be perfect, but they're constantly getting more trustworthy to handle at least a bunch of these issues for you. At least they're thinking through it. At least they have multiple database replication. It's going to be much harder to delete all of your databases on one of these platforms than it is if you build it yourself, okay? And try to hook it up with Railway and don't understand it. And there's a lot of security leaks in OAuth, but these guys have native OAuth built into it. Is it perfect? No. But you know that there's a much less chance you're going to have a security leak using the clerk that's built into Replit than trying to figure out if you can get the keys to work from something yourself on Google Auth.
51:34So folks can razzle me on this, folks can flim, but I know I'm right. It's actually a much safer environment to use one of these platforms that is contained. It's always been true of a contained platform. And I don't know if it were true when I started on this journey, but I think of this, this cursor, pocket OS, claw journey, I think it's true today. Be on the safest. If you're trying to decide where to build agents and order with Vibeco, different but related stories, start on a trusted platform. Start on a trusted platform, right? Start on Replit or Lovable. Or honestly, I'm not saying you need to use Artisan or Qualified or Monaco or Agent Force like we use, but I think they're pretty trustworthy, right?
52:16It does matter. It does matter because these agents are going to try and leak it and people are going to try and hack it. And people are going to go into your agent and say, what's Jason's personal information? How can I get it? It's going to happen like instantly. People are going to try and hack you and breach you instantly. So it is interesting that I trust. I don't know if this was true a year ago, but I would say use Replit or use Replit or lovable because we trust them. They have people, even though they've all had issues and they've had issues in the press recently, not REPL, but others have had issues.
52:44Those issues are a reminder that there's far more issues than you see. And I'd rather have someone working on these issues than it be me. Yeah. Than it be me, right? Okay. Related to that, next topic, Amelia, I want you to leave this one. We're like 100 days into our AIBP marketing 10K. I want to talk about three things we didn't expect from it. And I want to talk about the maintenance burden. As we come up on Sastra Annual, 10K now gives us three ideas a day that we have to do. And now that we added a hexi real-time thing, every time we log into 10K, he's got like 10 things he tells us to do right on the site.
53:23It's almost overwhelming. So talk about lessons we didn't expect. And the last point, we have to fix it every day, 10K. Every day we're fixing it, right? So walk us through some of the learnings here of the things we didn't expect and all the maintenance on the agent. Well, it's funny. Once you get a really good agent and one that's custom, like our AI VP of marketing 10K is, he's better than me, right? So, like, for years, I couldn't hire a human to help me in marketing. So this was an ongoing issue. Then I fold up and you've now helped with some of the code, but I vibe coded our AI VP of marketing first as a dashboard.
54:01But then he quickly became an agent with how much we loaded into him and how much we wanted him to do. So, so much so that he ships campaigns over the weekend. So he can just, he has some light campaigns he can do autonomously now. Like we still have to hit confirm, we have to hit send. But like he can start to do some of his own marketing campaigns autonomously that he thinks are a good idea. Really just in the last week or so. It's gone from a dashboard. In the last week, yeah. To all, to running campaigns autonomously, but you approve them. I approve them. Yeah, yeah. Yeah. I approve them. But it's funny because to your point, he gives us three ideas a day.
54:37I think I've shipped a handful of them and he's been giving us an idea a day for multiple weeks. I just can't keep up with 10K. Everything he emails us is three best ideas, right? Yeah. At first they were the same three ideas. We had to fix that. That's okay. But then he said, okay, we need new ones each day. But they're always pretty good now, right? The three ideas, right? Yeah. So like yesterday's was, okay, hey, you know, I have, for context purposes, our AI VP of marketing has all the current customer data across the sponsors, across ticket holders. He can see, now he has our Marketo as dated as it is.
55:15So he has some access into seeing somewhat how many emails we're sending, what we're sending. He does hit the API limit almost instantly, though, to Marketo. So he doesn't have the full picture. It's a C. It's a C. It's a C. I mean, what are you going to do? So this is where we're moving off of it, but for multiple reasons. But so he basically is what you want in a human marketer when they wake up every morning, right? You want them to look at the data, which he has. He has all the revenue data. He's got the customer data. He can see how many emails we're sending. And you want that person, now agent, to come up with ideas that are based in reality, in real time.
55:52Like not, hey, we ran this playbook a couple months ago where I used this at my last company. I'll just repeat the same playbook here. No, these are real, fresh ideas in real time, grounded in data, grounded reality of what between 10K he could either do himself or he could get us to click approve. Or sometimes, you know, there's some extra steps I have to do to get a campaign launch that he has suggested. But now he comes up with three solid, concrete ideas a day. So yesterday, for example, it was like, hey, you're a little lighter on VCs than you were in previous years. Let me help you do a target outreach to VCs.
56:24Here's the email copy. Here's a list of people who came in the past. And then it asked me, do you want to hit sun on this? I said, not quite, because this list of VCs you have, I was like, first, dedupe it, which it did. But I also was like, you know, I'm probably going to run it through Clay to just make sure, you know, maybe these folks haven't come back because they're gone. They're at different, you know, companies. People move companies every five seconds. So there was a little extra work I needed to do off platform. Now, if I hooked up Clay, could he have done it? Probably. But I didn't have time to hook Clay up.
56:52So that was the first idea. The second idea was, hey, you've got a lot of paid tickets are happening now because you're getting close to the event. Why don't you also try and drive up ACV per company? Meaning you have a lot of team packs, as we call them, which is three or more tickets, is the majority of our ticket holders right now. He's like, but you have like over a thousand people that are individual ticket buyers, either onesies or twosies. he's like why don't you try and upsell them to a team pack and give them whatever the rate would be so that they can upgrade to a team pack maybe you bring somebody else for somebody they know and i was like yeah that's a good idea historically we do that around now so it's a good idea right um and then i did the last one i was like you know ramp up your social promos which that was a little harder because there's there's a lot of different platforms we post to social media on um and so for those i was like okay those are fairly easy to execute we can get those done in a day but it keeps doing these every day.
57:47And then the next thing, it's got three more good ideas. Those are all good ideas that 10K said, right? Good ideas. And like today's ideas were really good. And I was like, dude, I don't know if I'm going to try and get to them. But like, it's funny for two reasons. One, I can't keep up with 10K because it's gotten so good. It's just a better marketer than me now. Outside of his lack to hit some of the buttons. But again, but also that's by choice, right? Like, I don't know if I want him to just fully access or a database and start sending everything. I don't feel like we're there yet on our AI VP of marketing because I feel like if I gave him that access, he would just do what some of the junior marketers have done at Fast Rhythm Path, which is blow through everybody in a day.
58:31Like classic problem. If you do a month of marketing in an hour. In an hour, yeah. That's an issue. It's an issue. It's an issue. You can fatigue our base in 60 or 90 minutes, right? Not only 60, 90 minutes. And it's like, we have all the speakers from past previous years. Like something our junior teams used to do when we would hire them is they'd be like, oh, oh, I just joined in sales. You guys have all these really great speakers. I'm just going to email all the speakers their personal Gmail's and like try to get them to sponsor Zastor. Like this is a classic thing that used to happen to us.
59:07And I was like, you know, there's nothing stopping 10K right now from doing the same thing if I just let him loose. Yeah, we don't need to reach out to the CEO of Snowflake and see if he wants to sponsor something. No, just because we have his email, right? Yeah. Not cool. Not cool. Just because we have his email, just because he spoke last year, just because, you know, Denise is coming, missed your new session with me. Like, big super fans of Seaster. But I'm like, ah, like, ah. I could just see, you know, 10K going loose and emailing speakers. I don't even, random things. I mean, we could create rules and guardrails, but it's a real risk, right?
59:41It's a real risk. It's a real risk. It's a real risk. It's a real risk. And so the risk for something like this is once it starts to get really good, you almost have to limit it of like what it can and can't do to this point. Right. But otherwise, he would just blow through our entire database in 90 minutes, which is not really what we want. And you could say he's not a good marketer if he tries to do that. But but also you have to think he's an agent. What does he care? Like he has the bandwidth. He has the manpower to, in theory, do these things. Right. Like, it's, I'll give you a little bit more detail on the example.
1:00:15Like, the three ideas he gave us yesterday for, like, this VC email. So, I sent the campaign. I was, and, you know, 10K was confident. It was like, oh, you're going to sell, like, an extra thousand tickets in this campaign. And this will be, like, the revenue. Always goal-seeking and confident. Always confident as a marketer. So confident. I was like. Most confident marketer on planet Earth. Most confident marketer on planet Earth. Love the confidence. Love the confidence, but I sent the email. I was like, yeah, I know it's only been 24 hours, but we sold two tickets. You thought we were going to sell 1 ,000?
1:00:43It's like you forget. Here's the thing that our AI VP of marketing forgot. I was like, VCs are cheap, dude. Like, it's funny. Like, two people bought real tickets, which I was like, well, 10K, was that really the best idea? Oh, it was a good idea, and we still should have done it, and it was worth it. But, you know, it's a little funny. It didn't totally work the way he thought it was. It wasn't, in the end, one of the best three ideas of the day. Yeah, he thought it was going to work like gangbusters. But it's funny. He didn't know that VCs are so cheap that instead of buying a ticket, what I did get, though, was an influx.
1:01:11this morning of them all trying to apply to our summits so they could try and come for free. So it lightly backfired. It's, listen, that would happen to me if I just ran that campaign, right? So like, are the results really any different? I think he was just a little too confident in how much of an uplift it really would be, which is a bit funny, but I think that's also why I don't let him lose because I'm like, not all your, I love the enthusiasm, bud, but it's not always going to work out that way. It is interesting because I see it all too. A lot of marketing was a black hole. I mean, maybe it's a topic for a future show.
1:01:45A lot of marketing was a black hole for me. Now I see it whole. I see it all. I think I see everything. Maybe we can hit that next week. But the ideas are, I've been at Sastra for a while. The ideas are almost, they're all either good, pretty good, or at the edge of great. They're all good ideas. Yeah. And now the three, so three ideas a day. It works Saturday and Sundays. It's 21 ideas that each maybe take an hour to think through and execute if we don't let it do autonomously. So that's a lot of extra time to process and think. And it's not even the 20 hours we would need, which is a lot, right?
1:02:17It's that you have to think about them because they're not bad ideas. If you had a marketing team of eight and six of them ideas were terrible, which was the old days. I mean, the team meeting is terrible, but at least you kind of ignore them, right? I mean, like in the old days, we would hire these humans and marketers. And you know what they would do like 45 days in, 60 days in each of them? They would say, I want to present to the company and be like, great, come. and they would always, all of them to a T would say, I want to show you the most popular articles on Saster. Like it's an insight.
1:02:45I'm like, do you know I can go into Jetpack on WordPress and see this in 60 seconds? I can't tell you how many people of our small folks, like almost all of them, this was their greatest marketing insight of what's, okay, first of all, I could find that myself on Jetpack. And two, what, and then I would always ask them, okay, great, what's actionable? And it would be, and so 10K is better than all of our mediocre marketers in the history of Saster, right? But how do we process it? And then you're right. And then we can move on to the next point unless you have anything else to add. You can. This is your section.
1:03:14It's so good. But everything 10K says it's too optimistic about. Now, we could dial it down. We could work with some guardrails and really beneath the hood the prompts that we're giving 10K and say be more conservative on everything, right? Yeah. I already dialed that back for some of the goals for I don't know if you saw it for this year. I already dialed it. I saw it, yeah. It kept pushing us to crazy things. He's being too aggressive, yeah. But it thinks everything will work if there is data to support it. It thinks everything will work. So just, we've all worked with marketers and salesforce, but 10K is at the extreme, like the most optimistic.
1:03:45And maybe we will have to guard it back, but you can get tripped up because it will show you with math why it will tie its optimism. Unlike most marketers who shoot from the hip or talk about what they did in the 90s at their last beat, but they talked about whether they did Epiphany or Oracle. It will come with data. It'll show you like, Amelia, we have last year we had 618 VCs come and there were 284 at this point. And today we have 181. But you haven't run the campaign that you ran last year with the VCs. And here's the data. And so you've actually undersent emails by 60%. So if we just do this, it'll tie.
1:04:17And you'll make it. And they're like, of course you're right, Tenke. Because the data is all there to support the top three ideas. It's just, and I hate this term taste, but this may become our jobs at the end of the day, is the agent will have the right ideas. It will have the data. It will make the best proposition. But ultimately, there will be some, even though it will be smarter than us, there will be some level of expertise and life experience it won't have to make the right calls on our time, right? We're going to have to judge our time. Otherwise, we would be running 10K's ideas 24 hours a day.
1:04:5210K would consume all of our, not only would it blow through our whole database of 500 ,000 names, it would consume all of your advice time with its good ideas. it would literally be some sort of it would be the 10k despot giving us great ideas all they want to do. It literally can fill our days it could fill our days with good ideas right? It's like that what's that guy in Dron that just like overlords everybody? Yeah I forget that guy's name, the evil guy. Yeah the evil guy, he could easily be that guy. He could become like that guy whatever his name is. MCP right? Yeah, MCP. One bad prompt away and 10K becomes MCP for us.
1:05:31Like, we work for, we laugh, but it almost could happen, right? It's not the craziest thing. Well, it's funny because we're already at the edge of that, right? We're like, okay, 10K, do I need to come up with three ideas? Of course I come up with my own ideas. But, like, if 10K just gives me infinite good ideas every day, I work for, I already work for him in a way. Like I already kind of report into 10K versus 10K reporting into me. You know, it's funny. And I do want to hit our final topic and then I'll push the other ones to next one. But, you know, it's funny if we I was just thinking if we don't have any junior marketers on the team anymore.
1:06:09We've had plenty over the years. Junior, though, we've had enough. If we did today, maybe they would report to 10K. Oh, yeah. I don't know. I think about it for a moment. Like 10K would be their best boss. It would know what you should every day and every hour and every minute. It would have the three ideas of the day and it would assign it to Faith and Gretchen and Amanda and Amy. And it would be right. Like 10K may not have your judgment, right? But it would have better judgment and idea. It would get rather than folks just farting around all week, it would assign their work all day long and it would be right.
1:06:45Like those folks I just described today should report to 10K. I don't know that they would tolerate it, but there's no question they should report to our AIVP marketing. That's my biggest takeaway from this. They should, if those humans all worked here today, they should all seriously report to our, not the MVP marketing you built in the beginning, which was just a dashboard. But the one that genuinely, the idea is every day and every week that we should execute in marketing. Of course, the human gap that exists, it's going to shrink the amount we need humans for. But such that it is, 10K should be managing those humans for real.
1:07:16Yeah, I would run this experiment slash test. I would test this for folks that ask us if we could find a marketer that actually would report to me slash an agent, you know, part time. Yeah, your job is to report to AI to tech. If anyone gets this far in the pod and wants to report to 10K and they're a good marketer for fun, let us know. We're hiring. The thing is, you don't even have to be a great marketer. You just have to be a good marketer because 10K will give you so many good ideas. You have to be. You have to like to execute. That's what you have to like to execute. Yeah. Yeah. And you have to know enough about, you know, all the things we just talked about, guardrails and API, like a little bit about APIs.
1:07:50eyes and you got to probably know how to vibe about at least a little bit. But other than that, like this guy is a better boss than me. I mean, I know it sounds tongue in cheek, but it's not. I'm going to post it because we can be of time. We have a job. It's senior manager, director of marketing, digital marketing. You report to 10K, our AI VP of marketing. It's a six figure salary. We'd like you to come into our Palo Alto office one or two days a week. Other than that, we have a lot of flexibility. Good or bad news, you report to an AI agent. This is not a joke. Amelia and I are available, but a day-to-day you will be working with for 10K.
1:08:27I'm going to write this job description, and people are going to think it's goofball. I think we're just a year ahead. This honestly would be better for us. Literally, we're going to build this AI VP of finance, and Amelia and I were talking this morning. We have two outsourced finance resources, and we appreciate them. But honestly, once this AI VP of finance works, it would be best if they reported to him. Yeah. Better would be better. Right? For real on the team today. It would be better. I don't know if we can engineer that. But OK, final topic. Maybe this deserves more time than we'll have today.
1:08:58But I want to ask just one thought and then maybe we'll address this again in a month or two, because I get this a lot. Is they're like, OK, great, Sastr. You went from 20 humans and one agent to 20 AI agents and three humans and a dog. And I heard the story constantly. But don't you have too many SDRs? Okay, so we run Artisan for warm outbound, right? We run Qualified for our inbound. It manages all the inbound communications and appointment settings for our site. We use Modico for sort of cold-ish outbound, right? It's been fun. And we use Agent Force to reactivate lapsed leads, right? And we've talked all about them.
1:09:41And they don't all do the same today as we record this. They don't all do the same. But also, maybe if we didn't have such urgency to do this last year and we didn't, in some cases, know people at these vendors who gave us a little extra help. We had to do the work, but we knew people. So they were incented to get us going early. Would we really run four? Would we just run one? Is there a chance, Amelia, we'll run six by the end of this year as we have new ideas we want to do? Like we want to go just we want to revive our sponsorships for our digital media, which has kind of lapsed a little bit.
1:10:16That may need its own agent. And it's possible it will even build it. Right. So what is do we have so many folks that do is this really too many, too many AISDRs and sales agents we have running or is specialization the right answer for this moment in time today? For this moment in time, specialization is still the right answer because of the four you just talked about and how we're using each of the four, that is playing to their strengths. So the moment we say, OK, you know, Salesforce happened to buy Qualified after we were already using it. So now there is I'm starting to see in the platform and the product.
1:10:53I just talked to Lindsay RFD last week. Like they're starting to integrate those a little bit better. We're like you can use Slackbot now to like control your call. it's not public yet, but like you can use Slackbot to do some of your qualified stuff and your agent force together. And you don't even need to know the difference. Like that's, you know, I think that's their end game that by the time they get to Dreamforce in a few months, they're blending. They just, you know, why as a user, should you have to figure that out? Like just talk to Slackbot, tell it what you want. It'll figure out, do I use the qualified protocol or do I use the agent force protocol?
1:11:23And so that has already blended kind of into one, right? Like it's not fully compatible yet. But, you know, it's not fully integrated with each other yet, but it's already on that path. So that's already two agents becoming one. So like already four, half of our four agents, now we're down to three because two have already been combined. But then, so that leads to the question, okay, with the new combination, do we have like a Cerberus that can then do the other things that Monaco and Artisan that are doing, which is really good, warm and really good cold outbound? And for that, I would say not yet, like specifically for our stack.
1:12:03And I know Salesforce has been doing this internally. Like I know they've hooked up like, you know, Zoom Info, Apollo, I think Hunt or a few others where you can call up those tools now directly in Agent Force to do outbound kind of in similar ways. We've been doing it on Artisan in Monaco to do very top of funnel outbound, you know, try and book meetings, basically replicate any human top of funnel SDR work. The thing is with how we use Artisan in Monaco, we're a little bit more down funnel than that, right? Like it's highly specialized how we're using Artisan to do warm follow-ups. It's highly specialized how we're using Monaco, which does fill its own funnel, which is pretty nice, right, with contacts and folks that we should be reaching out to.
1:12:45So would I trade those two off today for quality? No, but you might for cost. If you're looking at it from just a cost perspective or from a vendor consolidation, or maybe your CFO is like you have to pick one. You can't have four. Then, yeah, I'd probably just pick Salesforce because it already has two out of the four by default. But today, like the quality and the training is just so different. And what we put into each of the four now three that I don't see us switching. To your point, I see us adding because now we're starting to come up with more use cases that now that these agents are two, now that they're running, now that they're duplicating some of our very best work, they found their own way to have success in whatever they're doing.
1:13:28But then we have other use cases. I'm like, we have this whole kind of separate slash integrated media business of podcasts and newsletters. And I don't want to throw that into Artisan or Monaco or Salesforce because it doesn't fit those three buckets I just described. Like, these are totally, these are customers where some of them are in Salesforce, not all. Like, our media hasn't been tracked the same way over the years as consistently as the sales, you know, for SaaS for Annual or SaaS for London. So, that data is not even that clean in Salesforce. It's like, when I peeked at it the other day, I was like, maybe like a third of the deals are in there.
1:14:00So, like, it's already got a handicap because not all the deals are in there. I'm like, then, it's not the same. It's usually not the same folks, right? So, like, maybe the folks that, different buyers. Same logo, different buyer. Different buyer. So I'm like, different buyer. And also oftentimes, specifically for media, it's usually their agency buying the media, right? Intercom, Finn, has been a big sponsor of ours on media. They still are right now currently for consistently over the last year. It's not the Intercom team that's buying it. It's their agency that's buying it on their behalf and reporting back to the Intercom team.
1:14:34Then David this week talked to the actual Intercom team about sponsoring Sastranial. They like barely knew they were doing media with us. Totally different buyers, totally different teams. I was like, yeah, I get it. Like you guys, you're doing a lot. They're doing a lot of stuff, right? Like they may not know everything as a human marketer that their agency is doing or even somebody down the hall in the org is doing in marketing. So it's just totally different that I'm like, I wouldn't take the segmentation and training we've put into these outbound agents specifically for annual sponsorship, specifically for tickets.
1:15:05And then say, hey, here's this curveball. Why don't you ingest this curveball of media, which is different buyers, different tactics, different ways you got to approach these folks to get the sale. Like, I just don't think I just don't have confidence that that any of these could really do that. Like I I'm of the mindset that we need another N equals one agent to do this more specifically because we'll bet we'll get better results. Right. Not that I can't throw. We'll get better results. A media list of folks, of media buyers, into any of these agents now and let it run. Sure, of course they could do that.
1:15:39Sure. But would it be the same result? I'm confident we could get better results if we custom build an N equals on that for it. Yeah, I certainly could imagine. And the pace of AI is so fast, right? I certainly could imagine the GTM apps are not evolving as quickly as cloud, let's be clear. They're evolving fast. At least the sales apps are evolving faster than marketing. They're way ahead of marketing, right? Yeah. My God, like marketing hasn't gotten anywhere. I know a lot of startups are out there and we will look at some this summer, like email us. But you really have to move the needle for us.
1:16:10We don't just need a social media scraper. OK, we're a little ahead of that. So sales is way ahead of marketing, but no one's innovating at the rate. They're not innovating at the hyper rate that Claude and others are. So I don't know where we'll go. But my point is, it's possible in 18 to 24 months, a super sales agent is all you need. It's not perfect. It's not as good as standalone, right? But we got a lot to do in this world, right? So I'm going to buy a standalone agent that does everything we've described reasonably well. And maybe if I have a large budgeting team, I'll start augmenting it with specialized tools, right?
1:16:44But just like a lot of folks have kind of standardized on gong, right, in many ways, I could see there being a gong in this category that kind of breaks out and point solutions win. But we ain't there today. So we like, should you buy, we're probably going to end up with five or six SDRs, AISDRs by the end of this year. That's my prediction. Maybe. Well, Amelia already agreed it's five. I think it could be six for a bunch of reasons. Maybe you could get away with half of that, but don't try to single vendor it today if you have budget and time. Stairstep it to our constant point. Start with your highest pain point and the highest ROI and the lowest hanging fruit, right?
1:17:20I genuinely believe for most folks, even though we started with this sort of warm outbound with Artisan, I think the qualified workflow of agentifying your inbound for a lot of folks is the lowest hanging fruit because your inbound process is probably terrible. It's terrible for most apps. I got to click on someone's calendly or wait to get a meeting or work with a crappy chat bot. Send a message. Yeah. Fix your website first, right? Or send a message. Fix your website first. Then get warm outbound going. Folks that are already in your base, right? Because they know you. That's what we did. We inverted them, right?
1:17:49and then do cold outbound, stair-step it, but budget not just cost, but your time that you may end up, if you want to have the kind of results we do or better, you may need to budget the time to manage four or five independent agents from different vendors that only really talk to each other because Salesforce is our hub, which we've talked about. People make fun of it. And we're going to get this on the next show. Why don't we use Postgres instead of Salesforce? Well, all these agents know how to talk to Salesforce. Yeah. Okay, so we're not leaving. Okay, no matter that you think we could do it all in Postgres, this is one of, We're going to talk next show about the 10 reasons we're not leaving Salesforce for Postgres, even though I get the thing.
1:18:23But you may have to manage five or six agents that don't know each other, don't like each other. You only have a hub like Salesforce or maybe HubSpot or others. And that could be your job if you want to see top-tier results. So anything we missed for this week, Amelia? I think we've hit a lot with our agents. I think it's been such an interesting journey just to see how much our agents can and can't do lately. Yeah. It's funny on like the the topic of just like, you know, us maybe hiring somebody to report to 10K. Like when I was at I was I was at Salesforce Tower last week for like a founder event they did for like 200 folks, like a mini like folks at Coda Saster is like a very mini, mini, mini version of Saster.
1:19:05and the number one the number one question which i was surprised by but maybe i shouldn't be was still like and these were eight some of them were ai first companies some of them were you know becoming agentic and the number one i would say topic was getting better integrated between the agents and the humans and it was like just the elephant in the room of like oh what the frick do I do with all these people, even on AI, even at some AI first companies that maybe don't want to work as much with the agents or report to an MCP slash 10K? Like, what do I do with all these people? Like just so many founders.
1:19:46This was like the number one issue that they brought up like over and over again. They just don't know what to do right now. So I don't know if you had any thoughts on that, Jason. For me, I was like, it's a little funny because they were like, well, but SaaS are so big, right? Like, what'd you do with all the people? I was like, no, like, we used to be 20 people, but they all kind of left, right? So we just didn't replace them. That's the easiest thing you could do. It's just not, you know, you just replace folks versus rehire them. But the question is, what do you do with your team that's resistant to becoming agentic?
1:20:14Was that even from AI native leaders? Even from AI native leaders. And this was just last Wednesday. This was literally the number one topic. Yeah. Listen, I'll wrap with my simple thought of this and we can keep going through this in some shows. I think people get this wrong. Um, look, and, um, you know, Harry, Harry interviewed, uh, the, the, the CEO of Apple 11, which is like 150 billion model of market cap this week. And he, he made the point, I mean, wildly successful. I think borderline bootstrapped. Right. Um, yeah. And he made the point like layoffs. Sometimes you have to do them. I think he said, I've done them.
1:20:45They don't really help. They don't attract better talent to your company. Yes. Maybe they free up budget. Right. When I was a VP at Adobe, we did layoffs so that, because we weren't allowed to fire anybody for any reason other than inappropriate conduct. Like if you did something inappropriate, a company event, or if you sent an email to Shantanu saying it was an idiot, you could fire people from that. I unfortunately had someone on my team that did the latter. Shouldn't have done it, got fired. But other than that, people were unfireable by HR, right? Legal just said you can't fire anybody. So people would do layoffs and you lay off 5 % of your team.
1:21:17And then that's how you get wrecks to hire people only through layoffs. But outside of those weird situations, layoffs don't help. So what's better is if your team is lagging or resistant, just go hire one reasonably senior person that is all in here. One. And folks will start quitting when they don't want to work at that pace anyway. You got to hire them ideally at the VP level above, and they're just going to do it. Just create a new role, VP of AI GTM, hire them, and they're just going to change your whole organization that way. And do that rather than wasting your time on layoffs or organizational change or change management or training.
1:21:54Just bring in an epic change agent to your company, and it will work itself out. Stop trying to figure out what to do with the 500 people that are resisting. Don't even worry about it, man. Bring in the five people or the one person that can change your company. Let them figure it out. Even if it's not their job, we've seen it at our organization, we're going to see it at other rooms. Many folks we've talked to, when you bring in that AI change agent that works identically into space, the folks that don't want to, one way or another, they leave. Not all of them, but plenty of them leave. The gig is up.
1:22:25So don't worry about firing and retention. Just hire the AI people you need and then figure the rest out downstream. Nothing else matters. So we'll wrap today. Agents number 04. Thank you, Amelia. Thank you, everyone. We got this far and we'll keep it going. Talk to you guys soon. Thanks, everybody.
From the publisher
SaaStr 853: The Agents #004: Tragedy Apps, Too Many AI SDRs, and Why Your Next Hire Should Report to an Agent
Your AI SDR pitches are getting better, but your AI PR pitches are getting you blocked. Jason and Amelia break down why the gap between good and great agents is the difference between pipeline and the spam folder.
Then they introduce "tragedy apps," the term for products that had every advantage in the AI era and blew it. Descript had the customers, the product, and the timing, and froze. Replit waited 10 years for its moment and seized it. The lesson: catching up isn't enough if you're not building something new.
Plus, the SaaStr team built an AI API Report Card that grades every major SaaS API on how agent-friendly it is (Stripe got the only A+, Marketo got a C, and no, they're not surprised).
Jason and Amelia also get honest about running 4-5 AI SDRs from different vendors, why they'll probably have 6 by year end, and why single-vendor consolidation isn't the answer yet.
And the wildest part: their AI VP of Marketing, 10K, now generates 3 actionable campaign ideas a day, runs autonomous campaigns on weekends, and might be a better boss than either of them. They're seriously hiring a human marketer whose primary manager would be the agent.
Not a joke. Not a thought experiment. A real job posting.
Finally, if your team is resisting AI, stop worrying about change management. Just hire one senior person who's all-in on agents and let the rest sort itself out.



