


4 Sep 2026 · 1h 9m · 20 chapters

Building “product loops” (self-improving agent workflows) in Claude Code/agentic systems, contrasting with one-off prompting. Tyler explains a loop architecture: fetch inputs, do work, pass a gate (human/customer/tests), write an artifact (often via PR), then feed logs back to improve the skill/agent.
Tyler Folkman, Chief AI Officer and head of product at JobNimbus (Utah startup; raised a $303M series B, described as Utah’s largest). Background includes data science and engineering; leads product and engineering and builds internal AI/agent tooling.
Written by AI. May contain mistakes.
Explore what product loops are and their significance for PMs.
“Everybody keeps saying loops are the new prompts.”
Discover tools and systems for effective loop engineering.
“I feel like AI more than most things has a lot of hype and not a lot of action.”
Understand the role of agents in AI and their decision-making capabilities.
“and most people are interacting with it at a level of question answer, question answer.”
Learn how loops can be self-improving through feedback.
“So, and I actually have a little graph we can run through in a minute, it'll pull it up.”
Understand the visualization and structure of effective loops in product development.
“So when I was preparing for this, I started to ask myself some of these questions.”
Learn how the concept of reverting works in AI development.
“But to your point before, have a way back if something needs to go back because you don't like it anymore.”
Discover how JobNimbus approaches product development through loops.
“Yeah, if we kind of go next here, which the AI will kind of walk us through some of the things we do.”
Understand the role of AI in building prototypes and iterating ideas.
“And that's sort of what my AI is working on right now.”
Explore strategies for engaging customers and validating ideas.
“PMs, engineers, designers, anybody can do that?”
Learn how AI can enhance employee onboarding and training.
“So when you come in, we say, hey, go here in the terminal, run this skill, and it will actually walk you through the product.”
Learn how to avoid inefficiencies in AI-generated work and maintain human input.
“Yeah, that's got to be the most frustrating thing is that sometimes it feels like people are spending roughly as long as it took me to read this as to write it.”
Explore how to create and refine decision-making loops using AI.
“But if I just do that, and I, you know, write quit.”
Learn how to create and refine prototypes using Claude's capabilities.
“So the, the demos or the prototypes were not already built.”
Explore key loops that product managers should implement for effective customer engagement.
“Hooks that I find useful is one I did already talk a little bit about, which is like a post.”
Understand the risks of over-reliance on AI in product management and decision making.
“Whereas in a prompt or a skill, you say, never share a password.”
Discover the importance of maintaining quality in rapid engineering cycles and the role of PMs.
“And you say, go build it, and it'd be like built.”
Learn how PMs and engineers can collaborate effectively without stepping on each other's toes.
“Okay, so that's one part of it, which is PMs doing engineering work.”
Learn how AI can streamline product development and reduce risks.
“the business money or the customer happy.”
Discover the growing trend of multi-skilled product builders in tech.
“And we got hundreds of people to show up.”
Explore strategies for leaders to build skills and leverage AI effectively.
“In my opinion, yes, unless you find yourself in a very specialized role.”

Get the gist, explore an idea or ask about something said.
On The Growth Podcast, what are the key points of this episode?
Automatic transcript. May contain errors.
0:00We talk a lot about Vibe coding, but we don't talk as much about Vibe PMing. Everybody keeps saying loops are the new prompts. What does that actually mean? I honestly believe it's a very powerful skill for engineers to develop. In five years, I'm not sure we'll refer to ourselves by functions. There's nothing magic about being an engineer or a designer and that being in our title. Tyler Folkman, the chief AI officer and head of product at JobNimbus, which just raised Utah's largest series B round ever at$303 million. I know we talk a lot about AI versus people and replacing them, but I am a huge believer that with AI, it's more people-centric than it's ever been.
0:38That's kind of like career reputation suicide, I feel like, for a PM at this point, right? Like, do not ship anything. So should every PM designer and engineer be aspiring to upskill themselves into a product builder? In my opinion, yes, unless...
1:21And now, into today's show.
1:27Everybody keeps saying loops are the new prompts. What does that actually mean for product managers? How do you actually build a loop that's effective? What are the steps to improving that loop? Today, we brought in somebody who has the data scientist and engineering background. He is the chief AI officer. He leads up product and engineering at one of Utah's most exciting startups, JobNimbus. Tyler is going to walk you through not only how to set this up, but how to improve these loops, how to think about these loops. Nobody is teaching you how to do loops specifically for product work. If you are an engineer, if you are a designer, if you are a founder, you're going to learn so much about how you can potentially vibe PM.
2:11If you are a product manager, you're going to learn how to make loops and use loops. So I hope you enjoy this episode as much as I did. Tyler, thanks for being here. Yeah, thanks for having me. It's great to be here. So let's get started. How do PMs and product people use loops? Yeah, it's something we talk a lot about. I feel like AI more than most things has a lot of hype and not a lot of action. So I'd love to just show you kind of what we do and try to be really safe that I don't show anything I'm not supposed to. So what I've got up here showing is the actual system that I use every day to do loop engineering, context engineering, whatever you want to call it.
2:46And we'll talk a little bit about the differences. But the system I'm in for people that want to follow along is called Herder, which lets you essentially orchestrate agents and was built with a ability to essentially run itself. So I've built this thing called Orchestrate, which I can then tell it to spin up another agent to research contractor needs in 2028. And it actually knows in Herder, which you'll see it do in a second here, how to spin up an agent, how to open a new pane on the side here, which I can move between. You see I'm working on some different leadership stuff, hiring, and these green dots actually tell me what's done.
3:28Like this one's ready for me to look at. This yellow is it's moving. And then this one I've already looked at. So to get to your question, this is really the pain of glass that I use to manage multiple loops, which is kind of starting with getting an AI helping you. Why would I use Herder instead of VS Code or Cursor or Cloud Code in the terminal? Yeah, it's a great question. I think, and I was actually pretty skeptical maybe a year ago about terminal-based coding agents, but they've gotten so powerful and the systems around them like Herder have also been made in such a way that's powerful that it feels super native to work in the terminal where it can access what it needs to access.
4:11I get that this isn't as maybe sexy as VS Code, but for me, I can actually just have like a terminal open that's an editor if I'm doing some coding. I can also in that terminal spin up an agent. In Herder, I can even like split panes and do all sorts of work. So it's easier for me to have control over the agent loop cycle, as opposed to having to rely on VS code to release things at the pace that the industry is moving. And that's one of the things that's really fun about the community tools, because most of them are using AI to help build the tool. They move very fast and tend to evolve very quickly as AI improves.
4:46And then we're using this term agent. I feel like agent is like used done so many things. What makes it an agent here versus just another CloudCode instance? Super solid question. For me, the difference is an agent is doing something on its own and making decisions versus you consistently prompting it. So like GPT, ChatGPT came out, and most people are interacting with it at a level of question answer, question answer. I've heard people refer to this as almost like smarter Google search. Agentic is more you're giving it a task with a way to verify itself and asking it to execute on that by itself as much as possible.
5:26So you're taking yourself out of the loop more than you are with just like a prompt. That way you can actually scale yourself. Where I think prompting kind of got hard is you're kind of constantly in the loop and you're not really feeling the gains from what you get from agentic. Amazing. So what do we do next with this research contractor agent? Yeah. So it's off. It's doing its thing. It's actually going to report back when it finishes. I believe it made it in, let's see, right here, customer research. So if I click this, it's actually doing research and drafting some thoughts for me, which isn't really the point yet of this.
5:57And to kind of show what I was thinking outside of Herder with Loops, one of the things I was super interested in is like, can I use Loops or agents to help me prepare for this podcast, right? Like that's the most meta thing I could possibly do. So I pointed at like a bunch of stuff we do at the company and asked it to build various demos that we could kind of run through to show different things. And so what I'm doing actually is kicking off a predefined skill or agent that I've built that knows the things I want to talk about. It will then kind of walk us through some different examples. So one of the things I asked it to do, which makes it a little bit more of an agent loop, and you'll see that some of these things I'm not actually passing, is it's doing a pre-flight check before I record.
6:39Like, am I showing anything sensitive? It's saying, yeah, you might be showing some sensitive stuff. I think we're okay. Is the repo in a good state? I'm not actually in a sandbox, which I feel okay about, actually. It's got some fallbacks that are a little bit overkill. And then some manual things I'm supposed to do, like did we connect to Riverside and all that other stuff. So I did this on purpose to kind of show a few things. One, AI, when you ask it to, can be a great partner to help you do better. Like I wouldn't have thought about half these things, and it's kind of forcing me to check them.
7:10and I did run this before and I kind of decided I didn't care about like a sandbox. We're okay for this podcast. But every time now, if I ever wanted to use this in the future, that loop is starting off with conditions that I've told it are required for success. And now it's asking me, is this a rehearsal or is this actually a live run? And we're live. So let's say it's live. Do we want to start at segment one or start where I finished my rehearsal? Let's start from the beginning. And you can see, in my opinion, how this goes beyond kind of prompting and building an actual system to help me prepare or do work in a way that I feel good about and isn't just like AI slop.
7:49And you called it a loop specifically, what makes it a loop? Yeah, which we'll see in the end here. But one of the things it'll do, assuming it all runs as planned is towards the end, the way you close that loop is you feedback information into the AI to make this whole system better. So, and I actually have a little graph we can run through in a minute, it'll pull it up. But looping kind of assumes that you learn and it builds like this flywheel. So any good loop has this end that says, Hey, AI, let's review what I did. Let's look at the log of all this back and forth. And how do we take that and improve it?
8:26So that's really where the loop comes from. If you hear people talk about looping, it's this idea of self-improving agents. as opposed to a static skill, that the skill could just sit here and be the same forever, or we could take this entire experience and feed it back into the skill and have the AI improve it. And I guess what I get nervous about there is, is it going to save all the intermediate versions? Am I going to be able to easily revert back if there was some version of it that I liked before? Yeah, for me, Git is the main way I handle that. So very normal for engineers, a little less normal for product people, though I think that's changing.
9:03Git lets you version control these things. So actually one of the questions that popped up was saying, hey, your Git is unclean. What do you want to do? Oh, here he goes. I pulled it up. But I think that that is the right way to think about it, which is you can go back in time like Git. Maybe someone will make something more agentic. And there are companies working on this than Git. But with Git, I can kind of commit and move back in time. And those beeps you're hearing is actually it telling me I'm done with something. So if you hear those through the podcast, that's how I manage it. And one of the things I'd love to talk about is the importance of having your system so that you can roll back and also adapt to new models.
9:39Because what we're seeing is these loops that you might build or these skills or agents or whatever you want to call them. Different models perform differently. And you might go to a better model like Opus 5 or Fable 5 and find that your skill gets worse. And that's kind of a paradox to work through because sometimes you might have forced things that don't need to be forced anymore. Yes, I felt that way about a lot of my core skills. Here's a quick word from our sponsors. I used to think I had a retention problem. Turns out I had a messaging problem. I was sending the same onboarding emails to every new user, whether they activated on day one or never logged in again.
10:14I had no idea who was slipping or why. Customer.io changed that. Every message I send is now based on what users actually do in the product. Someone hits a key activation moment, they get nudged to the next one. Someone goes quiet, they get a different path entirely. Their AI agent makes it fast. I describe the campaign I want and it builds the full journey form. Triggers, timing, copy, even branching logic. And when I want to know how something is performing, I just ask the agent directly and it tells me what to do next. They also have an MCP server, which means AI tools like Claude can see directly what's happening in your customer.io workspace.
10:47Your segments, your customer data, your attribution, all of it. So instead of explaining your business context every time you need help, Claude already knows it. Notion used customer.io to personalize their onboarding and hit nearly 50 % open rate, improved conversion by 6-7 % with localized campaigns, and pushed open rates up another 20 % through A-B testing. The idea is simple, Customer.io helps you deliver more impact from every message you send. If you're a PM or founder and your onboarding is still one-size-fits-all, try Customer.io at Customer.io. If you've worked at any company bigger than 30 people, you know this one.
11:22The CEO sets strategy. By the time it reaches the people actually doing the work it goes through three or four layers of translation half of it gets lost and nobody finds out until the quarter is over that's the problem marisa was built for it's an ai operating partner for every manager and team connects to where work actually happens the meetings the messages the docs and it turns all that fragmented activity into a clear picture of execution managers get real coaching grounded in their team's actual work not generic advice. Teams stay aligned with strategy as it changes, not as it was last quarter.
11:54And leaders see where execution is drifting in weeks, not in the postmortem. One shared memory for the whole org. Everyone finally working from the same picture. If you lead a team, check out ariso.ai slash akash. That's A-R-I-S-O dot A-I slash A-A-K-A-S-H. So what are we looking at here? Yeah. So when I was preparing for this, I started to ask myself some of these questions. What is a loop? How can we visualize it? And working with AI, obviously, this is what I kind of think of is like part one is you kind of fetch your own stuff as much as possible. So you can see in the thing I gave before, research X.
12:26I didn't actually go do the research for it and give it to it. I said, go figure this out. It does some amount of work. Then there's usually a gate if you can have it, which is how do you validate that that work was correct? This is almost always the most important part. As much as possible, being able to make this deterministic is critical. There is this idea of like LLMS judge where it can decide And sometimes that's necessary. But we're seeing like with this idea of mirror coding, that if you have a lot of really solid tests around a piece of code, AI can actually replicate that code pretty agentically.
12:59And the learning from that isn't that like, let's replicate all this code that's already been written. It's AI is really good with clear boundaries and clear definitions of done and success that it can work through. So that's kind of like the part three. And then if you look at how it shapes it, it kind of writes out that thing and then allows it to learn and iterate and improve upon itself, hence making it a loop. If you miss the learning piece, then you're mostly just running what I would call like a skill, which isn't a bad thing. A skill goes to a loop when you feed back the learning so that it continues to improve.
13:31And so is there a step in here like before it creates the next version, I guess, between create the artifact and fetch its own inputs that it is pushing to GitHub or something? Yeah, exactly. So generally what I would do is if it passes the gate, then you would push a PR to GitHub for a human to review, which if you're just yourself building your own skill, that would be you. You'd kind of look at the decision making it made, how it wants to update things, and then merge that into the canonical main branch such that you are always using that going forward. But to your point before, have a way back if something needs to go back because you don't like it anymore.
14:08And are you often needing to revert back? How often does that happen? You know, I tend to with AI not revert back as much anymore because I can often what I think of as revert forward a little easier, which is to say if I don't like something, I almost tweak it forward as opposed to go back. Because often it's less of it's unanimously better in the past. It might be more of there's this thing that I used to like that I'm not quite getting enough of that I want to tweak the new version with. So I just fix forward. OK, awesome. So conceptually, I get it. How does this work in practice? Yeah, if we kind of go next here, which the AI will kind of walk us through some of the things we do.
14:46What we do at JobNimbus to kind of convert this into practice is we try to think of how we develop products. And I think of products pretty holistically. That could be a product for our customer or if we're doing something internally like using AI to develop our products or write code. How do we think of it as a loop? And if we kind of go back to this, this loop of fetching its input, doing work, the gate, writing an artifact, this all works pretty efficiently if it's code. But what do you do when you need to get like the gate is a human or a customer that doesn't work in your company? And right now it's kind of working on showing this.
15:23But how do you really get that into the loop so that it's fast? Because I think a lot of what companies are finding out is you might have a billion ideas, right? You can generate ideas faster than ever, prototype them, even build them in some cases. But is that something that's valuable and viable for the business? You know, if you go to kind of Marty Kagan's four risks, that's still really hard to figure out. And a lot of times it's because you're missing a clear gate. If we go back to this picture, there's not a clear defined gate that you can quickly iterate on because it's your customer. You can't just constantly lock them in a room and say, hey, do you like this?
15:57Do you not like this? And even if you could, you have a bunch of customers. So how do you manage that is a challenge. And one of the ways we're trying to adapt to that is actually, one, being way more customer-centric than we've ever been before, like using the savings that AI gives us on other things and spending it with the customer, and two, trying to mind anything they've already given us with the most AI or efficiency in tech we can. So we have a bunch of recordings and calls and interviews, and that might have been a whole team that had to work through that. And now with, you know, Cloud Code, you can point it out, all those transcripts, pull stuff out, and really more efficiently build that gate to at least filter out some of the bad ideas.
16:36And that's sort of what my AI is working on right now. It's actually using our product skill, which the first step is to build a bunch of prototypes. So it's actually going through and building just some random prototypes around payment follow-up. Not really anything we're particularly building right now, but as an example, it's going to build me three. And I just kind of wanted to showcase if you think about that loop is doing something at the first step while I'm not even doing anything other than talking to you. My AI is doing actually a lot of work to build ideas. The hard part of the loop is going to be validating that it passed the gate.
17:08Wow. So where did this prototype come from? I missed that part. Yeah, the AI just was still working on the it's going to build three of them variant C and B. And just when I said keep going, it started working on it. So this was built while we were talking. And what did we do to kick this off? Like, why did it know to start a prototype? Can we look inside that product skill? Yeah, I go. And that's not in here because I kind of demoed it. And I can go find it. But if, and in fact, this is a good example of herder. So if I wanted to spin up my own kind of pane here, I just say new. And then I can go into our product area.
17:41Wait, not that one. Really the best one to show would be like forge. And it might be a little bit hard to walk through the exact skills. but if we look at all the things in here, you will see this dot clod. And this dot clod has actually got a bunch of skills and commands that let us do a lot of this stuff. So we essentially built our own prototyping system. And by we, I mean the UX team here is awesome. It kind of being at the cutting edge. And so we've got a bunch of skills that let us do really cool things like create an iOS prototype, and Android one, port components, pull requests, run content.
18:21And there's more outside of this. This is just kind of an example. But really what these skills do is take a lot of our beliefs in how to build product and design and convert them into something a little bit more deterministic. It's not code, but we do try to kind of build those into canonical shapes. And then we can say to the AI, use this skill to generate 10 prototypes to solve this problem for our customers. And then we can start iterating on the feedback loop. Got it. And I think this is an important point. You're having your domain owners create skills for their specific area. And so the UX team is creating the prototyping skills.
18:58And I guess the product team creates the product skills. Yeah, exactly. And you can see it kicked out two more. So like we tried to get it to spin out variations of an idea. And these ones are pretty basic for speed. But you can see like payment follow up. then there's like a crew schedule one there's a different crew board uh idea here's another one about what you might need to know today because the idea with ai is how do we actually test a lot of ideas very quickly because ai is really good at that without building yeah as opposed to building the thing we think is right and then just doing the normal product cycle like you're kind of if you're mostly using ai to build in production that's valuable but man can you use ai to build prototypes way faster.
19:41Like instantly anyone can build a prototype and go talk to a customer about it. So now that I have these prototypes, what do I do next? Yeah. So for us, the next step would be, and unfortunately we don't have this skillified quite yet in a great way, but we've injected all of our customer research calls, transcripts into our data warehouse. So you'll actually have an opportunity to synthetically kind of have a customer inspect the prototype through AI. so it will kind of try to think like our customer we get you know for anyone that might be a customer that that's not the highest bar but it is a good bar to catch some maybe low-hanging failures that we missed right and the reason we like that is it lets us very quickly move through this loop right you need a gate and so we can quickly go from maybe a hundred ideas down to the five best ones and then we start getting with our customers setting up calls talking to them getting into the office with them or on the field so that we go from a bunch of ideas to some ideas to a few ideas to hopefully the one that we then finally go build and then do A-B testing within production.
20:46But the idea is you lower the amount of effort until you get more and more validity of your idea from the customer. And so who would be running these customer outreach? PMs, engineers, designers, anybody can do that? Or how does that work exactly? Because sometimes like the UX research function in particular has like a very strong point of view about who can run those and how they should be run in order to get accurate insights. One of the things we're working on, and this is newer muscle for us, because traditionally it has been more of a UX product run thing, like most companies, really trying to maintain the standards and do things right.
21:22And that's really important. But we're trying to build the muscle of everybody doing this weekly, if possible. In fact, we try to aim for like twice a week. We're not there, we're still working towards that. But if you think about with AI, where the new bottlenecks come, this is going to be one of them, like getting in front of customers and talking to them. And if you try to gate that too much, it's not going to scale with the speed of AI. So we're trying to figure out how to really invest in our people, such that anyone can start to talk to the customers and know some of the like obvious traps of like leading the witness or biasing them too much you know the only thing worse than no data is really bad data so we don't want that but we really believe it's possible with ai skills and training and really leaning into the people side that we can get anyone to talk to customers and really validate ideas and that is a new muscle like some people have never done this might be a little uncomfortable but we think that's that's okay makes sense so what has it done next and you can see as we go through this if you don't use Claude as much it's doing what they call hooks.
22:24So it's trying to make sure it does everything that I've asked it to do essentially. Ah, so now it's showing you kind of a representation of the onboarding that we do here, where, you know, we talked about how we really onboard with AI and want people to have a good experience. And what we found is a lot of having a good experience is having like a clear roadmap to success. So like stage one is like setting up all of your stuff. Stage two is like understanding the customer market for where your team is, the different strategy and principles. We've got that all codified, the product process, the loops that exist or the skills, and actually shipping something.
23:03And so these are just some of the high level buckets, but we actually can basically build a simple doc that explains the person, their role, what team they're on, who their mentors would be, who they need to connect to. We feed that to AI. In fact, AI really interviews us for that because we've codified it. And then it generates a whole onboarding flow for them that they can work through. We use linear for our project management. So it creates them a linear board, they come in on day one. And we still talk to them like, don't worry, there's a lot of human elements here. But for when they're kind of on their own and working through what to do, they don't actually have to remember from the conversations they have clear, hey, you should be with these people.
23:41This is your mentor. This is where you start reading about the product strategy and our process. And we found that the onboarding is way more efficient and also just way more enjoyable because you're not spending so much time just trying to get up to speed. So how do you build an onboarding like this? Basically, it's like a HTML walk me through getting onboarded on my job. What we found is AI is really good at systematizing existing process. So if your onboarding is already kind of wild and all over the place, the first step is to write down what you want the process to be. Then you can start thinking about where AI can help.
24:19So for us, like the key pieces were like setting up your laptop. Okay, cool. We can totally codify that into the onboarding. Setting up meetings with people. Actually, the AI now will just use my calendar and set up the meetings for you. So that's just automated. I just tell it who you need to meet with in the first week, and it finds time and sets it up. Another one was customer research and the product, like really understanding the product. So we built a product tutor. We put it into our repo. So when you come in, we say, hey, go here in the terminal, run this skill, and it will actually walk you through the product.
24:50And then if you have questions, you can get answers right there. And so it's going to be different for everybody depending on where you find value. But if you can write down your system, then it kind of usually becomes pretty clear. Okay, this AI could help with this. It can't like talking to customers. We don't want that just happening in docs. because we want you out in the field talking to customers. So we'll have that being set up, but not AI-ified. Thinking through some of the pros and cons is something we want humans doing. But there's a lot we found, especially in onboarding, that's just process.
25:24It's just getting onboarded. It's just kind of being up to speed on everything that's already been done. And my worry with long documents like these is that AI will create this fancy thing, and ultimately you just spend more time editing it to get it to be accurate than you would have if you had just done like a simpler version yourself. So how do you build this in sort of like the right compounding way? Yeah, one of the things we're still working through, honestly, is managing that because yeah, everyone got this like crazy writer that can write anything for them in as much detail. And a lot of companies historically valued that in some way, even if it wasn't explicit.
26:05it, like if you showed up to a meeting with like a big document, you know, it kind of implied you did a lot of research, right? So as humans, we seem to have associated value with length. And I've got I can't even tell you the number of documents shot over to me, they're like 10 to 20 pages of AI. And I'm just like, yeah, that's not happening. That's going straight to my AI, which kind of defeats the point, right? So what do you do? What we're thinking about is something should be AI written for AI, in my opinion, like part of the onboarding that we've done is not for you to read. It's to give context to the AI to essentially walk you through the things and answer your questions.
26:42So if you want to know, like, why did we make this strategic decision, and we give all that context to the AI, that's a lot. And if we give it as much as we can, we would never expect a human to read all of that. But then it provides context for the AI to answer. So that's essentially docs for AI. What we found is now, and this is more of a newer thing, we're leaning towards more visual, more succinct docs for humans. And AI could still help you, but you got to spend a lot of time as a human really cutting it down, maybe adding more visual components that people wouldn't read, but actually understand like a graph of data or even a picture that would have been really hard because most of us aren't designers can really help.
27:23So now if someone's sending me something that they expect me to read as a human and not have an AI ingest for me, I kind of think of one to three pages as the max. Prefer it comes across as like an HTML and somewhat visual. And then if they really want like a ton of details, I think it's okay to think about AI as kind of an interpreter for that. And then there's a rare case where you actually want the humans to go really deep into like a 10, 20 page document. I think that still exists. But if the person used AI and not a lot of their own thinking to generate that document, I don't think it's reasonable that the other people will use their own energy to consume the document.
28:01Yeah, that's got to be the most frustrating thing is that sometimes it feels like people are spending roughly as long as it took me to read this as to write it. And nobody wants that. Nobody does. A lot of times I think you're kind of almost kicking the effort over to another person, right? Like you just keep bouncing the level of effort around where it's like, oh, I need you to do this thing. Okay, I'll have AI do it and then I'll send it back to you. And And you're like, okay, I mean, I could have done that. So like, what was the value add? Exactly. So how do we create like a non-slop loop? Maybe you can help us like program a loop from scratch.
28:38And non-slop is kind of interesting because you hear the word slop thrown around a lot. And I would argue that some AI slop is actually better than human slop that I've seen before AI. And so one thing I like to remind people is before AI, we did not live in a perfect utopia of only good documents and good code running around the universe. A lot of stuff was bad. People don't like to remember, but we used to copy and paste code from Stack Overflow, right? It was not that different than AI, just less efficient. So for me, when I think about writing a good skill, and we could even go through this, go back here.
29:16I'll just make a temp directory. So like if you're going to make a skill, honestly, one of the first things you can do is and I'll just type here, but I actually think if in the best case, you're going in here and we'll just do skill.md, which is very basic. It's not including any code. I would write the first pass by hand. There's actually a lot, not a lot, but I've read some papers that suggest that skills authored by humans are often better than the ones authored by AI. And I think the reason for that is you know more and can express more of like what you want this thing to do. And if you offload that to AI, you might tell yourself it's, it's kind of like, you know, e-bikes are kind of popular.
29:59I live people like, yeah, I got an e-bike, but don't worry. Like I still want to get exercise and we'll pedal. Once you get on the e-bike, you're not pedaling. Like that's just the truth for most people. So with AI, once you kind of get on the AI loop, it can be really hard to be like, now I'm going to inject my thinking because the loop's moving so fast, right? It's like you're on the e-bike and it's moving and it's fun and you're getting the dopamine. It can be a little bit hard to get off that treadmill. So how do you start? I'd start like a human and just be like, help me make good decisions.
30:32I specifically struggle and I'm just going to make stuff up with decision fatigue and would love someone to use more what's like a good word for this contrarian thinking but also help push me to make a decision and you can tell i suck at typing now since ai when enough thinking been done uh i also like to know latest research and have a partner that questions pushes me uses the socratic method and calls my bs also be succinct i always had this because man if you used opus 5 the thing likes to talk not like the average length of responses between like oh my and opus 4.6 they're like in one realm and then opus 5 it's just like so wordy it's so wordy i did it definitely for me regressed it sounds more like ai than any ai i've used it's insane quick thought experiment for you is there anything in this video you should be trying on your own if there is try it take a screenshot post it on linkedin or x and tag me I'd love to see what you're learning.
31:56Now a quick word from our sponsors before we get into the back half of the pod. I used to live in Report Purgatory. Every team had a different number. Every weekly review started with someone reconciling spreadsheets. We stopped hiring more analysts and gave the reconciliation to an AI employee instead. Victor is an AI employee that lives on Slack and Microsoft Teams. It connects to 3 ,000 plus tools your team already uses, ships real deliverables, and every action goes through your team for approval first. It's the closest thing I've seen to a small team running like a much larger one. Let me share three things that Victor does that changed how my team operates.
32:34First, Ask Victor has replaced our Monday Metrics scramble. Someone types, flag any customer whose usage dropped 40 % week over week, and draft an outreach loom for the account owner to approve. 90 seconds later, the next step is ready. Second, scheduled tasks run the work that nobody wants to remember. Every morning, Victor checks overnight support tickets, drafts replies for the on-call to approve, and escalates anything mentioning churn. Nobody had to ask for it. Finally, spaces ship internal tools in minutes. Ask for a renewals dashboard, Victor builds it, with Authentic Database, and post the link to your channel.
33:09The team can stop opening four tabs to get the same view. So stop chatting with AI and start working with it. Get started at victor.com. There's$100 in free credits with no card required at viktor.com slash akashgupta3. You can find that link in the description. Quick question. Does your AI coding tool have a design system or a theme? Because there's a massive difference. A theme is a few hex codes, a font and a logo. You paste it in and your AI built app sort of looks like your brand. Sort of. The buttons are wrong. The spacing is off. And if your engineer tries to use the code, they're rewriting every component from scratch.
33:45A design system is your actual component library. Your buttons, your modals, your token definitions, the code your engineers already ship with. Boltutnew's design system agent ingests your real system, upload your NPM packages, your CSS, your documentation. The agent builds a complete design system from your actual code. Every project on Boltutnew uses your real components. So when engineering pulls the code, they see their own primary button, their own design tokens, their own architecture. Nothing to rewrite. Every other AI tool gives you a costume. Bolt.new gives you the actual uniform. Check it out at bolt.news.com.
34:21Imagine learning AI product management, AI product strategy, AI product leadership, advanced PM with Claude code, all from frontier leaders at OpenAI, Anthropic, and Google for less than$10 a day. Actually, you don't have to imagine it. That's exactly what Product Faculty's AI Builder Fellowship gets you. One yearly membership, six live cohorts. Not recorded videos or another content library you never finish. Real live sessions with frontier AI leaders, hands-on AI build labs, executive insight sessions, capstone projects, unlimited retakes, and continuous access to new programs as the AI landscape evolves.
35:09You'll also get every new certification they add while you're a fellow at no extra cost. The goal is simple. Help you master Frontier AI skills to become an AI native product builder and operator, not just someone who talks about AI. Purchased separately, these programs are worth more than$19 ,245. The lowest price certification alone starts at$2 ,700. But founding members can join the entire fellowship for less than$3 ,600 per year. That's less than$10 a day. Soon, the price increases to$5 ,000 a year. So if you're serious about becoming the person your company turns to for AI, this is one of the highest ROI decisions you can make this year.
35:49Join the AI Builder Fellowship at productfaculty.com. And so we can go a lot further on this, and there's like a lot more depth to skills. But if I just do that, and I, you know, write quit. And then the way Claude looks for skills is you can make a dot Claude. and we can move that skill to dot clod and we'll just make it decisions dot md pretty sure it'll find that uh so we've got there you don't see because it's a hidden folder and then if we go open clod okay help me decide uh whether to invest in robots for roofing i'm just making stuff up using our decide skill and so if this worked correctly you can see that it pulled the skill decide, right?
36:35So we're starting the loop off with a skill, which is essentially like something to help us start interacting with an AI in a way that we've kind of defined the boundaries. And so you can see it's starting with phase zero, which I didn't even say phase zero, it's just kind of inferring that I need to know what invest means here. So it's using some of that Socratic things I said, it's asking me questions. So it's asked me clarifying questions. I'm, you know, in a perfect world, we'd actually just be talking to it. So if you use voice, that's really efficient, but we could talk through and say it is reversible and the blast radius.
37:07Well, maybe not reversible. Now that I think about what I asked it, it is not easily reversible. Man, don't, don't take spelling for me. The blast radius is large and cost of weight small. Like, let's just throw that in there. And this is really, you know, I picked this because it's not something we're thinking about right now. So it's completely just out of nowhere. And it's kind of like a big question. So it's saying one way door, high blast radius, little urgency. And you'll start to see that it's using, you know, tech type words because it's trained on all this corpus of the world. So, you know, two way doors it's thinking about, it's thinking about the blocks, radius, the urgency.
37:45That combination is the textbook case for not deciding yet. And I tried to purposely give it something to try to push it in that way so this doesn't go on forever. So it's like saying, okay, you probably don't actually decide now who owns this call. and I can say the CEO. And then after this, what you would do to close the loop in the most simple way possible, and you can build all this into like systems and go to level 10. But you can say, based on this conversation, how should we improve our skill to be better and more effective next time? So this is kind of where the loop's coming in more manually, where we're saying, hey, we just had a conversation.
38:26You've seen the conversation. I don't know what it's going to recommend because this is a very short conversation to kind of show the point. But it'll come back with something. We will riff with it on that and say, okay, yeah, yeah, yeah, let's do this. Let's not do that. And if we go back and look at the skill, it will surely be a lot better and a lot more involved in the ways that we failed before. And that's really where the loop happens. And this can be hard to remember. And so what I've seen a lot of people do is build in hooks, which essentially is like before AI closes out the session or when it's closing out the session, it will force a kind of improvement loop.
39:04And that's something you can build in claw that's called clawed hooks. So, yeah, it's giving me some changes. And now it's saying, do you want me to apply those changes? And this is where I would say, again, this is the time to get off the treadmill. Use your brain. Think about what you actually want to put into it, because I will always have suggestions on how to improve things. It's never not going to say that. And if you always accept what it says, it will become too much. The skill gets too opinionated, too much context, too many tokens, and it kind of dilutes the whole value. Yeah, it tries to create like mega skills that have like 10 use cases into one.
39:37Which is completely not what, if you look at like the best practices, even from like Anthropic themselves, it's like not the way to do it. The AI just really seems to like that. Let's just solve all the problems with a given skill. So how do we turn this into a loop? Like I got the, basically we had the human gate and then we gave it feedback and then it improved itself. But do we want to set it off to go autonomously on its own now and start making decisions around roping robots or what happens from here? Yeah, yeah. And then you can set this up as a loop and ask me what you need, including a learning hook before closing out sessions that learns from the log.
40:14Yeah, totally. The one thing Claude actually supports is looping, which if you do slash loop, you'll see it run a prompt or slash command on a recurring interval. So I personally think loops are more than just like a cron job. But one of the things of a loop is you want it to run on a schedule so you can actually tell Claude, hey, do this for me or help me know how to do it. And that's one of the best advice I think that I give people is if you don't know how to do something, ask AI. That's not like always the end point, but it can often get you further along and help you kind of at least know the questions to ask.
40:48You said, hey, can we make this a loop? I said, yes. And I told AI to do it. And I know it knows how to do this. So it'll go set it up. It can set up the hook. It can set up the loop. It makes the skill better. And then in a few minutes, we've kind of gone from a one-off kind of prompt skill to a system that loops around one specific thing here, which is like making decisions around robots on roofs. but you could imagine doing that for a lot of things. I know people that use it for like preparing for the day. Every day goes off, does its thing, takes any feedback, updates the loop and goes back.
41:21So you come in with like a fresh set of like, here's what I need to get done today. Okay, these prototypes are pretty cool. How did it decide on these particular prototypes? Yeah, so if you look at this demo skill that I've made and this is where I'm cheating a little bit, the skill has step-by-steps that it's running through. So when I told it to go next, you'll actually see that it's going through here. It's reading the skill. It's then got some prompts, which is saying to create variants for some specific prompts. And these are really basic prompts. Like if we go back to the actual things that it generated, what I said is create a crew schedule prototype for a contractor in a product like job and a miss.
42:01So really basic prompt. And you see it working through that. So the, the demos or the prototypes were not already built. It's building them live. So every time I run this, it's a little different. But the skill itself had the boundaries of this type of prototype, how many to make. And you can see it's variant A, minimal, variant B, full featured, and C, creative. And that actually does reflect what we do in our internal system, where we try to have at least three variants and have different types, one that's a little bit more full, one that's more basic, and one that's a little bit more creative.
42:33So it's reflecting in more of a demo state. But this is exactly how we do it on our side. we just spend a little bit more time kind of refining the context into the prototype or here I just gave it a few sentences on what to build. Yep, I have a morning planning loop. What other loops and hooks should PMs be building? Like what's the ideal set of them? One that I've really valued for myself is customer outreach loop so that every day or week or whatever the cadence is that makes sense for you is actually identifying customers from your data, whether that's like from Pendo or Amplitude or a database that you should be reaching out to.
43:08Maybe they've had change in product usage. Maybe they're using a product that you're working on. And you can even just have it email them if your company is okay with that and you feel like you've set up the right guardrails. It's a really good way to keep close to the customer without having one of the biggest challenges, which was just the time to go find who to reach out to and send them a message. One of the best loops I think you can do is a PM just to stay close to the customer. Another one I see that comes up a lot is just like a project management loop. So pull tickets from linear, Jira, whatever you're using, see where they're at, when they were last updated, what risks there are, who's not got work in progress or needs things, and kind of synthesize that down so you're never having to go do all that manually.
43:50So I got two loops. Those both sound brilliant. What other ones do I need? And also what hooks do I need? Hooks that I find useful is one I did already talk a little bit about, which is like a post. like you can set up a hook when Claude closes a session to do specific things. And that's just really valuable. Like it's storing all the logs on your machine. So it can inspect the logs, the things that have gone through. And it's essentially like building out your own kind of evals for your own harness. So one of the things you can do is like build a, Hey, this thing finished, run it against where it ran into issues.
44:24Like where do we have back and forth? What could we improve? And it can actually just message you with that out when it closes and says, hey, this is like some issues. If you want to go even further, you can automate that process. Again, there's pros and cons, because like we said, Claude might over automate and try to jam every possible thing in to your improvements. Other hooks are like startup hooks that are useful. So like when it starts up, you might want to know things like what repo you're in, what where it's out on the get like, is it which branch is at the main branch. And then as you're in the work, you can actually set up tool hooks.
44:55So one that I think a lot of companies have, including us is like, if you try to run like rm-rf, like remove everything, it won't do that, like it'll catch on that hook, as opposed to telling Claude not to delete everything in a prompt, the hook is actually deterministic, and it'll trigger on specific things like a bash command, and stop that or sharing credentials, right? Like you're not allowed to share credentials. So we have a hook that if you're trying to do anything that kind of looks like that, it'll stop you or stop Claude more importantly, because maybe it thinks it needs to do that. So that's just kind of some of the ways.
45:28It adds some determinism into the looping of Claude because Claude itself is a loop, right? It's essentially asking you for something, taking it, iterating, and then coming back to you. And so at each kind of phase of that loop, they let you inject code through hooks. So it will always happen. Whereas in a prompt or a skill, you say, never share a password. Claude can just be like, eh, I didn't read that today. I mean, I know we've all experienced this where Claude's like, yeah, you're totally right. You said that and I forgot. It doesn't do a lot of good if all your data got blown out of the water.
46:01So you create a bunch of safety-related hooks, it sounds like. The key loops, just to review, I don't know if I remember them all off the top of my head, but there is one around work in progress and things happening in linear. There's one around customer outreach. There's one around synthesizing support and what feedback you're getting. What other ones should I be thinking about after that? Yeah, some of the big ones I'm trying to think on the product team that people use. This one is less of a loop and more of, I'd say, a straight skill because it's not necessarily looping as much. But we've tried to start building skills around thinking so that it's less about doing and more about pushing the thinking of the people on the team.
46:41So like if you're on doing more of the product work, it's like pushing your thinking on like, did you talk to customers? Did you look at the benchmarks in the industry for these things? Where does the data come from? Did you think about this risk or feasibility? because we're almost trying to force you off this AI treadmill at certain points, as opposed to just say, hey, Claude, here's, you know, the CEO told me to go build this feature. Can you go do all the research and tell me what to build and why to build and blah, blah, blah, blah, blah. Like, that's not actually like a terrible place to maybe start.
47:14But I find that because it's so addicting, that you actually just finish there. Like you get all this stuff back and you're like, I can't possibly go and evaluate this. so I might as well just send it up the chain and like see what happens that's not doing product work that's more kind of outsourcing your thinking that's kind of like career reputation suicide I feel like for a PM at this point right like do not ship anything that just AI just like developed and start to pass that up the chain you're just offloading the work to people above you who are even busier than you right and and it's not like to be clear like I don't see that happening on our team i think we've had some not like go all the chain but there's been things that may have gotten higher than you'd want to see and i think it's not because people don't want to do quality work they're feeling like they have this tool that helps them faster and so they want to keep moving faster because now everyone's using it people also aren't unaware if you went back like a year and you were doing this people maybe were like holy crap this guy's insane or this girl's insane now people are like that's just ai like i know this is not like thoughtful so think about it use ai to help you do research to push you to think have it even give you its ideas but if you end up in a meeting and your answer is claude said that or told me that or did this thing outside of just like normal data gathering like it's like a code machine or a searching machine for you that's bad and i i hear that from time to time people are like yeah claude said it would take this long to build this feature i'm like whoa claude does not know how long it And that was more like six months ago that I would hear that when Claude was newer on the scene, especially for PMs.
48:53I'm like, no, Claude does not. You ask Claude how long it'll take six months ago, and it's like a week. And you say, go build it, and it'd be like built. It was crazy. It would overestimate everything. Okay. So I think I got a good sense of what loops are, what hooks are, when I need to use them. Talk to me a little bit about from product to engineering. What engineering loops should be out there? what engineering hooks should be out there, and then PMs interfacing with engineers. When does the PM work? PM loops end and the engineering loops begin. Some of the most important loops for engineers right now are quality loops.
49:28The thing that people don't talk enough about, in my opinion, is if you ship, let's say, twice as fast with AI, and your quality rate maintains the same rate, let's say you have a 1 % bug defect ratio or something, your customer experiences twice as many bugs if your quality doesn't improve. The customer doesn't experience your defect rate. They experience the number of defects that you push out there. And so we're seeing this. I mean, you look at big companies, their uptime is the worst it's been in a long time. And my opinion is it's not that their quality got worse, actually. It's that they're just shipping more code.
50:01And so more things go wrong at the same rate. And we've seen that. And so we've really started and tried to invest in quality improvements through loops for engineering. like our standards, checks, automated end-to-end type testing. There's a billion things you can do there, but if you don't have AI working on the quality side, you're going to move faster, and your customers will feel like you've gotten worse at building things, even if you didn't, because they will experience the velocity of more bugs. So that's where I would start. If you're looping, loop on quality for engineers. And should PMs be pushing PRs?
50:40Where does that go till? Should PMs be working on engineering tasks at all? I think it's definitely appropriate for PMs to work on engineering tasks where it makes sense. Like, let me give an example. I don't know if I'd put a PM working on like our back-end billing system and making upgrades to it that could impact people's money flow and all that. There's a lot of like important decisions to be made there that are more architectural. I think it's fairly reasonable to push some front end changes where we have good, you know, decoupling from the back end, you know, good APIs, where we have good CICD, good quality testing, like the more you trust your system to do a lot of that checking, the more I think it's okay for anybody UX, PM, ENG to push.
51:22And so like I kind of mentioned before, you are at the mercy of your systems before AI. Great systems do really well with AI. If you're a company that had really bad systems and relied a lot on humans and slowness to kind of protect you, you don't want PMs coding in there because you barely want probably your engineers coding in there. But great systems, I think there's no reason PMs can't jump in and help. And the one thing I would be careful of is make sure it's agreed upon in the team because it can create some shadow work for engineers because you want code reviewed. That's the same for any engineer.
51:57And I've seen PMs be like, yeah, I just pushed this. I was working on the site. Can someone take a look? And now you've generated maybe hours of work for someone that wasn't planned on. And you might get frustrated because you're like, hey, I'm trying to ship stuff. And they're frustrated because it wasn't like agreed upon that that would be part of their workload. And as an engineering community, this is one of the things we're struggling with is how do we manage the code onslaught? Because you could have AI generate basically infinite code. So how do you do that? Systems is one thing people were thinking about, but the dirty truth is most companies' engineering systems weren't perfect before, so they're not perfect now.
52:38And I tend to push quality, like I said, on the loops because I almost think that the quality advantage of AI can beat the velocity advantage because it lets you ship safer. Okay, so that's one part of it, which is PMs doing engineering work. It sounds like PMs shouldn't be trying to become engineers, but if they're doing some front-end changes where, again, they have put in probably more time on it than the reviewer would need to, then it might make sense. What about the other side, which is engineers doing Vibe PMing? The failure points of Vibe PMing are interesting because failure points of Vibe engineering can be potentially more obvious.
53:19Like you shipped a bug, you created a problem. So anything like what's the failure mode of Vibe PMing? It's essentially shipping something that people don't want, right? Or spending time going down a road that's not viable for the business or not feasible or not valuable. If you think about the four risk factors that I often come back to, feasibility engineers already know that we're good. Usability is generally handled more by design. So we can think about that in a minute. So then you've got like Vibe PMing is more thinking about, Is it viable for the business? Which can they make money? Like, is it a high margin or margin you need?
53:52And is it something people actually want and would pay for the value side? So how do you vibe PM? In my opinion, engineers are more empowered than ever to have AI help them mine data, right? To go out into the industry, to see what competitors are doing, to look at calls, to even go find customers that they can talk to, right? You can very easily do all that. The risk is that they do it poorly, right? And you go down a path that doesn't make sense. One of the ways you can kind of mitigate that is speed, which if you have a bunch of ideas, but you're very quick to throw them away, then it's kind of okay, like cool.
54:30So I think if you're an engineer thinking about doing more product stuff, one of the advantages you have and where I would suggest starting is you can generally build pretty fast, especially with AI. Get a space where you feel comfortable that it's a two-way door, kind of to use the AI decision and go try to do some of the PMing thing. Talk to the business. How do we make money? Talk to the customer. What do they need? Don't overthink it. Get something out there behind a feature flag and get it in front of a customer and talk to them. That is very low risk. Same. It's like the version of like shipping a button color change or something for a PM in code.
55:07I think there is a vibe PMing. Where I don't want engineering's vibe PMing is like, hey, we need to make a strategic decision on how to invest money that could impact three years from now where this company is like that's not VIPM. I mean, that's like really let's get deep into this thing and use the skill set. And so in the same way, I think of engineering, there's this gradient of, hey, we really need best in class, trained product thinking, but not all problems are that way, just as not all problems are like really hard engineering problems. And so if I'm thinking about where I want engineers who lean in.
55:42It's like, hey, we wanted to make this change. We heard customers complain about this thing. It's on the roadmap for us. It's not a huge thing, but we need to kind of figure some of the things out. Can you do that? And the reason that's so powerful is if you as a person can go end to end from, hey, here's a problem to, hey, here's a solution that's making the business money or the customer happy. Again, your leverage has gone up exponentially in the company and the speed to value went up exponentially. All those human bottlenecks internally go away, all those different decision points and like getting people together.
56:17That was a de-risking thing, right? We did the triad to de-risk things because things took a while to build. If you can build things instantly, you don't need as much de-risking. You still need some because your customers aren't okay with constant change and giving you feedback is their main job. But the bar I do think has changed because the time to build has gone down, which is why waterfall existed, right? In manufacturing, it's like the time to create something physical takes a long time. So you spend a lot of time de-risking it up front. And we placed a lot of emphasis on this episode do on de-risking in terms of creating divergent prototypes and putting those in front of synthetic users, putting the best ones in front of users.
57:03How important is that for what features do you need to do that and which do you skip that? Never skip it in my opinion. It's the kind of corollary to engineering is we used to talk about like what your test coverage is. And now my opinion is just be 100%. It's basically free, like to tell the AI on the unit test side, that's not all tests, but on unit tests to tell AI to write 100 % coverage is basically free. Why not do it? Before we did it because it costs time and energy and there are good reasons. If you're doing product work, why would you not take 10 minutes and have AI spin up a few different ideas for you to consider, push your thinking a bit, do some synthetic analysis.
57:41Don't just like take it what it's what it says, but like see if it's got some points. You're like, Oh, yeah, I didn't think about that. Our customers have said that. And that's the thing I would have missed. It's just insane to me. I mean, we know from research from I think out of Microsoft that a third of the product things we release won't deliver value. Like, no, a third will. So like two thirds of the thing, either flat or don't do anything for the business. So why would you not take some time to basically get more at bats for free? And that's where like the synthetic stuff can be useful. But that's also where like having really good relationships with your customers.
58:14So, so useful. Just get some more reps because AI makes it free. It wasn't free before. Or you had to have someone design this stuff. You know, if you're newer to your career, maybe you haven't experienced that. But it definitely used to take a lot more time. So we touched on the PM and the engineering loop side of it. The other portion of the triad, of course, is the design. What loops are they building? How do these all come together to vibe product develop? Biggest loops you'll see on UX is prototyping. They were doing a lot of that anyways through Figma. Figma was like a darling in tech. And I think that AI has really hurt them because like claw designs come out.
58:53A lot of people I know are kind of vibe coding internal tools like design tools to work with their systems. And so I see design really leaning in heavily on like how do we iterate faster in a way that matches how we think about design and our components. And so you can totally build that into loops. And I think of like what is vibe design, the one we haven't talked about. It's really like a PM or an engineer spinning up something that's designed in a way that wouldn't make your design team immediately throw up. And the goal, again, is there's a gradient. Some things need a lot of design and really be thoughtful.
59:29Some things don't. But we used to always go through design for that because they had the skills, the tools. Now with AI, if you have a good design system, it'll use our component library, use our system. So if you're wanting to make some changes to the front end, like I think you should totally be able to do that. And having your design system know those boundaries is helpful. So when people use it, you're like, yeah, that's something that we feel comfortable non-design experts kind of riffing on. But you'd never learn this if you don't try. And so when I think about the triad, it's really more coming together and what people might be calling like a builder.
1:00:04And I think that coming together is going to take longer than we think. It's not like some people want to act like today everyone's a builder. Like it takes time. It takes time to learn new skills, to build systems, to do all that stuff. But there are people today that have found a way to merge design, product, and engineering into one person themselves with AI that are creating tremendous value. Whether it's for a company they're in or their own business. I bet you probably, you know, running your own basically product catalog of podcasts and newsletters. you probably feel like you've merged a lot of skills that you didn't have before.
1:00:42That, I think, is an exciting future. And we got to get there. We got to train people. We got to build the tools. We got to invest there. It just doesn't come for free. But I really think designers are in a very powerful place where they, more than anyone, often understand the customer, which is the hardest thing to replicate with AI. AI can code. AI can do the research. But they can't really replicate the customer. so if you have that knowledge and you're willing to think a bit more about the business and how they make money and a bit more about how to build things I think you can totally go end to end as a designer and even if you don't do that your prototypes will become so much better and you can get them moving so much faster because of all these AI tools so yeah I'm a huge fan of this idea of like design product engineering kind of coming together and people will still have expertise for sure.
1:01:35And that's important, but it's just fun to work across the whole stack on certain problems that make that a reality. And have you hired any of these full stack product builders? Are you still hiring specialists? Yeah, we hire a lot of them actually now. So we hosted a hackathon. I think it's the largest hackathon in Utah when we did it. This probably still is because it wasn't that long ago. And we got hundreds of people to show up. And the person, one of the people that won it is now an SVP at our company. And he's a builder, like he built a product with a small team end to end in like two days, like we asked them to build an actual product for for our user base.
1:02:15And it's crazy. And then another person that I think got like third, we hired to onto a team. And what we're actually finding is not that skills don't matter, like engineering skills matter, design skills matter, all these things that people learn matter. But if you have the ability to take those skills and then inject AI in the right way and kind of push a little bit maybe outside of your traditional comfort zone, it just opens up a world of opportunity for you to create so much value that wasn't really possible before. So I'm super pro this builder mentality. I don't, some people take that as like, oh, he doesn't believe skills matter.
1:02:50I think they matter more than ever, but I think because they matter and with AI and systems, you can actually upskill yourself more than ever. So should every PM designer and engineer be aspiring to upskill themselves into a product builder? In my opinion, yes, unless you find yourself in a very specialized role. For example, like on engineering, if you're like a security engineer or like you're working at database level research at Google on like how to build the next, you know, high scale, high throughput backend or database, whatever it might be. Those type of specialized roles really need special people with special skills that are going to always be important.
1:03:29A lot of SaaS companies don't have those. They tend to generalize better. And if you can become a product builder, they will love you because they want to solve problems that people will pay for and love using. And often that's not a incredibly complex engineering problem. It's not often a credibly complex design problem or a completely incredibly complex product problem it's the merging of all those things in the right way that's the hard part it's not like most like if you looked at most companies code based no one be like wow this is like the picasso of code and most things are not designed in a way that we're like wow put this on my you know on my wall because it's so beautiful so it's kind of like that super nexus of all those things and that took three people before and maybe it takes three people forever.
1:04:20I don't know. But one of my bets is it doesn't for all things going forward. And I mean, I'm not, I can't predict the future, so I'm not putting money on it, but that's what I would say. So what's amazing is how quickly you ramped up on all of this, even at the C-suite level, when you probably have to spend 90 % of your time in meetings and with stakeholders and those kind of things. So for the other leaders out there, how do you ramp up? How do you personally find the right time to do this, build this skill set? Because if you're going to start asking this out of your team, you obviously have to lead by example, like you are doing.
1:04:53Yeah, one of the things that I benefit from is I've always enjoyed tinkering. So I spend a lot of my free time outside of work doing stuff. So that helps like I won't lie, spending extra time, learning is always a good thing. The thing that I think we've done, that's actually really good. And our CEO really pioneered this was we don't we're in person Tuesday through Thursday. And what we've done on Monday and Friday, which is remote is we really discourage meetings. And it's actually the first place I've worked at that's done this somewhat well. So usually on Monday and Fridays, I don't have any meetings, which, you know, my team's like almost 100 people.
1:05:28So that's like not a bad place to be if you're leading a team of like any amount of size, where usually you're just moving through meetings. So let me tell you, if you get in a room for eight hours with a lot of time and AI, and a lot of things you want to learn and explore, you can do a lot of damage. It's really cutting that time into your schedule. So most people don't have that luxury or that culture. What I would recommend is treat it as important to your role and to the adoption of these tools. Saying it is shown. I mean, a lot of companies are doing research on this, like McKenzie, saying things like use AI doesn't do nearly as much, if anything, versus this is how I'm using AI.
1:06:07and that is if that's what you need to accomplish in your role the best thing you can do is use it and show the team you're using it and then you start to learn to where the failure modes are because often high level leaders can talk about things that they read on like x or probably your you know newsletter like hey they're talking to this guy tyler and he said everyone's building why aren't we building right and there's just so much nuance even what i'm saying about how we did this the pain what we're still learning you really got to experience it yourself to be able to speak to it. I feel like every leader now needs to just carve out some icy tinkering time.
1:06:42And most leaders love it. It's like so fun. Yeah, it's way more fun than being in meetings all day. This has been amazing. If people want to learn more, if they want to find you online, where do they go? So biggest place, Substack. I have a newsletter that I kind of write my tinkering about. It's called the AI Architect. You can find my name, Tyler Folkman, or the AI Architect. I am on LinkedIn. LinkedIn, I feel like, has suffered from AI more than most places. So I do post there. I'll be be honest, I don't read it as much. So if you engage with me there, it takes me a little bit longer. But yeah, reach out.
1:07:10I love chatting with people. Like one of the things I'm really passionate about is community and bringing together people. They're just having a good time. Like I really love AI, local AI, tinkering, building. So if that's your thing, definitely reach out. And if you're in Utah, like we're always looking for great builders. So JobNimbus is a super fun place to work here. Sounds like a place where you can actually improve your AI skill set instead of being stuck in meetings, which is another bonus to subscribe to the AI architect you will see the link in the show notes or down below in the description tyler thank you for being so generous with your learnings and time today yeah thanks so much for having me it was super fun see you guys in the next episode i hope you learned as much from today's episode as i did if you can do one thing that's totally free that would help the show it would be to check that you're following on apple and spotify podcasts check that you've left ratings and reviews on those platforms check that you're subscribed on youtube leave a like and a comment on this video and then share it with your friends.
1:08:03We're trying to make better and better podcasts. After two years, we think we've gotten something pretty good going. So let us know what we can do to make it even better, who else we should interview, and we will put on the best shows we possibly can. Finally, don't forget my offer for the bundle. You get an entire year of my paid newsletter. Plus my favorite AI tools, Bolt Up New, Airtable, Speechify, Descript, Magic Patterns, Linear, Dovetail, Arise, and Mobbin. That's$27 ,000 worth of value for just$150. So check that out at bundle.akashi.com if it interests you.
1:08:39Tyler Folkman: And I can't wait to share our next episode.
Today’s episode
Most PMs have automated something with AI by now. A PRD review. A weekly status update. The problem is that every session starts from scratch.
Loops are what fix that. A skill that runs the same way forever is just a skill. A skill that takes the log of what happened and rewrites itself is a loop. Everyone keeps saying loops are the new prompts. Almost nobody shows you how to build one.
Tyler Folkman is Chief AI Officer and Head of Product at JobNimbus. In this episode he builds a loop live on screen. He runs a preflight check on his own podcast recording, spins up three prototype variants while answering questions, writes a decision skill from scratch, and closes the loop on camera.
He also covers the loops every PM should be running, the hooks that stop Claude from doing real damage, and the point where vibe PMing breaks.
Brought to you by
Customer.io - Send smarter messages using your product data
Ariso - Ship AI agents and features faster with fewer regressions
Viktor - AI employee connected to 3k+ tools with every action approved by your team
Bolt - Build a complete design system from your code
Product Faculty - Get $150 off their #1 AI PM Certification with code AAKASH150
10 Key takeaways
1. A skill becomes a loop when you feed the learning back. A static skill sits there and stays the same forever. The loop closes when you hand the AI the log of the whole session and ask what to improve. Skip that step and you are just running a skill.2. The gate is the most important part of the loop. Fetch inputs, do work, pass a gate, write the artifact. The gate is where you validate the work was correct, and making it deterministic matters more than anything else in the chain.
3. Agents make decisions, prompts wait for you. The difference is not the model. An agent gets a task plus a way to verify itself and executes as far as it can alone. Prompting keeps you in the loop, which caps how far you can scale yourself.
4. Write the first version of a skill by hand. Human authored skills tend to beat AI authored ones because you know more about what you actually want. Once you are on the AI loop it moves fast enough that injecting your own thinking gets hard, like promising you will still pedal on an ebike.
5. In product, the gate is a customer, and that breaks the loop. Code loops run fast because the gate is a test. You cannot lock customers in a room and iterate on them. The workaround is mining the research calls and transcripts you already have to build a cheap first filter.
6. Prototypes are free now, so generate variants instead of one answer. The internal standard is at least three variants per idea. One minimal, one full featured, one creative. Then narrow a hundred ideas down to five before anyone talks to a real customer.
7. Synthetic customers filter, real customers decide. Customer research transcripts loaded into a warehouse let AI inspect a prototype as your customer. It is not a high bar, but it catches low hanging failures fast, which is the whole point of a gate.
8. Write docs for AI, keep human docs to three pages. Part of onboarding is not written for people to read. It is context so the AI can answer questions. Anything a human is expected to read should be one to three pages, visual, and cut down by hand.
9. Hooks add determinism that a prompt cannot. Telling Claude never to delete everything or never to share credentials only works if it reads that instruction today. A hook fires on the bash command itself. Session close hooks can also force the improvement step you would otherwise forget.
10. Ship AI output you have not thought about and it costs you. Passing unreviewed AI work up the chain just moves the effort to someone busier than you. Answering a question in a meeting with what Claude said is the failure mode. Use AI to push your thinking, not to replace the part where you do it.
Related Content
If you don't know where to start on Claude loops, I got you covered with my ultimate guide on Loops for PMs. And then you can follow it up with The Complete PM Guide to /goal in Claude Code. Tyler mentioned the evolving role of PMs and how it is shifting into a Product Builder role, so you can read all about it in my How to Become a Builder PM deep dive.
If you want to advertise, please email productgrowthppp[at]gmail[dot]com.
P.S. Please subscribe on YouTube and follow on Apple and Spotify. It helps!