


4 Nov 2026 · 2h 27m · 54 chapters

The episode discusses “Kerr’s Law” (and related “hacker laws”) for AI-assisted engineering: the bottleneck isn’t the model, but keeping a team’s mental models synchronized with reality through deliberate spec/code review and system-level thinking. It also covers AI governance for agents (sandboxing, auditability, default-deny tool access), the need for simple, composable primitives (“idioms” like Kubernetes RBAC patterns and CLI flags such as dry-run), and why agents must be grounded and reviewed for security/authorization. It includes examples of agent tooling on real infrastructure (Fly.io agent sandboxes, Kubernetes-based agent orchestration) and concerns about open source, supply-chain CVEs, and potential “LLM architectural recommendation” monetization.
Written by AI. May contain mistakes.
Discussion on the bottlenecks in AI-assisted engineering and insights from Dave's Hacker Laws.
“and whether Frontier Labs might one day sell placement in an LLM's architectural recommendations.”
Discussion with Dave about his experience and reflections since his last appearance.
“once more coder.com friends we're back with a fantastic be back guest that means they will be back and he is back Dave Kerr, creator of Hacker Laws, writer of Effective Shell, and all around friend and hacker.”
Dave shares insights on the evolution of software development in the era of AI.
“I feel like there was a bit of a kind of arc that connected things in the end, which I didn't realize.”
Exploration of the importance of simplicity in software systems amid AI advancements.
“You know, something, a system that presents itself in that way.”
Learn about the importance of adhering to common CLI idioms to reduce cognitive burden.
“And in a sense, that's a bit like saying, what's going to surprise people the least?”
Explore the balance between system complexity and human understanding in software development.
“if the dry run flags there run it once with dry run.”
Discuss the necessity of code reviews and maintaining shared understanding in development teams.
“and a lot of time building the machine and orchestrating.”
Understand the importance of security in system design and the implications of authentication and authorization.
“So that's like a deliberate slowdown choke point so that we get a chance to keep our mental models in sync for what we're building.”
Hear about a personal project that highlighted security pitfalls and the need for thorough code audits.
“So everything was based on symmetric encryption, passwords passed around in silly ways.”
Discover why understanding Linux and the underlying systems is vital for modern developers.
“This book you wrote, um, you said you finished it just before the fire was invented.”
Examine the evolution of coding practices and the relevance of Unix principles in modern software development.
“And I think one of the most underutilized understanding of the system is Linux.”
Explore how simple tools can be combined to create complex systems.
“Maybe there's times there where you do start to hit escape and say, okay, hang on, you're running the AWS command now.”
Learn about the fundamentals of Linux containers beyond Docker.
“And then there was this moment for a lot of people where they're like, oh, but I kind of need to know what's in a container and I need to have a user and I need to mount something.”
Discuss the importance of deterministic systems in agentic software development.
“It's just put together in a convenient kind of batteries included package.”
Discover how Kubernetes facilitates effective resource management for agents.
“not just the co-base that I'm building itself.”
Understand how to define agents using YAML for better management and control.
“Like, it's just another resource to manage.”
Explore the vision for the evolution and capabilities of agentic systems.
“It's not as fast as just sitting there and writing a loop using Langchain, just on your machine as a single process.”
Discussing the vision and infrastructure behind the Arc demo and agent workloads.
“a bit of an audit trail for who changed what.”
Exploring how open source has changed and the complexities of modern contributions.
“Like, hey, we need better granularity on certain types of information, or we need to be able to kind of run multiple versions of X in the same tenets because we've got a policy around that.”
Addressing the challenges faced by developers in the evolving open source landscape.
“I just know I'm sort of this way and that way about it.”
Analyzing the dilemma between building solutions in-house versus using existing open source tools.
“You can find the loopholes and the issues in, I mean, this is an absolute bloodbath of sorts in the NPM ecosystem, for example.”
Discussion on the mental models in software development and the challenges of synchronization within teams.
“I was thinking about putting on the spot.”
Insights on achieving flow state in work and the challenges faced when returning to tasks.
“for a second and just steep myself in that.”
Exploration of how bipolar disorder interacts with creativity and productivity in a fast-paced work environment.
“It's an exciting world, but there's also all of these kind of maladaptive behaviors that we kind of almost have to check ourselves on and say, is this good?”
Discussion of recognizing maladaptive behaviors and the importance of having strategies to manage them.
“And if I see that behavior happening, it's a sign.”
Insights on the intersection of neurodivergence and technology creation, including the responsibilities that come with it.
“Or I need to kind of validate what I'm thinking.”
Discussion about the need for integration of experiences and thoughts in a busy life.
“And I think some of the strategies, and thank you for sharing, I think you articulated that really beautifully.”
Exploring the importance of taking time to integrate thoughts and experiences.
“But the idea of integration is that when you have those thoughts and feelings, you'll need time to just be with them for a while, not necessarily solve them, but just let yourself be there.”
Discussing the motivation and reception of a speaker's personal talk at a conference.
“Um, I was nervous, but I felt a real sense of relief afterwards.”
Reflections on the challenges and opportunities in the rapidly evolving tech industry.
“They're the ones going to capitalize most?”
Debating the advantages of experience over youth in tech innovation.
“Or do you think it's not so much an old versus young game, but more like experience versus inexperience?”
Exploring how system agents can simplify software development and management.
“I went to my system agent, told it to do it, it to document it.”
Explore the transition from managing dot files to utilizing system agents for improved efficiency.
“I didn't want to maintain it in the first place, but I did it because I wanted the right kind of tooling.”
Discuss how managing multiple systems and utilizing automation can reduce toil and enhance workflows.
“And what's interesting is that now I have multiple systems.”
Learn about the importance of handwritten inputs in system design and documentation.
“So I'll do a lot of, I've actually recently gotten into Excalidraw, which is MIT open sourced.”
Understand the significance of well-crafted ReadMe files in software projects and their impact on user engagement.
“I was building things like string classes or string structures just because it was curious and interesting.”
Discuss strategies for creating effective technical documentation that conveys essential information quickly.
“The read me like line by line in Vim handwritten because like I'm a developer.”
Exploration of consultants' efficiency in condensing information and documentation practices.
Discussion on a structured framework for managing tasks efficiently in a creative environment.
“What is this, beyond what you shared there, what is this framework, this 15 minutes in the morning, let it cook all day and come back to it later?”
Discussion on engaging with hobby projects and using AI tools like GPT-4 for creative problem-solving.
“One of the things I've realized I think I might be more interested in now is the hobby projects, the dorky ideas, the journey you have with them, the kind of trajectory of the agents.”
Insights into automating testing processes using Docker and AI models for efficiency.
“crazy loopholes it went through to do something it shouldn't be able to, in terms of spinning up browsers, running JavaScript in them to get past the restriction to do this, to go back to the desktop.”
Introduction to the Shellwright project and its functionality for recording shell sessions.
“So I was like, it tackled a really hard problem.”
Discussion on the need for evidence in software development to ensure confidence in outcomes.
“You just install it via MCP and then you basically prompt your agent to say, use shell right to open HTOP.”
Explore what constitutes valid evidence in software testing beyond just passing unit tests.
“It's like, yeah, you can't, if this is the output seal on the end, or this isn't the API shape or the test suite running, then that satisfies it for me.”
Discuss the balance between maintaining flow in work and handling decision fatigue with multiple projects.
“Do you find yourself, I know we're getting close to time, but I asked a few people this question and I don't even know what my own answer is.”
Analyze the difficulties of switching between multiple projects and maintaining focus.
Reflect on the natural curiosity developers have about the outcomes of their projects and tasks.
“And then the lack of desire to spin it down.”
Highlight the importance of community and checking in on each other in the tech industry.
“I find myself really just curious how it's going to end in this moment versus like, and maybe to some degree, it's like the slot machine aspect.”
Discuss the value of engaging with various online platforms and communities for developers.
“It's a bit messy and it's a bit human and it's a little bit complainy and moany, but also silly.”
Consider the future of software development and the importance of building tools for upcoming generations.
“in my work hours into this agentic world and embrace as a seemingly to some degree, if not fully AI maximalist.”
Exploring the relationship between software, humans, and the tools we build.
“And he's very senior, extremely expert, respect this guy enormously, but I can see that he also kind of lives by that principle as well.”
The comparison of the advent of AI to the discovery of fire in terms of human evolution.
“And what happened when fire was, maybe not literally in that very moment, but over time as fire was, we're now aware that fire exists, is we all explored ways to use fire to make humanity better, right?”
Encouragement for individuals to engage in personal projects amidst industry changes.
A reflection on the importance of joy and fun in professional endeavors.
“Very much fodder for our conversation here today and the past conversation we had with Jared on the pod.”

Get the gist, explore an idea or ask about something said.
On The Changelog: Software Development, Open Source, what are the key points of this episode?
Automatic transcript. May contain errors.
0:00What's up, friends? Welcome back. This is the Changelog. I'm Adam Stacoviak, Editor-in-Chief here at Changelog. What if the real bottleneck in AI-assisted engineering is not the model? What if it's your team's ability to understand what it built? That's the exact idea Dave Kerr landed on when I put him on the spot to invent a hacker law of his own. The limit to how fast you can build and scale is how well you keep your team's mental models in sync with reality. Yes, this week I'm talking to Dave Kerr, creator of Hacker Laws and author of Effective Shell about building with agents without losing the plot.
0:36We discuss why he deliberately slows his team down with spec and code reviews and why models are down to build when they should be down to buy. We cover how his team spends 25 % of his engineering time on CVEs in the NPM era and whether Frontier Labs might one day sell placement in an LLM's architectural recommendations. and we also get into the grief of watching handcrafted side projects compete with one shots a massive thank you to my friends and partners at fly.io computers for agents sandboxes are not enough give your agent a real computer and get back to building machines sprites learn more at fly.io.
1:19Alright, let's do this.
1:36This episode is brought to you by our friends at coder.com. You know what? Your developers, they have guardrails. The humans, guardrails, right? That makes sense. but your AI does not. How often are you running your AI dash dash dangerously? I think that most people are living a little dangerous. Some are sandboxed, some are not, most are not. And I'm here with Nicky Pike, field CTO for Coder. So Nicky, what is the focus right now for Coder? I mean, really our focus and what we're doing at Coder is on the governance around AI. So, So, you know, everyone right now, they're talking about, you know, AI agents like they're magic, but nobody's really asking where they run and what they have access to or what happens when one gets compromised.
2:23I mean, kind of give an analogy. You're not going to invite a contractor in your home and then leave and have them have full access to your safe and everything else on day one. You know, this is what people are doing with agents. We are wanting to we are the infrastructure that helps you put guardrails and restrictions and governance around agents and what they're doing to you today. That's where Coder succeeds because, you know, we started out as a CDE company. There's no secret. We were a CDE company. We created remote dev environments, standardized workspaces. But what we realized is that we accidentally built the exact foundation for the AI age before the AI age even really arrived.
2:58So isolated, governed, audible compute environments, that's what we build. And that's exactly what enterprises need when their workforce starts, including agents alongside their humans. So, you know, for us, this wasn't a pivot. This was really, we finally found the problem that perfectly fit with what we'd already built. So if you're living dangerously, dash, dash, dangerously, non-sandboxed, you name it, Coder has AI governance for you, a centralized gateway to observe and to control LLM tool usage across your environments, authenticate model requests, audit every prompt, and contain agents behind a default deny allow list.
3:40The smart way. Learn more at Coder.com. Request a demo. once more coder.com
4:03friends we're back with a fantastic be back guest that means they will be back and he is back Dave Kerr, creator of Hacker Laws, writer of Effective Shell, and all around friend and hacker. So Dave, welcome back to The Change Law. Great to see you, Adam. Great to see you because the last time you were on the podcast was six years ago with Jared. I was not on that podcast. I am affected by the laws for hackers that we have to live by. However, I'm not one who keeps them in my RAM for random access. It sort of like gets shelved off to cold storage or something like that. So if you ask me, Adam, could you name five hacker laws right now?
4:49I could probably name three just off the top of my head. So I'm not the best at that. But you've got this open source repository out there called Hacker Laws. very much a hit 27.2 thousand stars on github if that's a metric that you uh sleep well sleep well at night by i'm not sure if you're like yes i got 20 000 plus stars on xyz repository my day is done it is a good day how do you feel about this project what's come since then what's what's on your mind around laws the current scenario we're in in terms of ai taking over everything, the book you've written, where should we begin? It's really interesting.
5:34I feel like there was a bit of a kind of arc that connected things in the end, which I didn't realize. So I had to, we did the show with Jared and it was really, really good fun. It's, you know, quite, quite whimsical. Some of this stuff, it's a little bit silly, but some of it is also just kind of like good practical design to think about, or also just the inevitability of organizations, you know more people more complexity um and then i'd mentioned to jared that oh i'm writing a book as well and he said oh hey when it's done you should you know come on and talk about it and writing the book took a long time way longer than i expected it was originally and still is open source it was just a collection of techniques that i didn't come up with because i'm not smart enough but i look over a lot of people's shoulders and i'd see them do something i was like oh wow how did you do that?
6:25Like you just cleared your screen in one go, found something else and then copied it over there. That looks super useful. I'd kind of write that down in some tips and tricks. And then I did a couple of blog posts of it. And then I started collecting them into like a mini book on techniques. I pitched it to No Starch Press. They were really happy to publish it. And they were great, but the editorial process takes a while. And then I pinged Jared again quite a while later and I said, hey, the book's been published. It's been out for a year. I don't know why I did this because generative AI, like I can ask it any question and it's probably going to give me a, I can ask it to write the book and it's going to do a better job.
7:02Um, I said, it's a bit of a strange place to be now that that's the case. Um, and we had a bit of a chat about it, but then I bounced back a message a little afterwards saying like, it's not a big problem. It was, it was fun to do. It's about the process. Some people still love reading and love reading stuff. But also I said, when I wrote the book, coding agents weren't a thing. In the last chapter of the book, I introduced like a little tool in the shell. You give it a question, it gives you an answer, just connects to an LLM. That was quite cool for me because I could use it to write, you know, shell commands.
7:36And I thought that was kind of funky, but geeky. And then Clawed Code came out and it kind of feels a bit like the world changed. Suddenly people were seeing like this this thing's doing amazing stuff and it's literally just sitting there doing like bash and grep and ls and cut and it's taking these like simple tools and it's doing crazy complex stuff it's taking video editing tools now and it's editing video and it's downloading things from the internet and then i kind of realized that's kind of interesting because even the most modern technology has still gone back to that principle of you take small simple well understood tools that you can kind of pipe together.
8:16And from that, you can build complex processes. And I thought those are a really good example. And I don't know, I don't know exactly how it all stitches together beyond the fact that almost what closes the loop is I work with teams, we write a lot of software, with clients, we write a lot of software. And nowadays, I'm not looking at things like, you know, is the syntax correct? Is it structurally correct? Weirdly, I realized I'm looking for things like hacker laws, like, you ain't going to need it. this is cool what the agent's built you don't need it but also you've got this thing which says like backwards compatibility for x like that kind of violates the principle of least astonishment which is it's clever but we don't need it to be clever and i realized that we need to start almost reviewing for those more system level things um so it's a weird little arc it's a weird little storyline.
9:10I don't know if any of it actually makes sense, but when I was thinking before the show, I'd realized there were all these little kind of connections between things. And it kind of all touches on just how the world has changed with AI, gen AI, and for us in tech, like agentic AI. Yeah. You know, I take that back when I said beforehand around laws, because the one that does stand out a lot to me, because I'm similar, I'm not looking at the code, I'm looking at the intent i'm looking at the architecture you know how the system presents itself to a developer to an agent uh how easily you can come to reason about the system just by probing it and trying things and failing and does the system give you good returns and good responses and things like that because if you're going to try something like you know the error shouldn't be like you suck uh you didn't read the manual it should be like hey you know that's a forbidden feature here or you don't have the authorization to do X, you should try Y.
10:10You know, something, a system that presents itself in that way. But I started to really navigate around Gaul's Law, which is a complex system that works, is invariably found to have evolved from a simple system that worked. And I find myself now just really pushing to create the most simplest system. And maybe it's, maybe it's a greenfield issue. I don't know, because a lot of things I'm building are greenfield. they're not legacy and I'm building on top of things except for the change log uh the website there channel.com and there's not a lot of change there because I'm not trying to add new features to do new things there so you know in this case I'm trying to like build the first thing that's simple and I feel like yes AI can do a lot Jenny I can certainly do a lot and it tends to want to really please us and maybe by doing certain tricks and maybe certain tricks are just complexity and I'm constantly pushing back.
11:02No, what is the simplest version we can do to learn, right? To see if the system works the right way. And so God's Law is what pops up to me. It's funny you mentioned that. I opened a few on my other screen because like you, I forget them mostly. I know that certain things exist. And I was thinking, what's that one about complex things were never invented complex. They started simple, they iterated and they became complex and that that's goal's law isn't it i think it was one of the ones that opened up and i love that because we've with gen ai you can kind of almost one shot complex but then when you start to pick it to pieces you're like it's very clever and complex and it's incredible that you were able to one shot it but this is why that's vibe coding because if i built it from the simple pieces i can see the end result would have been more simple as well, but also I don't even know what the end result will be until people start using it.
11:58And then I realize you need to pivot this way or pivot that way. Yeah, we're really slapped in the face with iteration these days. I feel like, yeah, you can one shot a complex system and then it's got no reusable primitives. So it's got a lot of, it does the single job and that's probably an okay thing if it never needs to be something more than that. If it doesn't need to scale, it doesn't need to now have authentication or authorization. Like authorization is such a tricky thing to thread through an application stack that, I mean, if you don't think about it early enough, you can spend a lot of time having to rebuild a lot of the system because the core primitives weren't there.
12:39But when you one-shot in that case or an agent one-shot, it's great. You get a working product for the one-use case, but trying to extend it, trying to augment it, trying to furtail it into a different direction, I mean it's the agent's problem now technically literally technically but it's our problem because it could take time, it's tokens in time now and it's our problem because I think there are ways to instruct around that the thing that I find really interesting is one of the things that my team are building and building an open source at the moment it's a set of tools for Kubernetes that mean you can run agents and treat them a little bit like services you deploy and you manage and govern.
13:21And that's kind of nice for some of the regulated, complex stuff we do with clients, because there's a lot of governance and controls and things like role-based access control. There's patterns for that. But interestingly, the agents will often come and event something. And they were doing that until we started really forcibly grounding and saying, look, before you invent anything, find three idioms or three examples that show the idiom. Because Kubernetes has a bunch of idioms for how you do things. There are standard idioms for how you think about role-based access control. So if you've rolled your own, it violates the principle of least surprise.
13:57So like, what does, you know, Argo or some other like common thing do? And in a sense, that's a bit like saying, what's going to surprise people the least? If they're using Kubernetes, they probably get a bit about it. Don't force them to learn new patterns. It's the same with CLI. It's like, oh, you've added all these cool flags, but what's the idiom of the GitHub CLI? What's the idiom of Git CLI or the AWS CLI? Because if people have got a bit of a mental model that they know that, let's follow that. It reduces the cognitive burden on them to understand what you've built. When you say idioms around CLIs, do you mean like dash dash help being a thing?
14:33Exactly. Or dry run being a thing? Like these are common things that happen again and again and again as repeated patterns. Is that what you mean? Yeah. Dry run is probably the best example because LLMs know about that. and that's great for them because they do and they're trained to know about it and use it. So if you're doing things like kubectl apply or applying infrastructure or whatever you get such good results just by the fact that they know if the dry run flags there run it once with dry run. It's a super valuable thing to bring in. Yeah and that's what I mean too about reasoning about these things is when you build systems you can make them super complex but if you keep the simple primitives like idioms and repeated patterns that have been there.
15:19One, maybe this dovetails in a weird spectrum of conversation, but it gives me as a human, and it's even strange to say that, maybe I'll say that for one more year and then it will just go away and I won't say that for a year. Kind of like Happy New Year. It doesn't happen and right now it's July. When you think about a simple system, I think about it right now is there's maybe a transitional period where we want to have more understanding of the applications we're building. And so I want to have, let's just say, human relatable or human understanding in certain things. But at some point, maybe because we're looking at the code less and less, like it's been less than a year since the, let's just say, fire has been recreated, right?
16:03We've been cavemen and cavewomen out here in the world of programming. Kraken sticks together. and rocks trying to create fire, which is the application stack. And then here you go with this superhuman genius that can just do it so much faster and better. How long do we need to understand particular parts of the system? How long will we care to understand particular parts of the system? Right now, yes, because we're transitioning. But what happens once the transition is kind of over? Do we look at the code less? Do we care less about the flags? Do we care more about how things pipeline and orchestrate and less about the particular details and idioms?
16:47I don't know, Adam. I feel like I go through a bit of a crisis on this day in, day out. Yes. I have some days. Yeah, some days I get output. And the output I get is because I spend a lot of time grounding and a lot of time building the machine and orchestrating. And sometimes I get output and I'm like, brilliant. you know job done for this or at least i get good enough because this is a front end or it's an app or it's a mobile experience it's 80 right for where i am right now 80 right is fine you know nice yeah check the box we pretty much one shot that because the team put so much effort in to tune the machine but then if i'm looking at the golang code which is the controller for the underlying kind of kubernetes system i'll review it line by line and some people will say i'm a dinosaur and probably i am but for the five percent of things i see there which are not quite good enough one they're either snafus that will catch us later or they're unexpected things which will just make debugging harder um or two they're potentially serious problems and it's like parito principle first 80 is easy last 20 is hard um and if your model's only giving you sort of 90 percent that last 10 percent still probably most of your time so for the dashboard we're building i don't really care we're not really going to review it because we can fix it very easily and the blast radius if it does something wrong is by design minimal but the authentication mechanism is not so there's a kind of duty and a responsibility there to look at it but i think the other thing that i see with code view because again i wouldn't say i get called a dinosaur because the people i work with are really nice, but I see it in their eyes.
18:30When I talk about still reviewing code or getting my team to review code or my team to review specifications, we use OpenSpec a lot. Why do you do this? You can just do it faster without. The code's fine. The reality is most of the time, if the specs are good, the code's fine. But I don't need the team to quality control the code. That's not top priority. If they do, if they find issues, we can fix the machine and the skills or whatever i need them to understand the system that's why the review is there for me that's why the passover one person does spec one person does implementation is there because i actually need us to slow down because when a bug comes in someone needs to know roughly how the system hangs together not perfectly but it they can't be investigating it kind of almost from first principles it's just too kind of risky for us because we're building something very systems level.
19:24So that's like a deliberate slowdown choke point so that we get a chance to keep our mental models in sync for what we're building. That's a good point to understand the system. I think that's exactly where my question alluded to is, do we care about particular details? But then how does the system weave itself together? Does it give us the outcome we anticipated? and you can't really get that unless you unless you examine in some way, shape or form. It doesn't mean you got to read line by line but I think in the case of an author authentication, authorization, that's an area where if you're rolling it, you're not using a service like one of our sponsors WorkOS, love them by the way.
20:14If you're rolling it on your own or even the authentication layer, you can do authentication to a system, but then authorization once you're inside of it, you have to own that as a systems designer. You can't just like willy-nilly that. And that will 100 % bite you if you're not checking particular permissions or if a command outputs. Like you have to have a system in there that does those kinds of things. And that's a part where you really want to understand the system. Yeah, and understand security as well. I had a really fun experiment where I built I found that me and my team were spending a lot of time Zoom screen sharing specifications and using our agents to kind of type in we want to change this to this or just transcribing our conversations and one thing that I found useful was a little CLI that just beams up your current markdown file into like a shared online page it's using like Cloudflare Party Kit you give someone a password they can open it, they can edit it they can sync it to their file system and their agent can edit it too and then suddenly for the duration of this session we've got the markdown on a screen and we can all use our agents for you know i built that quite quickly for fun and then i just let the agents go because this was a hobby project and then i said right i'm going to do a thorough review of this now and the security for it was an absolute fundamental mess now that's not a problem at all with the llm llm is perfectly good the problem was at no point did i tell it i particularly need this to be secure.
21:45I said, I want a password. So everything was based on symmetric encryption, passwords passed around in silly ways. And it's like, naively, it works, but it would never pass any kind of pen test. And in fact, it would be irresponsible to let people run it on their machines. So I kind of guided it through the process of, right, let's set up asymmetric encryption. Let's use certificates. Let's sign things. Let's go through a proper audit on this one. And of course, well-directed, the LLMs did a great job of the audit. But it's like that genie in a bottle where, you know, you make a wish and you get, you get the answer, but there's a sneaky little thing at the end.
22:18Like I want to be able to log into this app even when the internet is off and when I forgot my password and a model will probably give you something that works to do that. It just might not be something that should work. This book you wrote, um, you said you finished it just before the fire was invented. If I'm, if that, if that translates well. Yeah, I hustled at the end to add like an appendix chapter on, you know, generative AI and what it might mean for you as a shell user. And I said, all of these weird like flags and command line parameters and stuff, you've got a really good hook on how you can do that.
22:59And I hacked together, which was harder at the time, like a little terminal application where you could kind of pipe in whatever it would be, a question, and you'd get the result back and you could get it as Markdown. or you could stitch it into a pipeline and kind of do like, you know, git diff, pipe into this, summarize the diff, come out. And I thought that was kind of like a cool example of what you can do if you live in the shell. It was very simple and janky. And I said, like, watch this space, you know, see what people come up with. And that was a little bit before, or I think it was a little bit before.
23:30Certainly it was before Claude Code. Not suggesting that I invented Claude Code. I am, give me money. but that's when I was hacking around in the terminal and it felt like many other people weren't and then so yeah that was the timing at that time Gen.ai was kind of like it's starting to look really exciting and practical and it's starting to give quite good answers for programming but for me it was a bit more personally how can I stitch it into my kind of shell based workflow
24:00so this I'm not really sure how I want to ask this question question but i feel like you'd written a book maybe it was consumed by the lm and maybe that's why it knows so much i'm just kidding not not all of it but i'm sure it read your book right some of that didn't pay since it didn't hit the amazon sales i'm not retiring yet but you wrote this i think it's still an important book so just just to give you that i don't think it's not an important book and the reason why i think it's still a very important book is I think maybe potentially in this future we're all driving towards, you mentioned understanding systems.
24:40And I think one of the most underutilized understanding of the system is Linux. And I think the Unix philosophy and pipes and simplicity and all of the laws we can potentially even extract from all of that work. but to build the next like if we're kind of still maybe even in this era building versions of the factory and factory tools for our agentic systems rather than building and reading the code we're understanding the system that builds the code and it's not going back and fixing the code like you said before it's going back and fixing the system that makes the code so we do it better for the next time or it has learning in it we're in this world where I feel like now more than ever understanding linux or even having a home lab with sure a raspberry pi that's like the most well-known home lab type of gear but just minis forum and pick pick your brand but some sort of like smaller non-server non-desktop non-laptop kind of computer that's meant to run Linux or different workloads or even a GP or things like that I feel like now is the time where that has it's more important now to have that understanding than ever because it lets you dream about the potential of what you could build because everything runs on Linux everything runs in these kinds of systems how do you feel how do you feel about that generalization is that accurate in your opinion or or not it I mean it speaks to my bias it speaks to I mean I had this weird journey where I started on like kernel level code in device drivers.
26:23And then I kind of, that's like my first coding environment was Ball and Turbo C++. It was like DOS based. And then when I first got to use like Microsoft Visual C++ and an IDE, an interactive debugger, this was like, wow, I'm never going back. And I was doing that for a few years as it went to .NET and stuff. And then I started doing Node.js and I was like, I don't need all this complexity. that I decided, you know what, I'm going to try Vim because I've heard it's good. And I struggled for two weeks. And then I was like, kind of not going back because if it's too complex for me to kind of manage in my brain with Vim and Tmux, it's just too complex.
27:00So that's why I don't do Java. There's so much folder structure and nesting that like, for me, I just don't find it very intuitive. I really like to know JS because like I can kind of see what's going on. But to the whole Linux thing, as soon as you start building outside of your own computer you know deploying to aws or fly io or you need to have a docker file or you want to ssh to somewhere where you're running something else these commands become kind of essential for you to just break out um and then look at what you can do now you can ssh into the box you've got you can run your agents there you can tunnel things back you look at the agents like kind of tool calls and you can see what they're doing okay hey, it's doing an LS and then it's grepping for results and then it's doing a tree into there, but it's limiting it to three levels deep.
27:51And whether that helps you steer it or kind of control the trajectory or not, certainly you can just see all these things that are happening. It's like listing my SSH keys. It's trying to do something. Maybe there's times there where you do start to hit escape and say, okay, hang on, you're running the AWS command now. Let me just pause it because I need to think, what credentials has it got? it's like the lowest common denominator but I do feel the fact that Claude and then all the other coding agents like OpenCode and Pi just had this realization that we can just stitch together these things some of them are like from 1960 or 70 and have barely changed in terms of their behavior you can stitch them together and do incredibly complex stuff and it's a real celebration of the Unix philosophy simple tools composed together into pipelines allow you to build complex things.
28:43And it's a huge unlock to run things on different machines and just experiment and understand what's going on. I felt like it was the same with Docker. Docker exploded in popularity. And then there was this moment for a lot of people where they're like, oh, but I kind of need to know what's in a container and I need to have a user and I need to mount something. There's a bit of initial hassle there, but once you get it, you're like, cool, I've got these little machines that I can go into and run the internals of. Yeah, and the blast radius is minimized by nature of a container and Cgroups and all the things.
29:19Even that, you mentioned Docker, and I know that you're smart and you know that Docker did not invent Linux containers, right? You know that, right? Yeah, you had Solaris zones and all the proprietary ones before that. Yeah, but they popularized containerization. And so in many cases, and if you're a developer today, maybe a newly minted Vibe Coder, welcome, by the way. Or if you're a tried and true developer, now an agentic developer, also welcome. But by the way, Docker did not invent Linux containers. And so you can go and learn these primitives yourself and understand LayerFS and all the parts there that allow Linux to layer.
30:04and I think even then when you understand that level of thing, you don't have to depend on, I mean you can depend on Docker and containers and I'm not saying you shouldn't plan that ecosystem, but you shouldn't assume that that's the only access you get. To get Linux containers must use Docker. That is just not true. But I think understanding those systems there is just really pays dividends, right? To understand what you can do with Linux to that level. It lets you reimagine. you said the word pipeline i feel like pipelines deterministic pipelines will become the next biggest thing you know that's that's how i feel the docker thing is interesting i can't remember who did the course but there was a lovely i don't think it was a paid thing i think it might have been the sub blogs our blog post but it was literally build docker from scratch but totally like you say the linux level primitives the kernel level primitives existed and you kind of realize as you go through, like layered file systems and stuff like this.
31:04These aren't new inventions. It's just put together in a convenient kind of batteries included package. But yeah, you're totally right. I kind of want to go back and do that course now because it was surprisingly quick to build Docker because the key pieces were there. I want to go back to that course with you. What is the course called? And do you know the URL by any chance? Let me do a search when we finish off, and I'll find it and send it over. Because I thought that was a fun one, just to almost demystify it a bit step by step. You know, like how do you essentially mask, create a virtual file system or how do you allow yourself to start creating new users from user zero onwards or whatever?
31:46There's so much you can do there, really. That's kind of where I'm camped at. It's like I want to understand Linux primitives. I want to understand Linux pipes, pipelines, effective shelling, as you've written. I want to understand architecture things. I want to understand certain laws that help me keep simple systems. How do I speak to an agent that helps them translate that? So if you have all these laws, so thank you for your repo because you've given the agent something to anchor to. So when I say X, Y, or Z that references a law or an idiom or whatever, it has your corpus to go back on to give it some validity and truth.
32:24But that's kind of where I'm camped out at. It's like I want to understand things that help me build the machine, that builds the machine. not just the software I'm creating. I'm actually creating software around the software. So the software we get created has maybe more determinism, you know, in a non-deterministic world, we need determinism. And that's where my mind currently is, is just sort of like stuck obsessively on repeat is those types of things, those types of systems, not just the co-base that I'm building itself. Yeah. The machinery around it. Yeah. It's, I'm with you on that one.
33:02Like something that is interesting about Docker for me was I'm a big kind of SRE Kubernetes nerd. I like build and monitor. I like the kind of operate and run. That was my colleague, Roman Khaliv, kind of called me when we were doing some stuff and said, Hey, what about this? You know, we're talking about a runtime to run agents. He said, what about Kubernetes? And I was like, ah, and then like we had a quick chat and then I hung up and then I was walking around and after I was thinking like, okay, so you've got like resource management, you've got all the monitoring tools, you've got the whole idea of like scaling up and scaling down workloads, you've got fine-grained permissions, you've got being able to run on any cloud, you've got admission policies that will allow you to only admit things on certain levels, you've got secrets, you've got secrets that can be backed by HashiCorp, by like Vault and things like this.
33:58You've got a very rich ecosystem, and it's all about managing. It's all about resource management kind of in enterprises. It was a genius idea that you had because it spoke to what I've been speaking to some people about separately before, which is like agents like microservices. They like microservices, but they're quite smart. So, you know, typically we want to constrain them, think about the blast radius, what they can do. If they start to do too much, you know, shut them down, limit the CPU and stuff. but again like it's it's the tools it's the machinery to build your stuff within yeah are you speaking to uh arc is that what you're talking about like when you allude to certain details around kubernetes and yeah that's one of the open source projects we have can you speak to that i'm really interested in that too because i think that i'm not uh traditionally a kubernetes uh dude i guess i haven't played a lot with kubernetes although i've quite a well aware of how it works, but I've never actually been like an operator of a Kubernetes system.
35:01But I think I want to know more. I want to know more about how you're agentifying Kubernetes or how you're running agents at scale via Kubernetes. Yeah, so the history on that one was we had a solution that we brought to lots and lots of clients that allowed you to kind of model agentic workloads. You had agent steps and you had teams and you could kind of configure them and their system prompts and the parameters you pass in. And then the guy who created it, Chris Madden, who was also one of the creators of Arc afterwards, had this really nice idea which is called transformers. And transformers were like Python code that you could put in your pipeline that would kind of take an input and spit out an output.
35:46And the reason he did that, he and Chi Wei-Cheng and the team did that, was because a lot of the time they wanted deterministic steps. They don't want to say to an agent, read this folder and do X. They want to say instead, to a bit of Python code, list the contents of this folder, and then for each one, fan out an operation. And it was really cool what they built. And interestingly, there came a certain point halfway through the project where a client started saying, what about MCP instead? And MCP kind of gave us the replacement for transformers. It was a way to kind of like call deterministic code, but give outputs in such a way they work well for agents.
36:25But they'd already kind of cracked that nut a little bit, which is that you can't just throw a team at something. To do anything meaningful, you need a process because a process is predictable. It has your breakpoints, your opportunities to kind of observe it and control it and make it more deterministic and predictable. But what people loved about that was they liked exporting it to YAML, exporting the agent definitions and the workflow to YAML because then they could play around with it. They could get their LLM to look at it and they could dump it back in. And that turned out to be a real success of this.
36:54So when Roman came along and said, why don't we use Kubernetes? That seemed to me like, okay, this is just the right tool for the job. So much stuff that we need is there out of the box. I had a call with my product manager a couple of days ago and he's like, this client needs to know which person created which query and who edits it. Can we get this out of the box? And it's like, yeah, we've got audit logging. It will tell you the resources that have been created and who've created them. is like, I used to hate Kubernetes. I really love it now because it's basically solving problems because it's resource management.
37:26So it tied in quite well because we were like, well, all of the agentic workloads we're building are YAML. They're parameterizable or templatable YAML. It's system instructions. It's tool associations. It's kind of parameters. People love the fact they can treat it as text because they can put it in a repo. So you don't need to use a Python framework to run an agent loop. I mean, it's easy to read. It was better than gibberish, for sure. Yeah, and you can do GitOps, you can do infrastructure as code. So for the kind of clients we were serving, we need to run in prod. And to run in prod, the lowest common denominator is normally a kube cluster somewhere on whatever their cloud is.
38:05So these things fit it together very well. And Arc is kind of boring. It doesn't give you this kind of like sexy workflow building type thing. but it allows people to define agents as YAML or define agents that run against anthropic SDKs, put them all in a Git repository and then fire them up into a cluster kind of almost in the same way that you deploy microservices into a cluster. So for our clients who are in more regulated environments, all of that kind of GitOps and all of that process and control around it and the fact that all of their existing monitoring tools work and the fact that for their site reliability engineers, it's very familiar.
38:41It's like, okay, I've got services and I've got secrets and I've got agents and I've got models. Like, it's just another resource to manage. So it's kind of geeky. It's a lot of fun if you're into kind of like DevOps. And it's low-level tools. It's tools that you add to a cluster to help you build other things on top. Yeah. Could you walk me through one of the EAML examples in the repository? Corey, would that be too challenging? I'm looking at the examples section. I'm not even sure that's the best one where you have demo namespaces. I just want to walk through a little bit of that. Let me just open one of them up.
39:27So this is my repo that I use to kind of flash out a bunch of agentic resources to a clean cluster. So if I take a look, I've got things like MCP servers, and some of them are really simple. So the Notion MCP server, the top part of this is just the description. And then underneath, it's an MCP server. I've got some metadata, which is like its name and an icon. It says where it is. It's got a reference to a secret, but this is nice because it's a Kubernetes secret, meaning that it can be handled properly in production. It's got a transport, a timeout, and then a reference to a secret. So, so far, nothing too unfamiliar to someone who's used to doing kind of like Kubernetes stuff.
40:11If I take an agent that uses that, so I've got my notes taker, this agent just kind of looks like this. There's got a name. It's got a description. It's got a configurable model. And then it's got its system prompt, which is you use the Notion MCP tools to read and write notes in Notion. and then it's got tool associations. And there's other stuff. There's clever things. There's Argo workflows and whatever. But in a sense, that's the gist of it. An agent typically is a reference to a model, a system prompt, a set of associations to tools, and then a set of permissions potentially as well. And I've got teams who are building evaluations on top of that and so on.
40:57But that's quite nice. That's something you don't even need to use Python for. You can just make that YAML. There is even tools like Helm, which allow you to deploy and version control YAML. So that pattern has worked quite well for us. There are still loads of other ways to do it. We also run agents in containers which are just using the Claude SDK. You can use the Claude SDK through Arc. Or someone might build something using, like, Langchain. But when you build something in Langchain, you can put it in a Docker container and run it in the same cluster that Arc's in as well. So you've still got that same, whatever you'd call it, substrate or whatever, or bedrock to run it on because the cluster's there ready for you to go.
41:39It's not as fast as just sitting there and writing a loop using Langchain, just on your machine as a single process. It's way faster. It's easy to do. It's going to get you quick results and so on. There's no problems with you doing that and then putting it in a container and run it in prod. This tends to work well for, we need lots of agents with lots of instructions, lots of tool associations. We need to manage it, version control it, two pairs of eyes, a bit of an audit trail for who changed what. Where do you see this going then, this kind of Arc demo and the things you're doing with it? Help me understand the bigger vision.
42:14I mean, I can understand how an individual developer, maybe a team of developers are using agents, but this kind of orchestrated system, what does that kind of system do? anything really but what are some of the initial ideas you will have? To a certain extent it's infrastructure and tooling. We don't need it to necessarily do a lot more than that. We need it to ideally support the capabilities of different types of models as they come out, so skills and things like this. But it's not a product, it's not something we're selling, it's just a set of tools to help you build interesting stuff. So it's out there, it's open if people wanted to use the same format.
42:52There's another project, Cajun, that does something very, very similar. Yeah, more definitions for agents. It's a really good idea. We like the fact that people can run it in whatever environment that they want. You're not necessarily locked into one hyperscaler or another, but you're certainly going to be able to use any one of those hyperscalers quickly. So there's features that we're building. A lot of them are more around governance because clients are running sensitive workloads and they want as many features as possible for explainability and observability. But I'd say most of the team's time is building the stuff on top of it.
43:26You know, it's building the use cases to run different kind of agentic workloads. And off the back of that, things will fall out. Like, hey, we need better granularity on certain types of information, or we need to be able to kind of run multiple versions of X in the same tenets because we've got a policy around that. Has your view on open source changed at all in this transition we're in? it's changed in that it's less fun oh man i interview so many smart people and i love looking at their geeky hobby projects um because the days of like geeky hobby projects and people's cvs often they're things they put some love into you know what i mean it's like a 3d game or it's this or that and like i love seeing that because it's fun it shows that people who've got curiosity and playfulness and they want to learn um and sometimes i feel a bit of a sense of grief because those those beautiful things that people created maybe tinkered with over months next to that you've got something that someone one shot that's a really cool idea i mean i do this myself my ideas i just throw into open source um and that's not that's not a big problem but it's maybe it's just a little bit of that grief about how the craft has changed a bit and some of these things that people have created could be created much more quickly now.
44:50So be it, that's what tech is. Open source is also a place for people to publicize. It's also a place for people to potentially pollute and try and, you know, growth hack their own product by making lots of things to it. So I feel like it's become a more complex space. It's a space where LLMs have a preference for certain types of technology and patterns because the corpus of training data says you should use Bun for this. You should use whatever it is for this. I don't know, Adam. What do you think? You talk to so many people. How do you feel about this? My ideas on open source change, I suppose.
45:40I'm not really sure. I'm still torn. I feel like I ebb and flow so frequently that I don't have a good rudder for how I feel. I just know I'm sort of this way and that way about it. I think licensing can't protect you if you're looking to license as a protection. But I think if you're trying to open source, if you're trying to be on the developer side of open source, where you're just a developer with an idea, like you said, a hobby project, totally find MIT those things. You kind of want to give those things to the world for distribution, whether it's your name, your brand, your ideas, or just making something that's useful to not just you, not just you have strangers using your code.
46:24And you got this sort of shift a little further. I'm not sure if it's left or right to that. I don't know. Pick your direction. But you got indie developer, hobby project, but then you got company or something that could be a low-level primitive for a company to build on. And how do you reason about open source there? Well, it's been a struggle for the last, I don't know, decade or more maybe even, but for sure the last decade to eight years. A serious struggle with rug pulls, license changes. Yeah. Or even just nefarious behavior or not so hacker-friendly, open-source-friendly behavior from company X to company Y, and then you've got change there.
47:11So this has been going on for a while, but in the era of LLMs and agents where you don't even have to copy somebody's code to copy their idea or to learn from it, which maybe is the best thing ever. I don't know. I really if you can't tell I struggle deeply with this because what does it mean to open source these days from a developer side hobby side totally clear I want to give it to the world clear but then when you move a little to the left or right whichever direction you're trying to go towards something beyond that commercial or commercial ask or primitive of commercial how do you protect your moat what moat should we protect things are moving so quickly i'm like clod or open ai is going to cannibalize most developer tooling what are they going to be the gravity the you know the black hole level gravity pulling everything into the agent interface i think open ai's got some really cool um things about them they seem to be opening more with the sdk and the codex server i'm doing some cool stuff with the codex server right now that's letting me do like steering and turn-based stuff that's pretty interesting and you can spin up lots of agents in that case and do it from the CLI and they seem to be most open by it but I feel like it's just such a strange world to be open source in and then you got your code out there in open source and you've got cyber security concerns now well now Not because an LLN is so skilled.
48:50You can find the loopholes and the issues in, I mean, this is an absolute bloodbath of sorts in the NPM ecosystem, for example. I mean, like, it's just everywhere. So I'm not sure how the reason why this works now. If you're maintaining a package, you can get the features out quickly. So the velocity of change for every one of the packages is already super fast. So the scope for challenge, Everything in your supply chain is changing quickly now. So that's... We got to the point where we were spending 25 % of the engineer's time dealing with CVEs, vulnerabilities as they get exposed. We deliberately open-sourced to expose ourselves because otherwise our clients take the code and they run their own scanners as they absolutely should do.
49:38And if they find something that's wrong, quite rightly, they're like, what's going on here? So we're open, we run all of our scanners, we're public about how we do that we do our very best we kind of have an sla around it but also we're open to scrutiny we're also open to the fact that things could scrutinize this find issues that we won't know about but in a sense that risk is there anyway at least we're quite public about our policies but yeah you're right it's a bloodbath people are stealing each other's stuff people are taking great ideas and promoting them as their own i don't know what the future holds but being something of a cynic about when it comes to say capitalism, how long is it before someone who's running a project, commercial project that has an open source angle, potentially start saying to the frontier labs, how much would it cost me for your LLM to prefer my solution over others when people are making architectural decisions, you know, and I'm not going to name any company's names here.
50:40because I get it, it would be a business model in the same way that Google will rank certain destinations higher when you do a search. That's how they monetize that. Well, the LLMs have a lot of influence now into making architectural decisions, some of them very consequential architectural decisions. If you're working with a bank and some of your advice is coming from a model, that's potentially going to lead to a very consequential long-term relationship and decision. Yeah, you may choose to build something versus buy it when you could have just bought it or bought the open source version of it.
51:18That's what I mean by build versus buy it. Like use somebody else's thing. Literally buy it or get it for free via open source. you may find yourself if you listen to only the lm in that case with with a preference and then because now we sort of like forfeit or we're in this world where forfeiting our reasoning or our decision making is becoming almost second nature to some folks where you can be down the road like yeah let's let's build that like no no no we could have bought it we could have bought it and we could have had this hardened version, aka called Bash, right? Like you said this yourself, LLMs didn't go and reinvent the system.
51:57They used the exact primitives there. They didn't have to reinvent Bash and pay the price. Bash has been hardened and used and it's everywhere. Like a.sh file is everywhere. So why would you reinvent it, right? Yeah, and it is tested to absurd degrees now. Absolutely. as is like code for example you know but like build versus bias is a really interesting one because that's another one of those model biases isn't it I guess you've got hacker laws but also like model biases these guys these guys build stuff like they're down to build nobody's business DTB not DTF DTB for model like down to build let's build it okay yeah absolutely it's like okay I can do this for you we can put a cache in front of it and we You can put a cache in front of the cache and all of this is extraordinarily clever.
52:51We can do this. It's like, okay, just put it on. They're hyping you up too the whole time. Like, yes. Yeah. Like, yeah, it can do everything. It's like you can eliminate 10 ,000 lines of code if you just put it on CloudFront. We're okay to use CloudFront on this one.
53:07Yeah. So that tendency to build versus buy is also one. because then it touches on tech that, you know, a junior developer might not know that this is a solved problem. There's three or four different solutions out there that cover this. You don't need to create your own complex, you know, file storage thing for these big files. If you use an S3 compatible interface, almost any production environment is going to have something that will talk S3. So don't stress it, don't reinvent it. You know, that's kind of a solved problem. But you do see a lot of like very hyperactive, of, wow, we've created a bunch of things here.
53:4580 % of them are solved problems. Yeah. Yeah.
53:58Well, friends, I'm here to tell you that my friends, and maybe your friends too, over at the CNCF gave me a very generous discount to give to you. Use the code changelogpod when you register for this year's KubeCon Cloud Native Con in Salt Lake City, Utah. It's happening November 9th through November 12th. And I want you to go. AI agents, they're changing everything. They're changing what we ask of Kubernetes. Take identity, for example. When an agent calls an API, they run some code or it touches a database, who's actually authenticated for that action? Well, Abdel S., one of the chairs of the conference, tackles this very question in his keynote, The Identity Crisis.
54:41Who is the AI agent in your cluster? And Jeffrey Sika steps back with Cloud Native, built by humans, engineered to evolve, and he's looking at how the open source community adapts to AI. And Lynn Sun asks, Cloud Native Without Limits, what can AI agents do for us? This includes agents that help debug and operate real systems. So if you're planning to attend, as I mentioned before, deep discount, generous discount, think early bird pricing. I asked them to give you something special and they agreed. So the code to use is changelogpod. Once again, changelogpod, all lowercase when you register. Head to kubecon.io, that's K-U-B-E-C-O-N.io.
55:35Select the North America event, check out the schedule, and register. And use that code. It's a deep discount. I worked so hard to give you that. And they agreed, so use it. Once again, kubecon.io.
55:57I was thinking about, don't get mad at me with this one. I was thinking about putting on the spot. Okay. Given your expertise and lack of beard, gray beard, I'm not even sure that's a pejorative or not, but I just mean that you've got some history and some skill and some experience when I say that is what I mean by that. could you invent a Kurz law right here right now given where we're at is there a law or some sort of thing on repeat that you can coin in this moment or is that too much pressure yeah it's too much pressure okay I mean maybe maybe I'll just brain fart the thing that I think is the biggest challenge I see at the moment which is the limiting factor to build and scale what you're creating is your ability to synchronize the mental models with reality of what the team is building and that's what i mean by that that what i mean by that i resonate with that one individual can go incredibly fast because they can keep their mental model their intent up to date with the output although actually you wake up the next morning and what you built yesterday you're a bit like what was this you get two or three geniuses working together and they can create their own palaces through the day no one's going to have a chance to know what each of them does and very few people will have a chance to know what the aggregate system does and we had breakpoints in the past we had the code review the product discussions the debugging that the bug hunting all this stuff that forced us to kind of like okay build the mental model like oh i see there's a thing here i see there's like a gate here i see there's a reverse proxy there.
57:44I didn't know that before now, but my mental model is close to what the system is. And I think individuals go fast. And I think the limiting factor for teams to go at scale is a shared mental model between product, strategy, tech, design, SRE, and the actual reality of what you've created. Wow. I kind of just want to pause for a second and just steep myself in that. dude you did a great job okay you were like no I can't do that but you just did it okay you just cursed law at us right now okay let's put that down and make that a law because that's so true I find maybe this is always the case but I'll hit a state of flow like deep in the session and it's usually right at the end I feel like I've got that mental model right like I like team of one can scale really well like anybody I'm not building one thing I'm building several things because you got to wait here and so while you wait well you're not going to like do a five minute task it's too impossible you got to do multiple things right and so keeping this mental model and maybe even if you're building multiple things they coordinate together they orchestrate together there's maybe one sort of center of gravity and everything else is sort of molding around that maybe or maybe you've got a project you're doing these kind of things but i feel i feel myself at the end or sort of like right at the tail end of the session i feel like i've got a very clear mental model but i've got to end the session like i just i have to and it's everything in me everything in me to force myself to step away and then i come back the next day or the next session or whatever the time is and i got to rebuild that mental model again that's always how it's how it's been but yeah that mental model how the system works and what your version of it and the true system version of it is how things fit together and where you're trying to go like unless as a team you have that individually it's cool but if the whole team doesn't have that when they're in that state of flow good luck right yeah and it doesn't make for a happy team i talk to so many engineers and the conversations are always a bit like you know when you say how how's it going there's this kind of like slight grimace of like yes it's good it's good yeah it's And they're like, yeah, but it's busy, isn't it?
1:00:04And they're like, yeah, it's busy. Because we're all creating and the product teams are creating, the customers are looking for new things, marketing are able to do more stuff. It's going so fast. And the first steam engine, people got on it, it was like 15 miles an hour and they thought they were going to melt or something. So maybe it's just the same for us. Maybe we can handle this. But it's just got absurd. I mean, and I did a conference presentation a little while ago. I have bipolar disorder. And the topic of the conference presentation was how AI can dysregulate you if you already have this sometimes inability to manage your emotional state, particularly arousal and excitement that can then lead to kind of cascading behaviors.
1:00:48because, yeah, very fast context switching, hyper-creativity, this grandiosity of I've got this idea and I can turn it into reality and that's addictive and I'll stay up all night doing this and then I'll stop doing other things. It's an exciting world, but there's also all of these kind of maladaptive behaviors that we kind of almost have to check ourselves on and say, is this good? Are we still connecting with our colleagues? Are we paying attention to them in calls? There was a little thing six months ago where every so often someone would just say, are you applauding in meetings? And people would be like, yeah.
1:01:27I love the fact that you used the word maladaptive versus bad. Someone will say bad, but maladaptive is actually maybe the better term to use in that kind of case because it's like, it's not good or it's bad. It's just sort of in there as a different case though. But I'd caught some of your talk, not all of it. And I was actually not sure if I wanted to talk to you about that talk because it hit so close to home. And I was like, Dave's going to come on here and tell me about your disorder for one and how that affects you and how LMs exacerbate that or what you have to do to protect yourself or what systems you have in your habits, in your flows and stuff like that to sort of kind of keep you grounded to reality.
1:02:20right uh but since you opened it up i'm happy to do so but yeah i listened to some of it and i was like okay dave you're really you're really getting me here so what um beyond the talk yourself like what and then even your own exposure with is like how i don't understand bipolar to know what the spectrum is how do you describe you know where you're at on that disorder spectrum and then um how do you pay attention to other humans i guess given your acute awareness awareness of you know i wouldn't call it lm addiction or something like that but certainly you know certainly something where you feel like you're constantly being able to have those highs and extreme lows pretty rapidly in in today's world how do you how do you map the bipolar disorder and then the fact that LMs give us slot machine-like tendencies in today's age?
1:03:23It's a good question. I mean, I think in some ways, going through the experience of learning what it can be like when things really start to get out of control and spiral, and then how difficult it can be to transition onto a plan that will start to manage that and accept the consequences of what that plan will be in terms of what you can and can't do with your life and the different states you'll be in potentially through medication or whatever sounds hard has has been hard but also in many ways has left me a more well person because i know that certain types of behaviors or whatever that i see in myself might be warning signs to say right you need to have a bit of an intervention here and that's left me with some habits which are very very good for example like you'll almost never see like an open source contribution come out of my laptop after say 6 p.m because I pretty religiously shut down the laptop and I don't do anything creative not because I'm tired but if I do I'll just like zap into it and then I'll go stuff and but I won't get anything done because I'll have like three or four things going through my head and then it starts to get confusing and you start to struggle to sleep and you have all of these spiraling problems but I'm aware of that and I know but as I have a wellness plan to help me I think about, well, what do I do?
1:04:41I do need to disconnect. And if I see that behavior happening, it's a sign. And, you know, I use the word maladaptive, say maladaptive creativity, when creativity becomes all-consuming and at the cost of other things. Creativity is good, but it can also be, you know, there comes a certain point or in certain circumstances where it's not an adaptive behavior, but it's a maladaptive one. So in a sense, having an awareness of the condition gives you more tendency to introspect. And then the gist of the conference was, you know, you see some of these maladaptive behaviors in other people. And I kind of thought if I saw that in myself, I'd be getting the red flags and saying, OK, I need to either distance myself or I need to spend more time with other people and less time alone.
1:05:26Or I need to kind of validate what I'm thinking. And I think it covers it talks to many, you know, neurodivergent conditions as well. uh llms are very good at feeding your grandiosity and feeding your ideas that's a great idea what about this and if some of these ideas are not good or not grounded in reality a normal human being might sort of help you there a bit like okay you know i get it but maybe not this you know they'll kind of ground you a bit whereas the llm might feed into your fantasy or feed into your delusion. So these are like unique, um, I guess, side effects or things that we're just going to have to learn what it means for us and how we get maximize the good, but manage the potentially harmful.
1:06:17Yeah. Neurodivergent, uh, makes me think AD, ADD, ADHD, bipolar. Um, and you often see this even you'll hear a common phrase now i got a touch of the tism you'll hear this out there i don't know if you've heard this or not dave and that means you got a touch of autism and and most entrepreneurs or most creative folks who do something very big like an invent inventing thing or creating systems or system architects they tend to be neuro neurodivergent they tend to be a touch of the tism kind of person not they even have autism and i'm not trying to play down or or or not pay any homage to or any respect to that um you know that disorder but you got people out there that are already on that spectrum of hyper focus some some might even say manic like you mentioned in your in your talk manic focus where you just obsess and sometimes you get some really great things out of that I think about things like Bell Labs and creating Unix and maybe even like Linus when he first invented Linux or maybe even like Steve Jobs when he and Woz were early bored, like they were obsessed and great things came from it so how do you reason about in this age when you have this superhuman ability that was never there before it's very hard to not lean in and I think maybe friend groups like you mentioned rules like nothing past 6pm guardrails in your life and other humans that sort of speak into knowing who Adam or who Dave is that can say you know what Adam or Dave you okay checking you a little bit even for yourself slow down and check yourself as a core DNA of the changelog has been if we're moving too fast which is a good thing you want to move fast but not to the point where you break things like don't move fast and break things move fast and do well things but if you feel like you're over the skis a little too much slow down and check yourself is what we've said around here.
1:08:51I soapboxed a little bit there, but yeah, it's such an interesting time to be a neurodivergent person building with these kinds of tools and the responsibility you have to have to remain well mentally and still persevere and do your job. Yeah. And I think some of the strategies, and thank you for sharing, I think you articulated that really beautifully. I think what I what I like kind of about this is that some of the strategies are just universal like the one that I also know is important is just simply integration which is complex things for most people you need time to let that kind of process in your head you might not know you're processing it but that's why going for a walk might make you feel more relaxed because this thing is bubbling in there and it's just in your brain and it needs some time to process I mentioned and grief looking at CVs, you know, grief is something we need to process.
1:09:52Grief about the craft we know and love and grew up doing kind of changing. It's exciting, but, you know, change also can lead to grief and that's okay. That's natural. That's human. But the idea of integration is that when you have those thoughts and feelings, you'll need time to just be with them for a while, not necessarily solve them, but just let yourself be there. And if you're always busy, you're just accumulating this stuff that needs integration um but giving yourself space and time to just say i'm just going to go for a walk i'm just going to go and do something and none of this is there and my mind might be really really busy but that's okay because it will almost wear itself out but i think sometimes we're building these backlogs of things that need to be integrated interpersonal experiences you know the things that we're seeing the things that are changing the things that we're learning, but so much input is coming in.
1:10:46And maybe often our lifestyles are not structured in such a way that we have enough time to counterbalance that with integrate the experience also so that I learned from me all this cool stuff I've learned, but I still need time to kind of categorize and sort.
1:11:02Yeah. Uh, this talk that you gave, uh, is that a first for you to kind of go i would not say real but that's kind of real talk have you is that a first real kind of talk yeah for you yeah yeah what made you maybe it's courage maybe it's just an idea but what made you feel like this talk needs to be out there i need to share this idea i need to share this thought pattern what made you do that there's a friend of mine um uh it's near for i'm actually keen who got in touch and said hey would you be up for um you know putting a submission in for uh this conference um ai dev days and i said oh it's short notice man and like i'm doing a lot of stuff but i i don't think i can structure it into a way that's going to be interesting because i'm looking at the speakers and everyone's talking about skills and context management and loop engineering and all of it's great and so I don't have much to add to the party on that one um but then I thought there was this thing that's been bubbling in my head for a while which is some of it a little bit of concern for the people I see around me and some of it just a reflection on my journey uh and I thought I could probably I could probably put something together fairly quickly and it doesn't matter if it's a bit rough and ready because I think people would understand it's an authentic discussion and I'm not selling anything you know i'm not i'm not here trying to sell you my framework which does skills better i'm just you know sharing some observations um and i thought those thoughts have been bubbling in my mind for a while um and i think i'm okay to to kind of uh share them you know i'm not going into tons of personal detail about you know particular incidents but maybe talking about some things that it's good to keep an eye on but also strategies for keeping an eye on it.
1:12:54Um, I was nervous, but I felt a real sense of relief afterwards. And I had some really lovely kind of comments and one-on-ones and people reaching out to me saying that they enjoyed it. Um, and that was lovely that, you know, that was a really positive experience.
1:13:16What, uh, do you think anything would come from this? Like, did you get any people reaching out to you because this is going to have a especially in an ai days kind of conference you're not going to like you said loop engineering context engineering uh you're going to hear those kinds of topics right uh was anybody like hey man read the room don't uh don't feed into the fact that we're all in the psychosis let us just enjoy this superhuman strength we have and shut up for now kind of thing or were they like oh yeah oh yeah you're speaking you're touching a nerve on 80 % of the people here, right?
1:13:52Like what was the response like? Well, the room self selected for people who'd be interested in the talk, you know, there's a few different tracks going on. Um, so the people who just wanted to, um, you know, do look at skills and so on, obviously went there. So I think my room was fairly small, but I would say that the kind of theme of the comments I got was I didn't really know much about bipolar disorder. I thought that was really interesting. Thank you. I got the theme of people saying quite a few people saying, I live with you know person x or I have family member y um and sadly most of those comments were around like we really struggle as a family um to help help this person um but I also got a lot of comments from people saying I find it tiring too you know the things you were talking about like the pace of it the change the anxiety that comes from am I falling behind a lot of people saying saying that um because i think for many of us it is like that it's so exciting it's so exhilarating but you look at the substacks that come in and the podcasts and the papers and you're like how can i even begin to position myself as credible in this space um when there is so much changing so fast.
1:15:13Do you feel like the, I don't want to call them 10x engineers because that's sort of like played out, but like the high output folks, the innovators, the ones who not just move fast, but think fast, think big, think in big systems, they think in systems. do you feel like those folks are going to capitalize on this better than everyone else and maybe in particular in the software development space because they have so much experience i almost feel like i almost feel a sense of joy because i'm older right i'm not 20 or 30 anymore i'm in my 40s and i almost feel like this is amazing because i've got all of this experience some would even say wisdom I'm not sure I would or lie on maybe sometimes it's wisdom or not but now I've got the upper hand here not the the young buck who has the youth and the energy I've got the experience and wisdom and I know I know in quotes in air air quotes y 'all listening in audio I know how to wield this superpower do you how do you feel about that kind of idea do you feel like the folks who've got the experience and the wisdom and the bloody knuckles of different directions or maybe no hacker laws by heart because they've been down the roads?
1:16:39They're the ones going to capitalize most? Or do you think it's not so much an old versus young game, but more like experience versus inexperience? Yeah, I think maybe in a couple of ways. So I talk to a lot of people doing a lot of interesting things and many of them, let's say, for example, Hacks McKinsey, who've gone to do entrepreneurial stuff in different places. Obviously, we get a lot of people going to big organizations as executives. We also get people who go and create startups, scale-ups, or whatever. And a lot of them are looking for the same thing. They're like, we know with two or three engineers, we can go blazing fast.
1:17:15But we need an adult in the room. And I hope that doesn't sound condescending in that older is smarter, because it's not the case at all. The adults are also stuck in their ways and so on. But we need an adult in the room in that we want to go fast as hell. And we're willing to take on some risk, but we just need to know how much we're taking on so that we can kind of choose where we want to put the scales. We just need to know, like if someone's doing the payment system, that you're going to give it the stamp of approval to say, yes, I'm comfortable with the approach and methodology. Or you're going to help this team just get through that kind of like crisis as they start working together.
1:17:51So I think it's a very good time if you're, you know, an experienced person who's put things into production or even an experienced person in sales and marketing or operations to say, yeah, we'll leverage the tech. But we also know how to kind of apply some judgment on top of that to kind of help think about risk and help think about kind of a bit more long term sustainability. so I think there's a strength there and also you can look at the code and sometimes at a glance say largely what's been done here is good but you've reinvented something where you could have used GraphQL I can tell that in an instant or I can just tell intuitively this whole backwards compatible thing is a time bomb let's just not do it maybe that's overselling the kind of it's not overselling it is it though because you build your experience by making a ton of mistakes and people bring you in because you've made the mistakes and you've learned from them.
1:18:56But then the young folks, they are going to be like magicians, the ones who grow up with this technology and create it.
1:19:08Yeah, I'm not sure. Never in my life did I think I'd be the old guy. Or like the old finger, but now I see. I just don't know how to predict the future. I don't know how to think about, like I've got two young sons, right? I think about their future and I think about that. Like they're pre-AI, right? They were alive and born and lived in the world before artificial intelligence. But they're also growing up in a world where that's now native. It's all foreign land. This is foreign territory to us because like you had just said, we've had, you know, a career 10, 20, 30 years of sameness. Sure, you've had some innovations, Kubernetes, compilers, you know, whatever, all the different things in between there.
1:19:59I didn't make a good enough list there, obviously. But they're going to grow up in a world where reaching for a – I'm not even sure how to describe it anymore, like where it will go. If it's always on, like if there's an agent for everything, kind of like there's been an app for everything. Here's a stupid but very simple example. I now have and I haven't bitten into the open claw world yet I don't know if you have or not so I'm still like open clawless so a lot of my agents or things I have are very like bespoke but I have a system agent and just before this call I have a new system I'm setting up and it didn't have HTOP on it and I obviously wanted to like take a peek at the CPU and RAM and system load and what not and rather than me you know homebrew install htop i could do that i have a system agent that documents what my system is so that i know how it's together so that later on when i stop thinking about it and i come back to it i'm like how are my dot files configured how are these things configured how do we prefer to install certain things like do i install go directly from go or do i use the homebrew version of it obviously go direct but it helps me document my choices and so rather than install htop myself i went to my system agent i said just threw a command out and i continued working on preparation for this conversation with you i just said i need htop on the system and i need it documented that's all i said to it because it already knows contextually how we're documenting the system and i trust to make a good choice on htop that's a pretty easy one like installing on a Mac system via Homebrew is pretty much the way to do it.
1:21:46All right, so I did that. And that's a simple version of, I didn't go and just do Homebrew install HTOP. I went to my system agent, told it to do it, it to document it. And now a moment later, I just tab back to terminal and just HTOP. I didn't worry about thinking if it would be there because I said, hey, put it there and it was there. But you're speaking to this feature of where that's the way. like a version of that a simple version of that is going to be the way any choice you have you have an agent of record of sorts right and that's kind of a scary world to live in but maybe it's going to be beautiful i don't know i can't predict that future i don't know i guess if you looked at someone's dot files repo you could probably do some fun analysis with this just like find dot files repos and see what changed.
1:22:40Because I've got my own as well. And it's got the worst set of shell scripts to install my preferred stack that I half made interactive and half made like adempotent. So like it will sit there and it will get node installed and it will somehow get go installed and it will try to get Java, but Java will be wrong. And it will serve Tmux and all of my RC files. And the last laptop I set up, it was kind of a little bit like update my dot files, because I want these three MCP servers configured. They should be in the list of required MCP servers. Here's a couple of hints. But I'm not shell scripting that anymore.
1:23:17The definition of what I want is probably enough, especially because the shell scripts were always brittle and janky. And that's one of those things where it's a little bit more defined the intent. And the intent is I want these three MCP servers set up cleanly every time I do a new system. the idioms are out there enough that I trust you can probably get the job done right. Although the idioms are only out there because some amazing person created homebrew and aptitude and snap. And these are works of genius. And it goes back to the open source thing as well. The people who work on these things do colossal amounts of work, handling tons of incoming pull requests and almost universally not compensated from that.
1:23:59I can't remember what got pulled out of Kubernetes recently. it was one of the Nginx Ingress controllers and people were like oh we need it but the guys who were doing it did it for years got no money for it, did it as a passion project and you know these huge companies were benefiting from it yeah it's an interesting space we're in now so I've I'm kind of embarrassed to even say it I've kind of given up on the idea of dot files. I just have a system agent now. I don't want to maintain that. I didn't want to maintain it in the first place, but I did it because I wanted the right kind of tooling.
1:24:41I only did the dot files thing because that was the song and dance we had to do to have determinism in a new system or repeatability or understanding my system, for example. That was the closest approximation that we had. Now I just have a system agent that could be Codex's latest version, GPT 5.6, Sol, whatever, on triple deuce, double high, give it to me all, ultra style. Or it could be Cloud or whatever it is. It doesn't matter, right? Just swap out whatever newest intelligence model there is and my system agent can swap. It doesn't really matter. It's not tied to an LLM. It's tied to the knowledge base of what the definition of the system is, how we care about maintaining the system, how we document the system, maybe how we prefer to install certain tool chains.
1:25:36If it's one I don't use very frequently, maybe I'll use ASDF for that or something like that. It's something I care a little less about. Something I would really want to be close to the metal with, I'm going to go to Cargo Direct to get Rust, for example. I'm not going to go through a conduit. And so the system now knows that and it self-documents. And I just asked my little wish machine to install HTOP and document and I go back to my business. I don't care anymore about.files. But in a sense, I mean, if I understand you correctly, it's not that you've kind of like reneged on your desire to maintain systems well.
1:26:16Like.files for you was a chore because there's a lot of like weird, like the way you install Python has changed or the way you install Java has changed or it's now come to a different distribution. but you wanted a machine that set your system up in the way that you wanted it with the least toil and a couple of common patterns followed yeah now you've built a machine that sets your system up in the way you want it with the least toil the most flexibility and extensibility that's now more efficient so i guess is it that you don't want dot files anymore or is it that just you've just built a better machine that takes your intent with your expertise on how it's applied but you've said like do the boring stuff this is what I want.
1:26:55Right yeah well I guess I just uh I guess I don't I don't necessarily not care about dot files what dot files represented was an understanding of your system and care for your system I still care about that I just no longer need to hold that in my own personal mental space I've got other things other systems that are more important to reason about rather than the time I've definitely spent grooming and taking care of my.files only to serve me to get the system I want, not to actually to get to the work that I want. And what's interesting is that now I have multiple systems. I don't have my main machine.
1:27:38I've got a dev lab and my dev lab has, you know, a couple of different machines running prox mocks over here i've got three or four nodes of prox mocks running that are it's a hypervisor to to run you know lxc or even vms and rather than or i've got other macs in the house that that do different things so i don't run all of it on one machine i got thankfully i have multiple machines and so now my system agent isn't just this system agent now it's it can be all system agents. So I have a couple of headless Macs in the, uh, in the dev lab and by headless Mac, I mean, it's just a Mac on the, on the network, on the tail net, my TAN, my tan, my tail network, my tail, my tail scale area network is what I call it.
1:28:29Um, I tell that system to say, Hey, you know what? Let's define not, you know, me here, you know what I like, let's take that and let's define a headless Mac scenario and a headless Mac. What do you care about? Well, you don't care about certain systems in place. You don't care about this or that. And so you make different trade-offs in different, different scenarios. And so now I have a system defined for headless Mac. I couldn't even tell you what it is. I didn't even look at the code or what's written there about it. All I know is that it works the way I want. And when I tell the system agent what to do, it SSHs thanks to my tail net to any machine that has, that's on the node.
1:29:06It's on the net on the tail net. and SSH is in and sets it up to my specification. I don't have to worry about.files anymore, Dave. You know, I've graduated. But yeah, I mean, I had a discussion with the team about this yesterday, which is like one of the best things about Agenic Engineering is if I can open a ticket on Git Repository and the machines for an easy ticket can pretty much one-shot it, that means I can spend four hours that day heads down into a complex architectural piece or a discussion with the team members. It's like we've killed out some of the toil. It doesn't mean we're not applying the craft.
1:29:40It just might mean that we get to apply it with more focus. I'm curious, are there any things you write by hand? Like literally as in not even prompt the agent, say, give me this in the edit, but things where you're just like, I'm writing this by hand.
1:29:56A lot of the inputs are handwritten. A lot of the runtime is definitely not written. So I'll do a lot of, I've actually recently gotten into Excalidraw, which is MIT open sourced. And they have a website and you can, I think you can pay for a certain tier of it. And it's so cool. It's beautiful. I don't know who made that. Is it the one that has like, it's quite a nice hand drawn style for the diagrams. Yeah. Excalidraw font. I don't know what it's called. I think it's something like that. Excalifont potentially. and it's really easy to use and so that's one of my newest I would say in the last few weeks because I've been using my Remarkable and my Remarkable is great except for getting the stuff to the machine it's very difficult well it's not very difficult but it's a PETA it's a pain in the butt there's other ways to do it Excalibur is the better way to do it like actually drawing it on the Mac in a browser with you know with IndexDB and all that cool stuff.
1:31:01You know, it's very hardened. And so that's an input. I'll do a lot of thinking there. I'll draw, I'll write, I'll schematic, I'll ERD things. I've got a cool new project where I'm modeling ERD. I was like, let me build a system around that. So a lot of my, to answer your question directly, a lot of my inputs are written out. I'll think deeply about where I want to go and what I want to do. but the actual runtime of things for the most part, I'm not like, why would I? It's not that I can't, it's back to your, your example you just gave. Like I can go do this. I can one shot this ticket or I can spend four hours reasoning about the system, thinking about the system, being fully immersed in the system with me and my team and we're lockstep and we're making cool stuff.
1:31:50Or I can, you know, write everything by hand. Like, why would I do that? I don't need to do that anymore. And I still gate things and I still check things. especially around, you know, I often ask a lot for like clear outcomes. You know, what's a clear goal and a clear outcome from this bounded session or this bounded goal set, for example? And that's kind of where I think my personal toil is best met. Dream, think, innovate, architect, and then put that input into the slot machine. and watch it cook. Yeah.
1:32:32That's the world we live in now. Yeah. You know? It's either love it or leave it, right? You got to embrace it or get destroyed by it. That's how it's always been with tech. When I first started C for Dummies and a computer with no internet, I loved it. Because of that, I still remember probably the exact syntax for how to do hello world in C and probably more. I was building things like string classes or string structures just because it was curious and interesting. Then the internet came and it all changed. Then Stack Overflow came and it all changed. IDEs, code generation, you know, that's tech, isn't it?
1:33:14We've always been having to just build tools, build machines and find ways to take the tech stuff and turn it into tools that let people build useful stuff on top. And I've had a chance to think about that question for just a second more. And I think the parts that I am handwriting are, I said inputs. But let's say, for example, the reason why I ask you a more deeper question around the YAML file that you'd mentioned for Arc is because I've got a system I'm building that has a YAML file, but it's got a really robust DSL behind it and a DAG behind it. so it's not just a YAML file where it's just text and you just read it.
1:33:54It's far more than that. So that's an example where I've handwritten that part. But when it comes to using it in production, I won't handwrite it. I fantasize in a very positive hacker way about this YAML file being very easy to reason about for a human to look at it, and that's where the human meets the machine, right? So where the human meets the machine, those are the places where I spend time either handwriting or fantasizing about the design or dreaming about the design and so that's a version of the handwrite but the actual long term i'm never gonna handwrite that anymore again but i'll handwrite the entire cli command spectrum how it works why why not because not because i need to handwrite it because that's the input that is the contract between me the system I'm trying to build and the agent who's helping me build it.
1:34:49And unless that contract is, is, uh, flavored and pepper with love developer, love DX, AX, whatever you want to call it these days, right? Then it's not going to really meet the need, the needs of other humans that decide to use the software I'm going to build. Right? Like that's just how it's going to work. So that's where I focus. That's where I handwrite things is where the, where the machine, the, the human the machine meet yeah that friction point there's it has to at least in this moment has to be designed and that's handwritten from a dsl file or a yaml file dsl file to a command line interface or even naming of mcp tooling like that's where i'll hand write it that's where i'm here because later on in my tool calls i got a reason about like what was that tool again that wasn't but you know i got a reason about what that is later on as it streams past me so i got a hand I got to design that.
1:35:44And that feels to me like the same as if you're a tech lead in a team, which is I'm not going to necessarily scrutinize the boundary of your system, but the shape of your APIs I'm really going to want to look into in detail because I want to know that they follow the right idioms, that it's intuitive, that the way we do search queries and so on makes sense, that we're going to have pagination. Some of it is just obvious hygiene, but also are people going to be able to intuit what's going on? I find myself, the other thing which I've realized, I handcraft the crap out of is read me files. So like I spend the last week kind of forcing myself to have, I get 20 minutes with Fable in the morning to have a discussion, plan something out, you know, talk about what it's going to be, let it run through the day.
1:36:32And then at the end of the day, do a check in and say, this is what I like. And this is what I don't like. And the thing that it's building is something that I can just like pop open during the day to look at. I don't prompt anything. I just like record some comments. So really, really good fun. Super impressed with the output. The read me like line by line in Vim handwritten because like I'm a developer. I look at projects. I know that developers are busy. I like, I want to see what is it? How easy, like in as short a space as possible, like what does it mean? Why should I care? And if it's not for me, you know, I'll leave.
1:37:07How do I get it installed and have a play with it very, very quickly? And that's it. And I don't want any marketing speak. I don't want a thousand lines of features. I don't want a map of the code base. I don't care about that at all. I'm a busy engineer. People are publishing things. If you've got a great idea, I kind of need to see it really, really sharp and clean with as little text as possible, possibly with just a little bit of irony to say, hey, this is a hobby thing a little bit, but I also think it's kind of cool. or even for something like arc the docs you know it's really important if people are going to understand or be excited by what you're doing almost to kind of use quite human language to say this is what it is this is what you can this is the problem that you if you have this problem this is what it can do to help you and you know if that's the case this is how you kind of get it set up and learn about it that's something that i find for kind of just like basic technical documentation llms do a good job they're a bit wordy but for the kind of short thing where it's like i need to get the gist in a glance at a glance they're very bad at that and i see that with consultants that i work with that's one of the things they're very good at they deal with a lot of analysis and information and they need to condense that down to like what's the important messages and so that i can then hook into the deep dives when i need to mm-hmm handwriting read me's huh totally makes sense um i can tell it is uh is your shell write read me written by you i'd imagine it is based on what i see yeah and it's a little bit easy for me because they all follow a similar pattern um the last one i just uh uh put up a few hours ago and i'm going to be doing a write-up on the experiences of fable you know 15 minutes in the morning 15 minutes in the evening but i had fun um i had fun with that one because i just decided to go all out with the fact that like this is something silly because we're all multitasking and it kind of lets you see what the tasks are and it's not really going to help you you're still context switching it looks nicer um but yeah i had a little bit of fun with that one
1:39:34this episode is brought to you by work os agents aren't just writing code anymore they're accessing customer data they're taking actions across the tools we use and depend on so who decides what they're allowed to do that's a big theme from mark os and knit 2026 their conference for builders they previewed three products that show where things are heading first airlock intent-based access control for ai agents in a live demo an agent worked across linear snowflake stripe and email airlock denied a large refund sent a smaller one to a human for approval and blocked an email containing financial data and then there's atlas a secure home for internal apps built with ai think authentication data connections credentials permissions and deployment the stuff a prototype needs before it's safe to use at work and then they have passport work os is pushed towards zero sign in.
1:40:31Enroll your Mac once, then open work apps already signed in. All three were announced as previous, but the direction is clear. As AI makes software easier to build, we need to get more serious about who and what can access it. I'm linking up the init 2026 recap, so check it out at workos.com. Link is in the show notes. Thanks again to our friends at WorkOS for sponsoring ChangeLog. Once again, workos.com.
1:41:14This episode is brought to you by our friends at Fingerprint. There's an interesting problem happening today, building products. You want to make sure things are as easy as possible for your users, But you also need to know who or what you can trust. That's getting more complicated today with AI. AI agents are browsing, they're shopping, they're transacting alongside humans. Some of that automation is legitimate. Obviously, I use AI, you use AI, but some of it is not legitimate. And fraudsters, the bad guys, are getting more sophisticated. That's where fingerprint comes in. Fingerprint gives developers device intelligence to recognize returning visitors and make better trust decisions.
1:41:59It combines more than 100 signals across devices, networks, and behavior to identify visitors with precision, even as fraud tactics evolve. And it goes beyond identification. Fingerprint helps you detect bots, AI agents, proxies, VPNs, and other indicators of suspicious activity. So now you can protect accounts, prevent fraud, and reduce unnecessary friction for the people who actually use your product. And the developer experience is straightforward. One API call, no fraud detection model to build or to maintain. And now with AI install, you can add fingerprint to your platform directly from your favorite AI tool.
1:42:42So if you're building products for a world where humans and agents share the same internet, fingerprint is worth checking out. Head to fingerprint.com to get started. Once again, that's fingerprint.com.
1:43:01What is this, beyond what you shared there, what is this framework, this 15 minutes in the morning, let it cook all day and come back to it later? What's the deeper part of that that I'm aware of? trying to get efficient or increasingly efficient setting up having a short conversation the kind of like divergent convergent thing like divergent what are we doing convergent okay let's come to a plan you know build build the plan that you you think needs to be done to execute it and then okay you you basically have all day i'm not coming back for eight hours i need you to create interim results be creative work through problems i need something i can touch and interact with and feel and then at the end of the day we're going to have a review conversation going to talk about some potential alternatives then you're going to go overnight and i'm going to start again tomorrow morning but to try and really quite forcibly break myself out of um you know tweak tweak, tweak, tweak, tweak.
1:44:02Instead, kind of point the bazooka, let it go. And that's fun. I mean, and elements of this are based on how I do things with Teams. So for example, there's a Mac app for it. I don't want to review the Mac app at the end of the day. It's too slow. Give me an interactive HTML version that looks exactly the same that I can click on so that during that 20-minute discussion we can super fast tweak the idea um uh and also you know i'll give you the instructions on how to sign something or whatever it may be and i'll give you a set of credentials but just kind of get it working worked very well in terms of quick output and then sort of day six is a full line by or near line by line review of everything so far and i just i just transcribed So like, okay, I'm looking first of all at the docs folder.
1:44:52This is good, but I think this is stale. This is actually out of sync. So record a long kind of feedback thing and then a more interactive session to kind of like get the code structure and quality to where I want. And then the last day was a few hours of creating an interactive visual that kind of shows the gist of what's going on and refine the readme and then little test. It wasn't necessary to do it with Fable. probably could have got the same results through Opus. And I'd be curious to see what the results are with... Results maybe, but the continuity, gosh. I feel like Fable just doesn't want to stop.
1:45:34Sol, GPT 5.6 Sol Ultra in particular is very Fable 5-like, I've found. I think that it's not quite as smart, but it will certainly keep going and not have to come back to you for more clarity or just, I would call it, I don't know what they call it really. They kind of come back to you with like, I need you to prove this push to the test VM. Listen, it's a test VM for a reason. You are blessed to push that test VM to your heart's content. That's the point. Use it to iterate. That's for you. It's your tool. It's not for me. you don't need to get my approval to push there so like opus 4.8 will stop there and whereas fable or you know gpt5.6 soul ultra which is a longer name than just fable 5 will do very similar i had to stop one earlier i was like what problem you solving turns out it's in the wrong directory i won't even explain what happened but i let this thing cook for like eight hours on something i'm like man this is really solving a problem i didn't i didn't care what it was it was just a an internal kind of like fun thing and uh and i come back to it and it's it's not even on the right project it's it's on the wrong thing doing the wrong thing it had to apologize and i'm like well it's actually my fault because i told you to work in somebody else's directory not even your own home directory so you went back to your agent's file you got proper instruction and you listened like you should and that instruction was incorrect because I steered you directly differently to help this other agent who was sucking.
1:47:16I don't know about you, but Fable 5 for me, I must be doing some really seemingly nefarious things because I get cyber security interrupts from Fable 5 all the time. Almost to the point where I can't even use it. I don't know. What's your experience with that? Same. Because anything that I'm playing with that I'm going to publish online, I'm always going to want to periodically do a full audit and say, right, I would like to take a look at this. And I'm trying to moderate my language here. I'd like to look at this from the perspective of reputation, the possibility of, you know, saying something which could be misconstrued, something that could be enough of an issue that if someone was to use it, that would be, you know, compromised or whatever.
1:48:00and with opus 4.0 i would essentially say give me a full security review order this build the team you think you need to build to create the specialized agents to order this thoroughly attack it from every angle because it's going to be published it's going to be published with a waiver but i don't want people to either see silly things or have mistakes fable like bombs out of that quite hard um quite quickly especially if you're doing things like or i found if you're doing things like signing stuff, using certificates, using cryptography, using cryptography keys, which you need to sign distributions.
1:48:37And so on. So yeah, it bombs out, does bomb out quite quick. Yeah, I'm sure they'll eventually fix that. But that's something like, you know, the only reason I bring it up is because you say you let it cook all day. And I just can't trust Fable to work. I mean, I can if I don't do something that's in the realm of authentication, authorization, cryptography, security. What do I want you for, Fable, if you can't help me be more secure? You know what I'm saying? Isn't that what you're invented for? I'm paying you to do a job you can't do because you keep getting interrupted by things I'm not even trying to do.
1:49:17I'm not trying to hack the planet. I'm paying 200 pounds a month for this, man. Yeah, exactly. So in my case, I actually, with the same exact task, I tried to one-shot something. And this is how I got jacked up, is I had Alpha Team and Bravo Team. Alpha Team was Codex, GPT 5.6, Sol and Ultra. And then Bravo Team was Claude Fable 5, I think on Max or whatever the top tier was. Just to see how much you could think about this problem. And it wasn't even a particularly hard problem. I just didn't want to have to interrupt or give it I wanted to give it one mission go and do it and come back and I know both of those are sort of unbounded and they'll just sort of go until they'll almost even invent problems to keep going honestly it's kind of uncanny I like those missions in this case Fable did the best job theoretically Codex did the best job but it went a direction it tried to build an OIDC interface and it was like knee deep and it just spent all its time on OIDC and authentication versus actually building the solution.
1:50:32I come back later, again, this is a test, hours later, and I'm like, what you been doing? This is paraphrased. And it's like, hey, I've been really knee deep in this OIDC. It's going well. I think you'll like it. And I'm like, Fable 5 is already in production, man. The VM launched and we've got DNS map. Like it's Vable files production now, like you, you know, you, you've only got me in an OIDC interface that I don't even need because we use tail scales off instead, which is just super cool. I can't wait to dig into the, how I did this. Cause it's insane. It's using the who is from being on the tail net to just authenticate.
1:51:09It's not using the IDP, the TSIDP, the offer. I'm not sure if I'm familiar with this, but you can just authenticate as, as tail scale because you have to use an OIDC provider. provider to authenticate to tail scale in the first place. So you masquerade, and I guess that's not the right word to use, but you, uh, you gallivant as you, uh, across the network and wherever you go in the networks that you can touch as, uh, authenticated your, your tail net in your identity. It just, it's just you everywhere. So I have to log in. I'm just open the app. It's just there. It's amazing. It's why I, it's why I have two laptops because tail scale is blocked on my company laptop but our company laptop you know it's it's we do like client projects lots of different things but it's one of those things where it's blocked so i've got my personal laptop as well which is where i do most of my personal work although if i'm doing something like on arc or whatever sometimes i do want to bomb over to another machine or even i want to be able to like log into a git github runner and like tail scale makes that easy but not easy from my workshop i mean it is kind of magic and it's become the solution to so many problems the problem you're describing.
1:52:18One of the things I've realized I think I might be more interested in now is the hobby projects, the dorky ideas, the journey you have with them, the kind of trajectory of the agents. I've realized that when it all goes a little bit wrong, that might be the time to stop, to codify and say, I've just created a fun test case here to test on the next model. Because I saw where this one struggled and I saw the trajectory it took, the tool calls and so on. I'd be really curious to see if another one has a more creative solution to it. Like I tracked a task where I was like, the output isn't as interesting as the, not complexity of the task, but the many different ways to solve the task.
1:52:59Downloading videos, doing lip sync, trying to extract information from different places. There's a bunch of different ways to skin the cat and some of them are cheating. I'm kind of curious because I've not used GPT 4.6 yet. I'm itching to throw it at this task just to see not necessarily whether the output's better, but what's the methodology it comes up with using to try and solve the problem. Because I mean, benchmarks, I feel like benchmarks would be like, what does it even mean anymore? Like, you know, if it scores this much or this much in, in reality, we orchestrate complex pieces of work, long horizon tasks that do lots of things.
1:53:37Half of that come, maybe more than half of that comes down to the instructions, you give the context, you manage the skills you create, the environments you set up, and so on. So it's a bit like Simon Willison's Pelican on a bicycle thing that he does to test out new models. That's always been really, really cool. And he had a very good write-up of his experience with Fable, giving it a hard task, and the crazy loopholes it went through to do something it shouldn't be able to, in terms of spinning up browsers, running JavaScript in them to get past the restriction to do this, to go back to the desktop.
1:54:11Oh, yeah. I'll see if I can find the link, but that was a fascinating write-up of like, damn, this system is very, very creative. Yeah. It will just like, it will come up with some very clever ways to work around certain issues. Mm-hmm. That particular test, let's just say, had an HTML output running application in the browser. And it was on the VM. That was the final place. It was here on the Dev Lab. So virtual machine, in prox, mox, accessible via the tail net. And I wanted it to test different things around functionality. And it was trying to give me instructions. I don't know how you feel when an LLM tries to give you tasks.
1:54:59I'm just like, nah, you do that. And so it kind of proposed, and I'm like, I could totally do all this. And I probably should if I really, if this was production and if this was a real system I was going to maintain and I really cared about. I do care about it, but not in that direct way. I was like, hey, why don't you just, you know, we have Docker here on the system. Why don't you spin up Docker and build out a bespoke playwright, headless Chrome, whatever, and automate, like create an automation layer that's just going to test it automatically for me. So I don't ever have to think about it again.
1:55:36We know what we care about. Here's a list. Go build this Docker image. And that's repeatable. Docker file, compose, all that's, you know, infrastructure is code. And now we've got this beautiful test suite that runs in Docker that I didn't have to write. I had to be like, just test the front end, okay? Don't give me the instruction to test it. And I think that was Fable. I think Fable actually suggested I do that work. And I was like, I told Fable that. Hey, go use Docker. And it was like, yeah, that's a great idea. I should do that. And it did it wonderfully. But I had to give it that permission, I guess, to go and do it in that case.
1:56:13But otherwise, it one-shotted that scenario probably in three hours where Codex, I think I just forgot about it and I came back and still working on the OIDC integration and built nothing else. So I was like, it tackled a really hard problem. It probably did an amazing job and now I don't even care because TLC was the better authentication layer for this application because it's a DevLab tool, internal tool. It wasn't meant to go to the real cloud. It needed to have real authentication. Just needed to have dev aware security here in the DevLab. and it's just a team of one, so who's going to come in and hack me?
1:56:50So it wasn't that big of a deal. It's a wild world, my friend. It is a wild world. So we mentioned Playwright, and we mentioned Shellwright really quickly, just in passing. Is this an active project for you? I haven't seen this. I noticed this is in my preparation for this conversation with you. What is this project you have, Shellwright? So Shellwright was useful for me because on a few of the different things I do, I build CLIs. and I'm going to open a ticket on GitHub and I'm going to want the machines to complete the ticket, open a pull request and say that it works. And what I want in the pull request, I don't really want to look at the code.
1:57:28I want a video recording of what the terminal output looks like. I want a video recording of someone running the CLI command moving things up and down. For example, I want a video recording of someone using HTOP. I want a video recording of you using canines going to the Kubernetes cluster and checking to see if this thing exists. Because that's what I'm going to do for this bug where you said we didn't have a column for the age of the agent. I'm not going to look at the code first. I'm going to check it out, run up the cluster, open up canines and see as the column there. So please, instead, to my agent, you've got the ability to record a shell session for whatever the bug fix is.
1:58:10give me evidence that it works. So then you get your terminal recordings that you can then look at and eyeball. And if you see the column is there, you're like, okay, that passes the smell test. I'll now start to go into detail. And that came from the idea of like, playwrights are very useful for putting evidence into pull requests, such as someone's built something. I love it when my team put videos in pull requests because you can eyeball it. It's even better if there's an interactive environment, you can touch it. but also even just screenshots of the different screens is super useful and llms are pretty good at doing that you know they know how to run the dashboard up drive the browser and take um take a screenshot but being a shell geek i want interactive video recordings of shells um are you familiar with eskenema yeah yeah so i had this i didn't know shell red existed until today, basically.
1:59:05I'd had, and I only used it a few times, and I had to really coax it into using Askinema to produce what you've done here. How does that compare to Askinema, like what ShellWrite does and what Askinema does? Are they similar in output, but not similar in how they get there? They're quite similar in how they get there. With ShellWrite, it is actually creating a TTY why it's creating the buffer that's behind it it's issuing commands it's taking your intent and turn them into commands it's then grabbing the buffer which has got all the um uh ascii encoding and so on and it's either creating a plain text version for kind of black and white or it's creating the rich color version then it's recording a gif snapshot periodically along the way if you've asked it to make a terminal recording and then aggregating that into a video and what it renders it actually renders using SVG.
2:00:05So there's a pseudo TTY that's going on behind there. The architecture behind it is far cleverer than I am, but it was able to make it work. And the kind of the great moment was the first demo I wanted to do with it was to be able to say to an agent like Claude, use ShellWrite, open Vim, say how to close it and close it. And then you get demo come out where it's in bash and it says vim it leaves a little note saying to close vim you know type colon qa colon qa comes on and then it's closing like wow the agents know how to close vim and i i'm not using it uh heavily at the moment uh i quite like the fact that when pull requests come in i do a video it generates a video recording in every pull request of each of the test suites side by side so for example when i added compression so that the gifs that were the same frame cuts them out makes the output much smaller but i still wanted to see that like for the vim example the htop example for the canines example that roughly the videos look the same okay they look the same great that's evidence again um that's one of the things i think agents are great for that we under use them for or maybe i under use them for don't just write the code build a body of evidence that gives me confidence that what is there is correct.
2:01:29Those screenshots or recordings, um, or, or log, log entries or examples of what you did. They're quite good at doing that. Yeah. Yeah. I'm glad, um, I want to play with this more. Like I said, I just discovered today, uh, my Askinema version. I think it, I don't know if it went bad or good. I enjoyed the output, but I had to – this may have been months ago, but I hadn't revisited. I've had the pain. I've wanted to see the CL outputs. I wanted – because that's my – I designed it. I gave it to you. I gave you my intent. Is that the result? How closely did we actually – did we meet the bar? Was that even possible?
2:02:14Did you come up with a better solution? Because sometimes my ideas are just – they're not – they're authoritative in the fact that I've given them, but they're not authoritative in the fact that it's a contract. This is a riff or direction I think is pretty accurate to where we should be. Try to stay close to that. And if you have better ideas, present them so I can, you know, bask in the glory of the new idea and then direct, you know. But being able to record even a test suite I think would be really cool in a pull request because you're right. What I want is evidence of the outcome that we said when I said approve go and you worked unbounded for three hours or whatever.
2:02:51out the other end, is the output the same as the desired, or roughly the same as the desired input? Because that's success, right? That's proof that we've met our bar. That's... I got to use this tool, man. We need to bake this into, I see you've got some skills here. Again, I'm uninitiated on it, so I don't know how mature it is. You're using it, obviously, but is it pretty easy to just tap into a system? And does it install via a binary? I don't even know. Just installs by MCP. You just install it via MCP and then you basically prompt your agent to say, use shell right to open HTOP. Make a recording of opening HTOP or make a recording of how to list the SSH keys in my folder.
2:03:42And normally it will do a pretty adequate job. My initial goal had actually been, it's really time consuming to get good shell recordings for things like the book or the website. until I realized you can just say to an agent, use SVG and create a beautiful-looking shell rendering of what the command output is, which is actually the best way now to create really nice terminal output graphics. But then the other thing I realized is every time I change something on my cluster, the colleague I work with, he will want to see the screenshots of the terminal app before and after, because he'll kind of want to see that it looks like it should do.
2:04:19Because in a sense, it's one of our user interfaces. It's in fact one of the most important interfaces. It's a DevOps tool. And it was a little bit of toil creating those screenshots until I realized I could say, you shall write, run up canines before the fix, take the screenshots of where the issue is, apply the fix, open canines, take the screenshots of where the issue is fixed, save them here so that I can drop them into the pull request.
2:04:48Yeah, I like that a lot. I'm going to have to find a way to bake this into my way and just bake it into my toolkit because that is the evidence. I think you're spot on with that. If you want to craft another law here at the tail end is something around evidence. Give me – in between my intent that I give you and my design I give you, out the other end I have to have some version of evidence. Because otherwise you're going to make me read the code or spin up the cluster and play with it myself. And yeah, I might eventually want to do that, but I don't want to do that before I instruct you to continue.
2:05:22You know, I want to have confidence and clarity in what you produce that it matches our desired outcome and goals. And if not, what were the tradeoffs? So I can tell you to keep going, not so I can then get broken into my system. I have to come from this meeting or then rethink from whatever and spin up the server. And no, I don't want to do that. Give me some artifacts, some evidences that what you did is accurate. And then I learned to trust you in some way, shape, or form, if that's a way to even say it, or trust the system because the evidence has been pretty accurate. You've never – the thing has never tried to lie or be less than forthcoming with the details.
2:06:05It's like, yeah, you can't, if this is the output seal on the end, or this isn't the API shape or the test suite running, then that satisfies it for me. Yeah. And evidence is not the unit tests pass. Because if the unit tests don't pass, I'm canceling my subscription. Because they really should pass. To me, that's not evidence. That's just like, well, that's hygiene that has to be there. Right. But it might be something like you've connected to the cluster. You've run something. You've captured the logs. you've attached the logs. That's where I can see that there was a bit of a smoke test there.
2:06:41And that's one of the quite nice things about agencies. They can be a bit creative and ended about getting evidence. It's a little bit like asking a QA to do a smoke test. Take a few screenshots along the way, press a few buttons. Doesn't mean it's perfect, but it might mean it passes enough of a smell test for me to then review in detail or put to a UAT environment for someone to test. yeah or even have a special aha moment when you see oh wow now i didn't think about how that would map to that now you see it in real life because they say it seems believing right and i find that like that uh that state of play that you get into when you're going back and forth you can sometimes get exposed to something even beyond what you've even thought of because you're like wow now i see how that maps to this um it just gives you a chance to kind of go back into creative mode versus just simply test suite paths, which is kind of boring, you know?
2:07:36Do you find yourself, I know we're getting close to time, but I asked a few people this question and I don't even know what my own answer is. Do you find yourself finding that you're less in flow because you're parallelizing and that you're always having to make decisions and it's like more decision fatigue without that joy of like six hours of flow first? Or is it that with all these tools you've got more flow that's a good question and i think it like gosh i even hate saying that it depends i almost felt cliche even responding that way as i said it that was my natural response there's times whenever i've got multiple plates when i mean multiple like four or five or six plates spinning and that could be totally disparate projects uh going to ones that all culminate into one thing eventually all right like several rows that lead to one highway kind of thing.
2:08:29I find that when I'm laser focused on one or two, maybe three is where I find that I enjoy it personally. Like I feel like I'm enjoying the process a lot, not just getting things done or getting a lot done in a particular time spectrum. When I've got five or six things going I would say it's less joyous in the fact that I could do that many but not joyous in the toil of doing because I'm just a little less in the I have to get pulled so quickly to something completely contextually different it might be similar because it might be a CLI or it might be an API or it might be you know whatever it might be it might be adjacent or similar but it's not the same exact thing and i find myself even getting confused like in the in a split second then kind of have to rejigger myself to be like okay we're back on xyz project uh and and i have to kind of like remap this is what the project does it's almost like i become like stupid really momentarily and then smart again like it's like a like i have to like jolt myself out of like I don't know momentarily so I think I've really enjoyed the process usually hours in it's usually like by hour two or three where things really get I feel like they start to I call it like a flywheel almost like a hamster like you kind of get it going and like if I get interrupted or I got a meeting coming up and trying to spin it down or spin it up I find personally once it's spun up that's when state of flow happens spinning down is like oh it's hard to like spin down these agents i've kind of like got wound up with this intent and this design and this architecture and these directions and whatever but spinning it up is cool and then spinning it back down i was like man it's it's kind of hard to mentally because i'm like what are you working on what are you doing i want to see it be done then i've got to take a break and like getting the agents to stop is like you can't just tell them to stop right you don't want to because like no no no you're you're you're locked in get that thing done and then break and then don't let me have anxiety about what you're working on so i was like your question but it's kind of like a a tap to some degree into my psyche you can get it so if like if you're doing two or three things and there are the things that you like but also if you're doing it over a period of hours you can get into that but if it's starting to get into like the five or six and it's like short blocks then it's just
2:11:12yeah yeah Yeah, that's probably the number one challenge for me right now is the process to get to the spun up version of that. And then the lack of desire to spin it down. I've got to personally step away. I'm a human. I got things I got to do. I got a family. I got to go to dinner. I got friends to hang out with. It's end of day or I got a meeting to go to. But I try to like block myself into time whenever I know that I'm not needed for anything else. And I could just spend three or four hours kind of like just locked in. And that's that's that to me is a sweet spot. Three or four hours locked in.
2:11:55Definition of done. Marching orders. Mission going. And I try not to let it bleed elsewhere outside of that that time zone because. Because I think as a human, you're naturally just curious to how things like – the reason we watch movies that suck or movies that – we're in the middle of a movie that sucks but we watch it at the end is because we have to understand how it ends. There's a mystery to be solved. And these LLMs kind of give us daily mysteries, if not minute-by-minute mysteries. How will this end? Will this be successful? Was this a good idea? Will this solve the problem? Will it be beautiful in the end?
2:12:30Will I like to enjoy it? you know will it be production ready all the things right um yeah minimized i enjoy spinning up a lot and that's exhilarating but i think i find i really enjoy it most when it's focused on two maybe three things yeah versus five or six just by nature too much more i like what you say about we're human beings we want to know how the story ends i think that's a much more positive framing than it's the dopamine loop of one more prompt and one more answer that actually yes there is like a slot machine thing there but i think your framing is actually more positive which is like it's not that i just want to keep on clicking the buttons it's like i want to see it done so that's really nice right you have a desired outcome that you're sort of like emotionally driving towards you're fantasizing about this future uh as a technologist you're you're innovative and so you're thinking you know you're probably with the superhuman strength now you're tapping into a whole new world you haven't been able to before so it's tantalizing a lot of things culminating but ultimately i think it's like there's an outcome a desired outcome to get to even session by session if not project by project like where is this project going versus where is this bounded session going?
2:13:54I find myself really just curious how it's going to end in this moment versus like, and maybe to some degree, it's like the slot machine aspect. Let me pull it one more time and get something out. But when you're really riffing on and you're in that state of flow, you're by nature,
2:14:18you know, really pushing a new bound. that you haven't before, even in that single session. So it's by nature is who we are and what we're doing with software to create, to see the thing get created. Yeah. You know what I mean? The struggle is real. The struggle is real. That's why you mentioned your talk, and I was like, I don't even know if I want to ask Dave about this talk because it does hit a real moment there for you. And I think as a community of developers, I think we have to care about each other enough. Thankfully, there's still X and Blue Sky and Mastodon, places where people hang out at.
2:15:02I'm mostly on X. I feel like a lot of the conversation I want to tap into around this AI era is all on X for me personally. That's where I'm getting the majority of my information. Thankfully we're there though. We're, we're making jokes and we're releasing them. We're sharing and stuff like that. And we're checking in because, you know, we need a buddy in the end, check on your buddy. Don't be a human on an Island with your LLM, be a friend and check in and be like, Dave, you doing good. How's your sleep? How's your eating? How's your health? How's your relationships? yeah one of the things that matter most to you because if we're only here for the tech and this llm just chooses us up and spits us out we're not going to enjoy the life we're trying to live yeah we have to have some boundaries yeah and empathy empathy is a big part of that it's funny you mentioned x like i'm on reddit more than i was years ago partly because i feel like at least what I'm seeing there and engaging with is some of the, some of the few places where I'm not seeing stuff that's just completely AI generated.
2:16:10It's a bit messy and it's a bit human and it's a little bit complainy and moany, but also silly. And it's like, I kind of need that in a very serious world where everything is like a pitch and everything is, you know, big and dramatic and it's going to change the universe. I almost need a little bit of grounding of like, yeah, we're all finding this a bit silly and tiring. It's kind of cool as well. Look at what I did, but like, it's what's going on here yeah give a shout out to some of your your reddits as we tail off because i'm curious too i need even as you say that i i feel like there are some pitchy things on x and there are some things that are i wouldn't say necessarily ai generated i think i have a lot of good because i'm only on my following like i'm not my for you but my following who am i following so that's orchestrated and to some degree uh designed by my intentions right i'm opting into that but what are some of the reddits that you're hanging out on that you're enjoying programmer humor is always just easy light-hearted stupid uh fun i think claude ai has been interesting because there's loads of talk about people being like i don't really get what's going on with fable like it opens up here it closes there and like what's going on there's been some really interesting conversations from people around well look there's a business model here potentially but no one knows what it is so until that point like you know my readers are an outsider is that i think they just got to try everything they got to try and their market is changing um all the time as well i look at things like command line again just because i'm a dorky shell person and that's one of the places where i still see cool things that i love i see people's passion projects that are maybe not entirely handcrafted but like they built a tool for their thing which is cool to help them do their work and uh you know i i always i always find that interesting slay the spire which is like a a card game on steam like there's just some fun lighthearted stuff there so yeah just a few different things but i'd be curious about yours as well maybe we can do a share offline and um share some of the things as links or whatever yeah i don't know if there's anything in particular on X that I'm enjoying, but I feel like I'm trying to steep myself in my work hours into this agentic world and embrace as a seemingly to some degree, if not fully AI maximalist.
2:18:36I know there's a lot of people out there like doom and gloom and there's times that I'm like, oh my gosh, doom and gloom. Like yesterday and the day before, I think it was like doom and gloom days. Today, after last night's session or, you know, the three hour session I had yesterday was like, I'm back to good again, you know, miss Evan Float like anybody, you know, like, I just don't know. What can we, what can we do besides just kind of keep showing up and applying our experience and our wisdom. And I think, and if we got to, if we keep shaping the world for future humans, like future humans are going to use agents if we can make those future humans world easier by giving them what they're going to get anyways which is more agents and then giving their agents good tools that give them safe determinism in this non-deterministic world well that's the kind of job i'm trying to do now in a way you know i'm trying to build tools for agents trying to build factory tools you know not building the next version of a hammer or a nail gun or a level or things like that.
2:19:41These are things that help you build things like these little primitives you use to like a jig you know things like that. There's a lot of asymmetry to you know literal construction and software development now. Like you probably can go into the construction world and learn a ton about how to build software just by processes inspection, quality assurance yeah tools machinery measurement redundancy you know project management planning all that kind of stuff because that's what we're moving towards you know we're we're an intelligence layer but we're directing an intelligence now you know and we're trying to i think as long as we're building tools that are for humans because what is software for really i guess i'm building software for an agent to use but as a proxy to the human to the human's intent right and i remember something that uh, a colleague I hugely admire said to me a few times, like when I'd been questioning what I was doing, he's like, do what's fun, man.
2:20:38Like, cause otherwise what's the point? Like, I love that. Do what you enjoy. And he's very senior, extremely expert, respect this guy enormously, but I can see that he also kind of lives by that principle as well. And I don't mean that he runs around making jokes. He works with people. He finds exciting and exhilarating and interesting. And he loves just like listening to them talk. and getting excited about it and he he has fun he works with the people he finds interesting he works in the problems he finds interesting and then i think the other one is have empathy because we're all going through this strange change like it's a you know for us as software engineers like we have a place in this world at least for now for a lot of other people like there's a there's a ton of fear out there about what does this all mean you know i don't know what keeps you awake at night with your children but they're going to grow up in a world that's really different and this is this is a time that's quite you know it's it's big it's stressful it's a lot of change yeah i know i've uh said it verbally and directly verbatim inventing fire i really feel like this is like fire being invented you know like humanity changed forever when fire was not invented, it was discovered.
2:21:56I'm sorry, I should probably not say invented. But it's a version of an invention now. I feel like this is the new age fire. Yeah. Everything we know of that is anything we can rely upon in this digital age is going to drastically change because of the way humans will use agents to do work in multiplication forever. Yeah. from this day forward. It's never going to go back to the non-agentic world. It's a little strange, but it's like fire. Expect to be changed. And what happened when fire was, maybe not literally in that very moment, but over time as fire was, we're now aware that fire exists, is we all explored ways to use fire to make humanity better, right?
2:22:48And that's all we're doing, is we're exploring ways to use fire to make humanity better. yeah just don't get lost in the fight yeah right well said yeah dave what else can we uh can we close on anything that i know we mentioned your book in passing maybe not directly let me go to my tabs real quick because i want to mention the exact website effective dash slash hyphen shell i'm sorry i'm gonna say it again effective hyphen shell or diet or dash dot com so order your main website let's see what is your what is your actual website these days man it's dwmcur.com and there's links to most of the dorky stuff there there you go yeah we'll link up in the show notes link to arcs there link to show rights there hacker laws as we talked about in the last pod is there and then I think you probably even link out your book this is I love your site such a beautiful little hacker site really I'm so impressed I like it I don't know how much time you spent on this but I like it your posts are great I love how your posts look it's very hacker but also very readable so cool I love it great job I try to keep that stuff authentic and kind of handwritten because there's a load of amazing professional stuff out there there's a load of slop my stuff is a bit silly and dorky but that's okay that's fun that's what I enjoy yeah well thank you again for coming back on the pod for your post are your project on GitHub, Hacker Laws.
2:24:20Lots of stars. Very much fodder for our conversation here today and the past conversation we had with Jared on the pod. Anything else, Dave? Anything else left in closing? Anything to shout out here in the end? Anything? Yeah, maybe. I've done like four interviews this week. And, you know, earlier on I'd said that I sometimes see a sense of grief when I see people's side projects, their dorky side projects, and I love them. And I'm like, are people still going to do this anymore? But what also struck me today as well is like there's a whole bunch of young people coming into this world with just so much skill and enthusiasm.
2:25:00And I talk to some people who are spooked, understandably, about their industry as well. But also I look at what these people are doing and the projects they're getting onto. And I do think the future's bright for them. With every tech innovation, we've just started solving more complex problems. And I hope that's the case. I hope that's the case that it continues to be interesting. But also to your point, it will do if we have fun, if we make it about actually enjoying what we do. Yeah. I like your friend's advice. Just have fun. Just do what's fun. It's such a compressed simplification of how to interact and how to do it.
2:25:39That's cool. Dave, thank you so much for coming on the pod. It's been a pleasure, my friend. Take it easy. Adam, thanks. I've really enjoyed the conversation and getting to know you a bit more. Yeah, man. Thank you. Cheers, man. Bye. Well, friends, it's always good to talk to Dave Kerr. Love the way he thinks. Love that he has organized these hacker laws for us to enumerate on and to ruminate on. And even cooler, he can come up with a brand new hacker law on the spot. Just chef's kiss. Chef's kiss. Glad to have you here. Glad you listened to this show. Thank you so much for tuning in. It is a wild time to be a software engineer.
2:26:15Of course, a special thank you to fly.io for having our back for sponsoring this podcast. Learn more at fly.io and the beat freak in residence break master cylinder, bringing those awesome beats. That's it. This show's done. We'll see you in the next one.
2:26:55Win it, win it. It really whips the... King of... Yeah!
Dave Kerr created hacker laws, and now he finds himself reviewing agent-written code for them. Back on the show after six years, Dave names what he sees limiting teams today: keeping everyone’s mental model in sync with what’s actually been built. Adam declares it Kerr’s Law on the spot. We get into why Dave’s team treats code review as a deliberate slowdown, how Shellwright lets agents bring evidence to a pull request, and what living with bipolar disorder has taught Dave about noticing when the excitement of these tools stops being healthy.