In short
Dev Interrupted Podcast Episode Summary
Episode Title
You Don't Need More Code. You Need More Business Impact.
Guest
Chris Westerhold, Global Practice Director at ThoughtWorks
---
Episode Description In this episode, hosts Andrew Zigler, Ben Lloyd Pearson, and guest Chris Westerhold explore the intricate relationship between engineering efficiency and business impact. The discussion centers on why engineering waste is often challenging to define and eliminate, emphasizing the need for a clear organizational "North Star" to align engineering efforts with business goals.
---
Key Themes and Discussions
- Engineering Waste and Business Impact
- Definition of Waste: Chris explains that the issue isn't just about tools but rather a lack of alignment with business goals, leading to wasted efforts.
- Human Factors: Most efficiency problems arise from people and processes rather than technology itself.
- Systems Thinking Approach
- Chris advocates for a "systems thinking" approach to identify and reduce waste. This involves understanding the complexity introduced by human factors in software engineering.
- He highlights that understanding and defining waste is challenging because it often manifests through various non-visible means across processes.
- Balancing Developer Freedom and Standardization
- A discussion on finding the balance between allowing developers the freedom to innovate while also introducing platform standardization to reduce friction.
- Continuous Improvement Culture
- Chris emphasizes the importance of cultivating a culture that encourages continuous improvement and recognizes the value of developer experience.
- Metrics and Goal Alignment
- Teams often lack a clear way to measure the impact of their work, which can lead to wasted efforts. Establishing metrics aligned with organizational goals can help navigate this issue.
- Chris notes the importance of understanding what "work that matters" looks like in the context of business objectives.
---
Key Takeaways
- Focus on Outcomes: Rather than merely increasing code volume, the focus should be on creating measurable business impact.
- Clarity and Alignment: Organizations need a clear understanding of their goals ("North Star") to align efforts effectively.
- Engage Developers: Developers often have valuable insights into where inefficiencies lie; engaging them in dialogue can uncover hidden waste.
- Adapt and Evolve: As technologies evolve (especially AI), companies must continuously adapt their processes and approaches to maintain effectiveness.
---
Industry Insights
AI Adoption and Developer Productivity
- A recent survey indicates that AI tools can save developers significant time, with many reporting up to 10 hours a week saved.
- However, there is a juxtaposition between reports of increased productivity versus ongoing frustrations in the developer community.
Context Engineering
- The podcast discusses the concept of context engineering, which emphasizes preparing the context for AI tools rather than merely prompting them.
- Chris aligns this with the idea that better context leads to better outcomes, pushing back against the notion that productivity hinges solely on the quantity of code produced.
---
Notable Quotes
- "You don’t need more code. You need more impact." — Chris Westerhold
- "The best developer is a lazy developer. They want to avoid repetitive tasks." — Chris Westerhold
---
References
- Atlassian Developer Experience Report: Highlights the growing impact of AI tools in software development.
- ThoughtWorks: Insights on engineering practices and strategies for continuous improvement.
---
Follow-Up Actions
- To connect with Chris Westerhold or learn more about ThoughtWorks, visit [ThoughtWorks.com](https://www.thoughtworks.com) or [Chris's LinkedIn](https://www.linkedin.com/in/chriswesterhold/).
- For more insights and ongoing discussions, listeners are encouraged to subscribe to the podcast and engage through social media platforms.
---
This episode provides a deep dive into the challenges of modern software engineering and the vital link between developer productivity and business impact, encouraging listeners to rethink their strategies for optimal organizational performance.
Written by AI. May contain mistakes. Listen to the episode to check what was said.
Transcript
Automatic transcript. May contain errors.0:06Andrew Ziegler, Ben Lloyd Pearson
0:30I love these stories this week, but the Atlassian one seems pretty big. So let's go ahead and cover their developer survey results. All right. So Atlassian, a leader in AI engineering and adoption of these new tools, dropped the recent State of DevX report. And we have a look at a quick snapshot of some of the statistics that were included. Obviously, AI adoption being on the rise is something that they are widely covered, but they're talking about how AI tools are producing more value. And according to their report, 68 % of developers reported a sizable time savings. Like we're talking about upwards of 10 hours a week using a tool like AI.
1:05And that's a pretty big jump from last year's report, where 54 % of those developers said that they were experiencing those gains. So according to that last year's report, you're seeing actually a lot of velocity in how engineers are adopting these tools and using them. You might remember from recent weeks, this actually runs contrary to reports even from LeadDev where we hear about how engineers are not seeing these kinds of productive values from tools. So definitely really interesting to see the competing viewpoints of these surveys. I really recommend folks look closer at them to understand the full story.
1:38And with like all of the reduction in time, Atlassian even goes further to quantify this into how much money you can save as an engineer or an engineering leader. In some cases, they are looking at 10 hours a week of inefficiencies If you have a company with 500 developers, you're looking at like$8 million a year in lost value in terms of waste. Waste, by the way, is going to be a topic we bring up a little bit later today. But Ben, what do you think about this report? Yeah, that 8 million number is pretty stark. I actually kind of think maybe that is all that adopting AI comes down to. Like how much time did it save or how much work, like work hours did it save you versus the amount that it costs you?
2:18You know, because that really does seem to be a good way to evaluate it. But just to be clear, so last year, more than half of respondents to the survey said that they had basically had no measurable improvements from AI. Whereas this year, two thirds are saying they're saving 10 plus hours using AI. Like that's a massive, massive jump. but you know honestly like it actually does kind of resonate with me personally because i am absolutely saving at least 10 hours a week it's you know i've actually been thinking about this a lot lately like there's some point where you know presumably as this technology matures and gets better we're all going to start reaching a point where we're capable of doing two three x what we used to do before ai and i've been thinking about like what is actually like leading that to happen like just personally for me and i figured out there's kind of like two different categories of ways that it's helping.
3:08There's like the stuff that I've always done that is now substantially easier. So, you know, I work a 40 hour week within that 40 hours, certain number of hours of that work that I've always done is now significantly less than that. But I think the stuff that's actually more important is all the new stuff that I never would have expected to do before AI that I'm now doing in addition to all of the stuff that I already do. For example, like here at Dev Interrupted, we're now analyzing research white papers in a fraction of the time that it used to take us to sort of sift through all of these in-depth research articles and try to come away with interesting insights that we can incorporate into our content.
3:50And because it's so much easier now, we have the capacity to not only do this in the first place, but then also to execute it at a scale that just never would have been possible for us. And I think that second category is where we're all going to start feeling that like 2x, 3x of our impact and our output. And I think there's even like potential growth beyond that. Like it's so cliche to say like a 10x engineer or a 10x knowledge worker, but in many ways, I feel like we're actually starting to see glimpses of that. And, you know, my advice is like everything just seems to be accelerating at this point.
4:24So like just strap in and do your best to learn something along the way. Yeah. So our next story, Angie, is about context engineering. So, and I think it's a recent guest, Philip Schmid. So what do we have there? Oh, yes. So there was this really great blog article came out on Philip Schmid's personal website that we're going to include in our show notes, along with everything else we're discussing in the news. And Philip really goes in depth about what is context engineering and defining it as something beyond just prompting. This article distills a lot of really brilliant points about how you need to be thinking about preparing context for an LLM.
4:59And there were many parts of it that stood out to me just based on my own practices. But, you know, Ben, I know you've been experimenting with this a bit yourself recently. What did you think of Philips Insights? You know, I'm just going to come out and say it like I'm kind of getting to this point where I dislike all of these so-called prompt engineering guides that I see everyone making. Yeah. So this is really, I think, a really great take on this challenge. You know, but these prompt engineering guides, they like give you a couple of sentences, they lead you to believe that you're going to solve complex problems with them.
5:29And then they just leave out a whole bunch of like really important context that is behind it. So they'll say things like test your entire code base with this prompt or feed an error log into this prompt and it will debug it for you. Or, you know, write a book like a famous author or something like that. And I mean, those are pretty cool tricks, I think, but they don't really give you like sustainable problem solving. And the reality is that most of the like actually difficult problems that we solve day to day require a pretty immense amount of context. Like humans are really good at both getting that context, but also knowing when we have to go and acquire additional context.
6:09GPDs don't really work that way. Like context engineering is like where you should be investing most of your effort. Like we do that here at Dev Interrupted for content research. So we use GPTs to help us gather high quality data artifacts that we then feed back into custom GPTs that we're training for specific purposes. So like I brought up these white papers, like we can use GPTs to extract really relevant data points and then feed those data points into other GPTs that are helping us build content that might span more of an overarching narrative. And I think there's a lot of parallels to how the stuff can be used in software development too.
6:46But like the reality is like once you have all that context, prompting is actually like the easiest part. Like it actually can come down to just a couple of sentences because you've put in all the work to give the context that the model needs. Angie, like does that match your recent experiences? Yeah, I mean, it definitely aligns with some of the things I've been trying. I liked the way that you frame it. It makes it sound almost more like you're arranging it like a factory. Like you put the parts next to each other, they have inputs and outputs and there's things you expect along the way. I think it's a really interesting way of bringing it together because even Philip himself really hammers on the point that context engineer is a system.
7:22It's not a string. A prompt is a string. Context isn't just like a static prompt template that you paste in. Maybe it has some variables. It's an output of something that happens before it, whether that's a defined system that you work and build to create like a rigid structure for what comes downstream, or if it's data sources that are otherwise cleaned up and organized in a semantic way. But the important part is that your context is organized in a way that's intentional. And while you look at it like a factory, I actually look at it more like a classroom. I see it as what is the minimum amount of things that I need to bring into this world, into this classroom for the people, the agents, however you want to look at them, to come in and understand what are their goals?
8:10What are the tools available to them? What do they need to ask and understand? And ultimately, there's a lot of parallels to organizing a syllabus or preparing for a new school year. You can't throw everything at somebody on the first day and expect them to figure it all out. You have to structure the context and the tools available to them so that they know what to reach for. It's a really different way going beyond just a template string. So I really loved how Philip framed it. We're going to include this in the show notes for y 'all to check out as well. I think the only bit of prompt engineering advice that you actually need, and that is, if you ever have a hard time getting a good prompt for a GPT, just ask it to help you.
8:55Like, it turns out that these are actually like really great tutors. And anytime that you might be wondering, can I solve this problem with AI? just have it help you figure out how to solve that problem. So, you know, you don't need to download any of those prompt engineering guides out there. Focus on context engineering and then just get familiar with working with GPTs to improve that process. All right. So introducing pay per crawl, enabling content owners to charge AI crawlers for access. This sounds exciting. Andrew, what's the story about? Yes. So this is the title of a recent blog post that really kind of opens the door into what the future of the internet and how folks access it might look like.
9:35Cloudflare, as you know, infrastructure for the web, it's global CDN. Honestly, what serves probably most of the websites and services that you interact with on some level. So the impact of Cloudflare makes it perfectly positioned to be the one to solve the, you know, the AI spam, AI crawler issue plaguing the web. If you've been listening to DevEntreptor for a while, you know we've been covering this about how AI spammers and crawlers will go through all sorts of different websites, even free and open source projects, right? And scrape huge amounts of data for their training sets or otherwise used in LLM calls.
10:13And this is actually bringing a lot of systems to their knees. So Cloudflare is introducing an option for content providers to charge on a domain or a DNS level for access to resources. Because when you remember, the HTTP protocol has actually ways built in for handling this. There's a little known HTTP response code called 402 payment required. And while this hasn't really seen widespread adoption and use in web specs until today, now Cloudflare is picking up the pieces of the web itself, showing how much of a self-healing system the web truly is to tackle this problem, allowing content providers to connect payment portals directly to AI crawlers so that those AI crawlers could potentially pay for their ingestion of content.
11:02It's a really interesting look at how content consumption might change under the hood of everything we use. Yeah, I don't think I've ever run into an HTTP 402 error. Like, that's pretty wild. No. And I guess if it's only for AI, maybe I never will run into it even today. Probably not. But yeah, I mean, I love this story because it's like, first we had Anubis and Labyrinth that trapped AI bots in these, like, endless logic problems. Like, if you've been listening to Dev Interrupted long enough, we've covered these stories. But now we have Cloudflare basically trapping or charging those AI bots to get out of that trap, which is pretty incredible.
11:40Yeah. I think it's also the first usage-based pricing scheme that I've seen that charges AI bots specifically for their use, which is pretty interesting. But personally, I'm just thinking about this from the perspective of maybe information becomes free for humans but costs money for AI. And that actually doesn't sound like, you know, it sounds kind of appealing to me, actually. But, you know, don't let the AI bosses hear me saying that. Right. Now you make me think it's like, OK, maybe we delegate all of our work to the AI. Can we delegate all of like that? You watch all my ads. You take care of all my ad spend for me.
12:15And I don't have any ads because my LLM gets hit with all those ads instead. Oh, wow. Yeah. Yeah. Or maybe the AI delegates consuming content to you. Or, I mean, we're talking about now you have a layer between the AI content and where it's getting used. Who knows what other services might pop up somewhere. That new layer. That's very true. Yeah. But, you know, the really big thing here is that this puts Cloudflare in direct conflict with Google's ad division. And this is shaping up to be kind of a battle of the titans. I mean, I even saw in this article, part of CloudFare's strategy is actually they want to change some of the laws around AI and how it can use information on the web.
12:55So, like, personally, that seems pretty risky to me. But I will also agree that we probably do need AI-related laws, not only in the U.S., but probably around the world. So, yeah, but this is, you know, it's an interesting story. It's interesting to see how the web is being shaped by AI. And we'll definitely be covering it here more in the future. All right, Ben. So it's the story that never ends. There is more drama in the AI staff poaching wars that we've been covering week after week in this tiring saga. It's more like a Greek epic at this point. And honestly, I'm basically going to start looking to launch trading cards.
13:31And I'm joking mostly, but I don't know. If I got to cover this one more week, maybe I will. I think Adam, our producer right now, he's looking for ways to set up polymarket futures for some of this too. I mean, where's the fantasy football league? Someone please out there make this. I will feature it here. Now, jumping right into the story, the recent poach is Meta has taken Apple's head of foundation models with an offer that is frankly ridiculous. He was offered a$200 million signing bonus. And just to put that in context for you, that's more than Tim Cook purportedly makes. So according to the report, Meta acquired Peng.
14:14This is the AI engineer, one of the largest packages we've seen in all of this wars, with the 200 million spread out over multiple years. So taking the head of foundation models at Apple is a huge blow to their artificial intelligence program and another huge win for the superintelligence labs. And honestly, this goes to show that there's really no one or anyone off limits here. I'm going to reserve judgment on whether or not it's a win personally. You know, like, honestly, this is all looking so desperate to me at this point. Like, it's almost like Zuckerberg wakes up in the middle of the night in like a cold sweat after having some sort of nightmare about AI and just decides he has to throw like another nine figures sum at the problem.
14:56But, and I mean, meta also just doesn't really have that great of a track record at innovation. Like, Andrew, when was the last time you thought about the metaverse? I mean honestly I never really started thinking about the metaverse but not to rag on the efforts of meta but I definitely think that how all this has played out in the open has made it seem a little bit too theatrical and obviously there's a bit of like the media and press and people like you and me talking about this week after week but when you just look at the facts um it really is quite crazy to see what's happening back and forth between these companies right now yeah well here in the real world, we all have constrained budgets.
15:34We can't afford a nine-figure AI budget. Andrew, I don't even think our company has a nine-figure budget for the entire company. Yeah. If anyone listening to this has a nine million figure budget for anything they're working on, we'd love to hear about it though. So yeah, most of us are here just like trying to figure out like what's even worth investing in at this point in terms of AI. Like I don't think today is the time to double down on any sort of massive AI investment. Like it's the time for agile experimentation and opportunistic investments into productivity. So when you identify something with a lot of potential and not a whole lot of effort to implement it relative to the outcomes, that's the stuff you should be investing in today.
16:15Don't be swinging for the fences trying to get home runs right now. Aim for lots of small wins. I think that's really what the name of the game is when it comes to AI right now. And the big ones are all going to start coming when the market or as the market matures. So just don't follow the Mark Zuckerberg AI strategy. I don't think it's going to work out for you. So Andrew, who's our guest this week? Yes, so in just a moment, Ben and I are both sitting down with our next guest. It's Chris Westerhold of ThoughtWorks. And earlier I mentioned waste. Well, that's what we're talking about in this discussion, waste and engineering.
16:50And no, I'm not talking about the garbage disposal kind. We're talking about that wasted effort between plans and reality. So stick around.
17:27Learn how to do it the best. Download the guide today and lead your team into the future of AI-powered development.
17:35Today we're joined by Chris Westerhold of ThoughtWorks to unpack how engineering teams are optimizing their software development. It's easier than ever to spin up new tools and new platforms, new solutions. But for most teams, that's not what they need. They don't need more code. They need less friction. show. Yeah, and our guest today has seen this firsthand. We're going to discuss some strategies that make sure that you can also prove that investing into the developer experience can help you as well. So Chris, welcome to the show. Hey, thanks. Thanks for having me. I really appreciate it. It's always fun to get a chance to chat with you guys and talk about some of my favorite stuff.
18:13Absolutely. We've got a lot to cover today. Some really cool stuff about how people are looking at their own engineering teams. So I want to go and dive in. The first thing is talking about how companies are spending, you know, huge amounts of time and energy and money on engineering efficiency. But when you look closely, a lot of those same teams lack a methodology to show that anything actually improved from all of that work. And ultimately, that results in wasted effort. Why do you think understanding waste and software engineering is so hard? I think the easiest way to describe it is there is no one way to describe waste.
18:50like as soon as you inject a human into a process it becomes exponentially harder and you know it's why we've been chasing this you know kind of automation for years and years and years and years like how do you simplify but you know waste takes there's handoffs there's just complexity in in a problem there is not understanding requirements misunderstanding requirements there's all of these different bits that go into what really should be considered a creative endeavor in creating software. And, you know, the bigger the problem, the bigger the team, the bigger the thing you're trying to do adds in all of these layers of complexity that are incredibly difficult to not only predict up front, but to try to iron out.
19:39And, you know, you've seen over the years kind of many different methodologies and ways of trying to do this all way back from like the Toyota way to Six Sigma to more modern ways of trying to identify kind of waste and friction. All of them have succeeded and failed in their own way. But the, you know, I think one of like all of that being said, it really comes down to what level are you trying to, to identify that waste? Like the more granular, try to get the harder it gets, but the, the higher, like the higher view you take, you know, the less impactful it is. And so when you're thinking about identifying that waste and friction, you really have to understand what your goals are to be able to get you there.
20:23Because just trying to be better and trying to identify that waste and friction isn't really going to get you there. Absolutely. You called out something really keen is that, you know, by definition, it being waste, it's falling outside of a system that you understand and control. And it's not something that is going to be neatly siloed. This isn't my pile of waste, like how you go to maybe like your source code or your project management, This is my pile of tasks. This is my pile of code. There's no pile of waste because waste hides everywhere. And waste, as you rightly called out, requires a lot of separate initiatives to understand where those individual bits of waste are coming from.
21:01actually i want to point out i think this highlights one of the core challenges of software engineering as a whole that um you know i think more than just about any other profession they deal with unknown unknowns quite a lot like they don't always know what what they're going to encounter when they're building something and even when you've deployed something successfully you don't always know if it has bugs or issues that you're going to have to address later so yeah i think that you know kind of feeds into why ways can be so hard to identify i was i was talking to a client earlier today and they told me that they had been working on a project for 15 months just in the design phase and we're not talking about aerospace building like an f16 no like it just in a kind of standard run-of-the-mill software and you know one of the things they were trying to remove is that kind of waste and friction but they're trying to do it up front And so they spent all of this time, they've been stuck in this analysis paralysis and they're not actually getting anything out.
22:01And, you know, I think another kind of major kind of misconception or just a misunderstanding is like there has to be a certain level of waste that you're okay with, you know, because it kind of leans into like technical debt as well of like, what are the things you're willing to accept versus the thing you're not willing to accept? and then how do you solve them when they do kind of stick their their head into something then you're like oh wow okay that's a problem now let's go about fixing it yeah i mean if you if you spend 15 months planning you could almost consider all of that to be waste in certain universes yeah because i mean at what point are you you know you're you're building a tool to solve a market problem or your user problem those types of things are they really are they really going to be able to sit and wait for 15 months or more to to get that product to market probably not that's what comes to mind for me is that by the time you've solved or created that that product the problem space has moved on you've missed ultimately and so uh but you know that itself too just measuring by speed can become its own kind of uh you know like blinders like we're going to fix maybe our waste has to do with processes around our cycle time or why these conversations take so long people aren't aligned why aren't they aligned are there like for example in a company like that when you ultimately discuss it as an out as an outsider someone not in it do you quickly uncover like really easy to fix problems or are those problems often more systemic to the organization a lot of them are systemic but they are a lot of it tends to be like they just don't know any better or they don't have metrics that help them define what the problem actually is.
23:53Like when you go in and start working with somebody like that, you can talk to some like random project manager like, yeah, we've been doing this for almost two years. But when you think about it from a like a, you know, an executive view, those things tend to get kind of, you know, blocked from them. Like, yeah, it's green. It's on a it's on a dashboard. Everything's just fine. Like, don't pay any attention to it. The problem with waste in general is that it's never one problem. And so like, just to, just to like play forward this example, one of the issues they have is that they don't have full stack developers.
24:23And so they have front end developers, they have backend developers, they have database administrators, they have QA. And so they end up with this, I'm going to pass it from station A to station B to station C, and then they just move down the process. And so when you think about it from that perspective, it becomes really difficult to remove some of that because now you're asking your React developer to understand, you know, back in development and database design and those other bits. And so you have this kind of, you know, you've identified this chunk of waste, but how do you actually go about fixing it?
25:05And, And, you know, they tend to fall in like people problems, process problems, and technology problems. And you see lots of people that will always jump to the technology problem. You know, as technologists, we're like, yeah, we always want more technology. That sounds great. But it's almost always a people problem or a process problem. And in this space, like how do you actually go and start training people on how to do these other bits? You know, that becomes one of the really challenging parts towards transforming an organization. And you see the same thing happening in the AI space now of great.
25:40Well, we've given people all of these new technologies and new tools, but what does that process look like? And what are the, you know, what do you need to do from a people side to be able to actually enable the realization of that value? I love your example of, you know, an organization that lacks that full stack developer. Not only is every step of that process going to like every handoff does that creates waste. But when you have, when you're say like on the third or fourth step down the pipeline and you have to go back to the first because you identified a problem, like that just compounds the amount of waste that you're creating on an organization.
26:15And of course, we'll talk more about AI in a moment because every episode we talk about AI at some point. But, you know, the reality is that AI may be accelerating the generation of waste within some of those steps as well, which just compounds the risk even further. I think it absolutely does. I mean, if you're not actively trying to remove waste or tech debt or any of these other things, it will continue to grow. And whether we like it or not, code deteriorates just by sitting there. And so you're going to need to, you know, an organizational process. And all of these things do. You know, you have things like Conway's Law.
Read the full transcript
26:54And everybody's heard of Conway's Law before. But when, you know, you go in and talk to somebody, it's like, yeah, you've built all of this stuff around the way you operate. And that's not really good for you. And in that, that back to that example I was giving, that's how their organization was set up. And so that's how they were building software. And, you know, you have to rethink some of those things if you're going to be able to really move the needle. So let's talk a little bit about actually moving the needle. Now, we've kind of broken down waste sources of it, ways that it impacts process and tooling within an organization.
27:31And, you know, some people look to things like automation to solve waste. Maybe if you can find ways to deploy faster or reduce cycle time, they kind of view those as like the solution to reducing waste within their organization. But often many teams just need a little bit better alignment and a little bit less sprawl. Like, you know, whether that is process sprawl, like you described earlier or some sort of tooling sprawl, given all of this, how do you identify work that actually matters in this environment where you may have lots of sources of waste that you don't fully understand yet? I always take these types of questions and go back to organizational goals.
28:09And I know that feels like a big step for a lot, but like you hear, you hear lots of people talk about like OKRs and these other things, but like what are the goals you're actually trying to solve as an organization? And, you know, when you think of like young startups, they don't have a lot of money and they want to go really fast. And so you're totally fine with accumulating a lot of tech debt because, you know, you're going to have to replatform this thing once you get your series B or something like that. And that's OK. But then as you mature, you know, less concerned about going super duper fast, you probably have a little bit more money so you can be a little bit more focused on quality.
28:50or maybe you're trying to completely transform your business. Like what are the things that actually matter to you as an organization? And I see a lot of engineering teams really struggle because they don't have a North Star. Like, how do I identify the things that matter? I need to know what our goals are. What are we trying to accomplish as an organization? And then that's going to help me identify the right things to do because you can automate all kinds of stuff. But if you're going to replatform or do some other stuff, you know, maybe next year, it would be silly to spend your time on some of that.
29:29And so to me, not having that alignment, you can just see this rippling effect across an organization, especially as that organization gets larger. I've talked to some orgs that have 5, 10, 15 ,000 developers. And I would bet that if you went up to the average person there and asked them, like, what, like, your work you do every day, how do you think that actually impacts the business? And a lot of them would probably say it doesn't, which is, which is, has its own set of problems. But I've been there. Yeah. I mean, we all have, right? But if you, if you don't have that, like, how are you going to identify the stuff that matters?
30:07you can't really yeah i'm thinking back to when i was in platform engineering at a very massive company and and uh the latest to hot technology comes out and the ceo says we all have to do this thing now and it's like but i work on platforms that don't touch that so like what does that mean for me and you know i think the the second bit around some of that is like you'll hear a lot of engineering leaders say and focus around just productivity productivity productivity productivity and you know the there has been a severe focus on the need for faster typers when i think i mean we're going to talk about ai in a little bit but like that's been like the focus is like oh well we need people to actually write more code and i would say the answer to that like i think that's a false premise you don't necessarily need more code what you need is more impact to your business because like the the value of a line of code is essentially dropped to almost zero at this point with a lot of the other tools and everything that's out there but you know understanding what are you trying to do why are you trying to do it what's the waste that's in your way and you know like i think we all have been on some kind of platform team at some point in our life but you know what maybe abstract away that complexity is the best thing that you can do to let your developers focus on the things that matter.
31:32Like you talked about the unknown unknowns. Like, yeah, you should be, like if it's a known known or kind of a known unknown, great, automation paths for that, bring in your AI tools to help with it and then allow your really expensive engineers to go focus on the things that actually matter, not on things that have been well-sorted inside of your organization and then let other things focus on that. I think another interesting kind of misconception or misunderstanding is that like developers don't like to talk and they do. They'll talk your ear off. All you have to do is just come to them with good intentions and ask them interesting questions and they'll talk your ear off and they'll tell you where all the problems are.
32:18You just have to ask. and when you start to think about that type of thinking and that kind of continuous improvement that goes along with this different set of metrics, you now all of a sudden are doing things that are kind of twofold. If you have a good understanding of where you're going in as an organization and you're listening to your developer community to say, hey, tell me where the problems are. Where is the crossroads of those two things that can have a good impact towards your organization, positively impact your development community. Study after study says that happy developers are going to be more productive.
32:55They're going to write better code, all of those bits. And all of a sudden you've made everyone happier and a rising tide lifts all boats. But if you're like a lot of those kinds of things take a serious level of leadership and organizational alignment to make that happen. Yeah. Yeah. So do you have any examples of an organization that starts to think about, wants to think about things the way that you are describing, but maybe instead of actually improving productivity, they're actually like adding to the complexity of their environment. Yeah. I see this quite literally all the time. And this is the, like as technologists, and I kind of already mentioned this, like we kind of fall in love with technology.
33:39and if you're just constantly thinking about bringing in new tech, bringing in this other stuff, and you're making your environment more complex. I met with a client yesterday, and we were talking about CICD. How do you kind of modernize your CICD platform? And I asked him a question. I was like, well, what platform do you use right now? What's the thing that you're really kind of focused on? And he's like, oh, well, some teams use Azure DevOps. Some teams are using Bitfucket Python. lines other people are using team city octopus deploy jenkins github actions the answer is yes yes and i was like i was like did you just list a did you just google like give me 10 like cicd like he's like oh no yeah no i mean this is just kind of what we're doing and i'm like well of course you have a problem i mean it's about 2 000 developers which is big but not that big and you know so you have you now have this landscape of complexity that is hard enough for the people on those teams to be able to understand but now you've made like you have a high level of fragmentation inside of your organization you've made it difficult for internal engineers to move from one team to another team and you've now essentially kind of crippled yourself when it comes to being able to be nimble enough to go after the things that matter to the organization.
35:06I actually want to touch on something, you know, you mentioned like asking developers to figure out what would actually benefit their lives, but I wonder how do you balance this? Like, uh, you know, I always think if you ask a room full of developers, like if you ask 10 developers, what's your favorite CICD tool? There's a good chance you're going to get 10 different answers probably 12 you know you have 12 actually right so how do you balance this like well the developers want all of the greatest technologies and they just want to adopt what they think is really cool versus like we as an organization need to make sure that we are following best practices we're standardizing things we have like happy paths that are easy to follow along with like how do you balance those two things yeah that's a really great question but I have to give two answers to it.
35:51And so I'll have to caveat a little bit. So you want to think about your early adopters. So like, who are the people that are on the forefront of things? And you can see this a lot in the AI space right now. Like, oh, well, do you want to use Cursor, Windsurf, or any number of other things that pop up seemingly every day? There is a number of people-ish, 10 %-ish, that are going to want to just run around and use all of that stuff and just geek out on it, spend all night, fiddle around with it and find the best way to do it. Like a lot of organizations try to rope those people in. It's like, no, no, no, no, you can't do that.
36:28It's like, well, no, even hold on a second. Like those are people that are going to validate all this stuff for you. Then there's this middle majority that are just like, tell me what to do and I'll do it. Like if you want to buy cursor, great, I'll use cursor. You want to do VS code, fine, I'll do VS code. Just give me an easy path to get my job done. I am technologically literate, but I just, I don't care. Like there's not enough of a reason to care. And so I think in the best organizations, you have a process that can say, let these like cutting edge, bleeding edge people go do that analysis, but then gather that feedback from them and say, Hey, I saw you were fiddling around with Sonnet and, you know, Claude Code.
37:09What'd you think? And as you start to gather that information, you can now take those learnings and apply that to the middle majority and say, great, we've built a really great platform for you. We have some custom IDE plugins. You know, we've determined based on all of this feedback that VS Code and whatever, whatever is fine. And so that's the way that you can keep essentially both of those camps of folks happy. Like that works really well when it comes to those types of tool where you run into problems are like CICD pipelines and like more kind of core fundamental things where it's like, hey, I can't have you just running and going and trying every random pipeline tool under the sun because that brings in cost and complexity and things that are a little harder to unwind than, you know, using J unit or whatever.
38:04Right. You're rightfully calling out that it's less about allowing all these bespoke developer experiences pop up within your organization that's only going to make it harder to exchange knowledge. That's not the same as people who are pioneering or early adopting with tools and experimenting with them and figuring out things that are going to work for your org before anyone in the world knows if they're going to work for anyone. Those are two different levels of choosing your lane, having your favorites, figuring things out. Because those early adopter folks, they might feel strongly identified with a few of the things they're picking up.
38:39But they're not like, oh, I'm JUnit or bust, like what you just rightfully called out, right? If you're in an organization that has that kind of sprawl, there's a lot of opportunities to simplify, I think, the platform. And that actually really flows well into another thing we want to talk about with you, which is about having the right strategy to make those organization-wide engineering changes, make those platform engineering upgrades that are actually going to make an impact and not slow people down or cause a revolt, right? This is what everyone's afraid about when you make massive change for developers.
39:11And right now, you know, AI is being used pretty interchangeably as like an ultimate developer productivity accelerant and unlock. But without platform engineering and a coherent strategy, that's ultimately chaos and it's expensive chaos at that, right? You know, all these queries are costing somebody money. And Chris, you've said that companies need to rethink their systems and their platforms before bringing in new stuff to actually help them. And how do you think that actually looks like in practice and how can a team really start? Yeah, that's there's a lot there. I always like to, just as a general principle, optimize for laziness.
39:53The best developer is a lazy developer. I don't want to do that again. It wasn't fun the first time. I don't want to do it again. Give them a path to be able to do that. And I think a good platform and a good platform strategy enables some of those things where you have these kind of golden paths that allow people to be able to do things easily, but it's flexible enough for you to be able to say, Hey, here's how you can modify this to make it work for you. Here's how this kind of like centralized ownership or centralized controls, but federated ownership. Like I'm just providing you with a core and allowing you to be able to go from that.
40:33Like that's one way, like, you know, the, I always liked, uh, I always kind of bounded autonomy is another thing that I try to talk about of like, you know, Hey, well, there has to be a box. I can only support so many tools and so many tools, so many things. And so now this is how we're going to, you know, provide these sets of tools out from a platform perspective. They're going to be well curated. They're going to be easy to use. They're going to, you know, kind of hook into all of the things that you would expect them to do. And the vast majority of people are going to be okay with that. And you're going to get a lot of unlock from a productivity perspective by providing people with this kind of set of tooling.
41:21You know, the way that you kind of described the question, like a lot of people do feel like if they tell people they can't do something, it's just going to erupt in chaos. Like I, but I don't think that's necessarily true. If you invoke like the EAs of old of like ivory tower, like, you know, you shall not pass kind of stuff. Like, yeah, you're going to get some really bad reactions. But when I think of good developer experience, good platform engineering and kind of like just a really good metrics to strategy overall, like you have to do it with your community, not to your community. And so if you build that culture that says, hey, you know, I would love to have every tool under the sun.
42:05I can't. I'm sorry. I know you're a huge fan of Go, but we're a Java shop. Like, I just can't have five random services written in this thing. I get it. It's a cool language. There's nothing I can do about it. And if you have a, you know, an open set of conversations about those kinds of things, and you have a process where people submit stuff and you, you really build that community and go back to like the, you know, dissent, but agree, like kind of a thing where it's like, yep, I get it. don't agree with you, but I'm going to accept it and move on. That is the, the cultural impact that you have to have around all of this stuff or everything just falls flat.
42:48And you end up with chaos of tools and things. And like, you know, there's no productivity and just everything is just a mess. In the end, engineering takes good leadership and there's no tool in the world. There's no AI that can come in. There's nothing that can replace that kind of a thing. Cause it's just not easy. And that's the, like, that's the stuff that you have to get there. And whether, you know, AI tools, platform tools, all of these things are going to help enable people be better, but you got to get the crap out of the way, the waste and friction. And that's done through leadership and through continuous improvement engine and rethinking about everything.
43:28So you're talking to a bunch of companies that, you know, I mean, every company we talk to is asking like a pretty consistent set of questions about AI and how it's affecting, you know, how How to adopt it, how to manage the impact, how to make sure it's responsible and all of that. So just from what you've seen in recent months working with various companies, what is the difference between a company that is doing a great job at incorporating AI into their workflows versus one that hasn't yet leveraged it or has tried to leverage it and failed in some way? Like, what do you think is the main difference?
44:00It is a difference between system thinking and tool thinking. If I've heard this once, I've heard it a million times. we've implemented Copilot or any other tool we've implemented Copilot, you know, last year and we've seen nothing. We've seen almost no impact at all. And can you come in and help us prove the impact? And I'm like, hold on a second. There's a couple of different problems here. One, like I can't, I can't prove something just because you want it to be proven. And you, you just, I know you've spent probably millions of dollars on this, but it doesn't mean that it's right. And, you know, this goes back to the kind of the fallacy that I talked about before of needing faster typers where, okay, if you're going to just bring in a code gen tool, that is predicated on the fact that I need a faster typer to create more code.
44:47And that's just not the case for people that are really doing really good things with AI right now. It's by rethinking value streams and systems to enable people to not only work better, but to get to better, higher quality output. Because if you look at the data, like especially some of the kind of initial data around things like Copilot, and this is not me pointing fingers at Copilot, it's just an easy, easy word to use. Like, yeah, that, you know, people leveraging Copilot and those types of tools, you're getting a lot higher level of bugs. You're getting higher code complexity. you're getting and you know i think one of the reasons for that is the fact that you're just saying hey give me this block of code and move on and you're not you're you're thinking about it as a one-way street in a lot of ways and this is where like the whole vibe coding thing has come from but like thinking about your ai is essentially like a coding companion like at thoughtworks we've always pushed pair programming and you can think a lot about an ai system as being a pair and treating the AI assistant that way.
45:52Hey, ask me questions about this particular set of code and not just, Hey, give me a block of code that does X, Y, or Z. And as you start to think about it that way, especially in like now this kind of agentic world that says like, great, well, this is an agent that I can talk to that can help me with infrastructure. This is one I can talk to about, about better pipelines or about whatever, or design, or, you know, and I can pull in all the context that I can think of from across the organization to say, hey, these are all of my design standards. These are all the ADRs around my design. Here is our kind of core infrastructure and all of these different bits around auth and auth Z.
46:31Now, all of a sudden you can start to have a much more targeted and interesting conversation to say, great, how do I solve this problem? Not how do you give me more blocks of code? Right. And it goes back to like the value of a block of like a line of code is essentially zero now because like I used to hire you because you knew Java. Now I need to hire you because you can solve a problem. And by redesigning these AI systems that can pair you across that for these different problems, that's where people are really starting to have success. Yeah, I think personally, you know, I've had the most success when I can break any challenge that I have down into a very fundamental component.
47:12Like, you know, I think really what it comes down to is having a good data set to feed into an AI model that is then makes decisions within a very specific criteria. Because you really think about LLMs, they're trained on lots of data, including bad data. So just because they know a lot doesn't mean they're always going to make the right decision. but because they were trained on bad data they're also very good at what you described with the pair programming where when you ask them to challenge your ideas they're much more capable of spotting where you're making bad decisions or or have bad ideas yeah and i think that approach a lot we've seen a lot of development teams have had success when they treat it more like a sparring partner rather than like something that just delivers volumes of code to them.
47:58Well, and it goes back to like, how are you improving now? Like your knowledge and also creating better output. What is the business value and the business impact that you're trying to get to? Great. You need high quality code that is going to solve a certain set of problems, not getting code out there fast. That'll solve some of those things. That's why I've had this personal kind of bad reaction to this focus on productivity where it's like, yes, we all want to go faster and do more, but labeling it developer productivity just seems like a really bad marketing campaign. Like what you want is better outcomes and, but you need good high quality code to be able to make that happen.
48:42And, you know, the, you know, kind of the explosion of these AI tools really can make people, you know, way faster, but you're only as good as a system in which you work. And so if you're going to, what's the Einstein quote? Like if you're going to judge a fish by its ability to climb a tree, it's always going to think it's stupid. And so like that kind of overlays into this, like if you're going to put somebody into this machine that just you're constantly running on this treadmill, that's a problem. And so how do you change that dynamic? That's that type of system type thinking that you have to bring in and remove that waste, remove that friction, and then enable people to actually get the job done.
49:23Right. It's like moving in like a different modality of being a knowledge worker. You're just working with the information that's going in and going out in different ways. What I find whenever I'm using these new agentic tools, whether it's to code or to design something, there's so many ways that you can use it, but ultimately I partner with it in order to create the artifacts that I need to have better outcomes. Instead of working with the LLM in a declarative or imperative way, like do this, make this, create this, interact with it in an interrogative way. And then as you and the LLM kind of crystallize that knowledge and get really firm and really crisp on what you need and what you're building, then actually what you need to create is a really good document to put that in for a future conversation to use.
50:11The business context and the impact that you're making, you're ultimately producing different artifacts of knowledge work. And that's like a whole different modality shift. And people can only work in that kind of environment when they have the right tools and ability to do so. and the like there's a bunch of different kind of paradigm shifts that are that are kind of coming along with that because like you you know we've we've long complained about documentation and the problems that come from that and you know there are really good you know kind of llms that can go and analyze your code and analyze these other things to come up with better information but you know as you're moving through like the sdlc life cycle now and as a developer that is you know creating code why are you not saving chat threads like hey this is the thing that actually used it to this was my logic that i was using to walk through it why you know now with as cheap as storage is and cheap as everything else is why would you not store some of that stuff instead of saying like hey like summarize this code for me and then dumbing that into confluence like that's not as it's useful for some but in this new context like who's going to go read that what you're going to want to do is just you know type in a question in an element it's going to go find it well in this new model you can start to save a lot of other sets of information that are going to help when it comes to solving those other problems and it's like hey i need to go change code well we've all been here it's like looking at a new set of code and you're like man who wrote this and then you go look at the commit message it was you and you're like no this doesn't make any sense at all.
51:51Like, what was I thinking back then? And I remember early in my career, I could remember every line of code I wrote, like everything that I changed, it was just, and then you get to a certain point, you're like, I can't remember any of it. And so you can, how do you start to think about saving out of this information to provide better kind of telemetry and observability to what happened for future you? To tie this back to something that we talked about sort of at the top of this episode is You mentioned that like 10 % of developers that are naturally going to want to go out and experiment with new technologies, be the ones that are on the cutting edge and bring back learnings.
52:28To me, when I hear that, I also get a little skeeved out because I start to think about shadow IT. And as somebody who used to run shadow IT, I can't condone the practice, but I understand why that sort of thing happens. so you know to me that kind of use one of the risks of like unstructured ai adoption what else are you seeing as like a risk to overall engineering effectiveness developer productivity developer experience however we want to use whatever phrase we want to use to describe this like if an organization doesn't have structure to the way they're rolling it out what are the risks that they're they're bringing into the company yeah that's a really great question and I actually started my career in shadow IT as well so like I fully understand and I also don't condone but you know one of the like I made a joke the other day about you know kind of LLMs are giving like shadow IT weapons of mass destruction because you can I mean I've done some stuff with like Microsoft Access and like like some like weird scripts that should have never been done but you've now given i imported as insecure dependency now you know it's right you've now given people essentially you know tools that can have really serious impact to an organization when it comes to security and everything else like if if everything is run in the cloud and you're now allowing shadow it essentially to run these things like you you have a whole nother layer of problems that you didn't have before and there needs to be a lot more governance from a platform perspective from a just quality and security perspective and like how do you you know i really think that is the it's stuff we've talked about for a long time but i think this is where we're going to be forced into this particular like kind of mindset of, I have to have essentially hard gates that stop something from moving into production because of the problems that can come from this.
54:34Have a data breach from some random thing that got deployed into some random cluster in the cloud that cost you who knows how many millions of dollars. That's a problem you're only going to find once. And how do you stop that? You're going to have to have those layers into there or you're going to really, really struggle. I think the way you solve this, so like that was my doom and gloom version. But I think the way you actually solve this is by you have to kind of get rid of these groups. And like I understood why you had them before because you, you know, they were generally around analytics and reporting and some like really weird like little workflow tools.
55:17But if you're, if you can truly free up your really expensive engineer's time with, you know, this level of kind of AI and automation and everything else, give folks like that the ability to create proofs of concept that can truly show value and be able to now say, great, look at this thing. it's really you know it has these things it has this business value and then be able to pass that into your you know traditional it groups to get built i think there is a way of rethinking about how really technology works inside of an organization and you know everything down from from the way you prioritize projects and products and applications and do portfolio management, but even down to like, what does a tool like JIRA look like in the future?
56:19And do you need to follow those same kind of constructs that you've had over time? And because now, if it is truly that much easier and better to operate these things, which you should if you're building the right kind of systems, then great. Great. How do you enable the folks inside of your organization that know where the problems are? How do you enable them to fix it? And you don't want them to have to fix it on their own. So great. Give them an avenue in. Just like with the platforms like we talked about earlier with the, you know, dev tools. Great. It's the same thing. Right. It's like, hey, you can build a really cool POC and guess what?
56:53We can now take and translate that into something interesting. Before we wrap up, Chris, where can people go to learn more about your insight and connect with you? Yeah, you can find me on LinkedIn, ThoughtWorks.com, Carrier Pigeon, email, whatever you can find. I'd love to chat with you. I love to hear people's stories about what's working and what's not working inside of their organization. It's always something interesting and there's always really hard challenges to find. Things can get better. I always go back to the Chinese adage of when's the best time to plant a tree. The right answer is 25 years ago, the second best one's today.
57:33And so when I think about measurements, metrics, removing waste and friction, just be a little bit better tomorrow than you are today. And in two or three years, you're going to look back and go, wow, we've really made some progress. And we didn't do it through this big, messy kind of transformation. We just naturally, you know, made things a little bit better. And I think that's really the way that, you know, success is made. Ben and I completely agree and it's all about having that communication and in being able to understand like I can make an action right now so I should do it it's about doing the little things today that are going to make that huge impact for tomorrow and you know thanks so much for sharing your insights with us we also uh you know Ben and I and the Dev Interrupted team we we do also love to hear from folks about what they're doing inside of their own engineering teams if anything we've covered today is really kind of close to heart to you or fascinating or maybe you even have countering opinions, we would love to hear them.
58:24Please, you know, reach out to us. You can reach us many different ways, like on LinkedIn, maybe on Chris's, you know, maybe you can actually reach Chris by like Smokestack. I don't know. But if you actually managed to do that, let me know. And to you, our loyal listener, you know, you've made it this far. We've had a really nice conversation about how teams really work. So if you made it all the way to this point, you clearly loved what we chatted about. Please be sure to like the episode and be sure to tune into Substack, where every Tuesday we drop this episode along with engineering news. So if you're not reading that, you're only getting a tiny scoop of the story.
58:57So we'll see you next time and take care.
From the publisher
Is your engineering team shipping more code but creating less business impact?
We're joined by Chris Westerhold, Global Practice Director at ThoughtWorks, to confront why engineering waste is so difficult to define and eliminate. He explains that for many teams, the issue isn't a lack of tools but a lack of a clear 'North Star' to align their efforts with real business goals, diving into why so much well-intentioned work results in wasted effort and increased friction.
Chris argues that most efficiency problems are rooted in people and processes, not technology, and why a 'systems thinking' approach is crucial for real improvement. He shares insights on balancing developer freedom with platform standardization and the leadership required to build a culture of continuous improvement. Learn why focusing on better outcomes—not just more code—is the key to unlocking your team's true potential.
Check out:
Follow the hosts:
Follow today's guest(s):
- LinkedIn: Chris Westerhold
- Learn more at ThoughtWorks.com
Referenced in today's show:
- Atlassian research: AI adoption is rising, but friction persists
- The New Skill in AI is Not Prompting, It's Context Engineering
- Introducing pay per crawl: enabling content owners to charge AI crawlers for access
- Meta poached Apple’s head of foundation models with $200M offer - 9to5Mac
- OpenAI Poaches 4 High-Ranking Engineers From Tesla, xAI, and Meta | WIRED
Support the show:
- Subscribe to our Substack
- Leave us a review
- Subscribe on YouTube
- Follow us on Twitter or LinkedIn
Offers:
