1. Podcasts
  2. Practical AI
  3. Building Human-Centered AI
Practical AI

19 Nov 2026 · 45m · 15 chapters

Episode artwork

Building Human-Centered AI

In short

Building human-centered AI in banking—how Scotiabank approaches generative/agentic AI with risk, compliance, and measurable business value, while keeping humans in the loop.

Guest backgrounds

Dr. Gautam Palapa is Principal Director for AI and Innovation at Scotiabank. He has a PhD in machine learning/AI, taught in academia for ~6 years, and previously worked in cloud-native/application development at Pivotal and VMware (Tanzu/Kubernetes). He’s also the author of Invaluable.

Key claims

Start with organizational value and define/quantify success before choosing AI. Use “low-hanging fruit” first; avoid fully autonomous transactions (e.g., agents performing personal account actions without visibility). Agents aren’t “intelligent” like humans—non-deterministic probabilistic models lacking real-world context and intent. Happy, empathetic teams are more productive; technology should reduce customer/employee friction and move humans to higher-value work.

Notable examples

Rebooted Scotiabank’s internship program like a startup with rapid prototyping and customer/workflow problem pitches; experimenting with agent swarms for software design/testing via multi-agent patterns and evaluation juries.

Written by AI. May contain mistakes.

Chapters

1:15

Dr. Palapa's Background

Dr. Palapa shares his journey from academia to his role at Scotiabank.

“We have a fantastic guest, so much experience.”
2:25

Overview of Scotiabank

An introduction to Scotiabank's services and goals in financial services.

“I spent about six years in academia teaching various topics.”
4:26

Transforming Banking with AI

Discussion on the traditional conservatism of banks and the push towards AI.

“I have the honor of working with a lot of very smart individuals and teams across the globe.”
6:31

Opportunities for AI in Banking

Exploration of how AI can improve banking operations and customer interaction.

“I think what happened over the years is that as organizations started moving faster and people and customers started expecting things and services in a different way, and a lot of it actually goes to COVID, right?”
8:23

Assessing AI Implementation

Dr. Palapa discusses assessing AI opportunities within regulatory banking constraints.

“and the way in which people interact with us and with the systems.”
14:08

Understanding 'Invaluable': Key Insights from the Book

The author discusses the inspiration and key messages of their book 'Invaluable'.

“So, invaluable is something that came out of a lot of interactions with executives and with organizations.”
19:46

Integrating People in the AI Transformation Process

A discussion on the importance of empathy and human values while implementing AI in organizations.

“How do people fit into the process so that everyone wins and that they can kind of retain their humanity as they go through?”
27:55

Challenges and Mindset Shifts in AI Implementation

The speaker shares insights on overcoming resistance to AI and enhancing human roles.

28:07

Understanding Human Value in AI

Explore the importance of demonstrating value to individuals in the context of AI.

“Here are the various things that you can do to help us on this journey.”
29:51

Integrating AI in Workflows

Learn about practical AI applications in internship programs and team dynamics.

Show all 15 chapters
30:43

Shifting Mindsets in Software Development

Discover how to transform traditional development practices with AI and new methodologies.

“So let me start with people aspect of things and then talk about some of the technologies.”
36:18

The Future of AI and Human Collaboration

Delve into the future of AI integration in organizations and the human element in technology.

“just going with the flow would be really useful to people.”
39:54

Navigating AI Implementation Challenges

Understand the critical questions to ask when integrating AI into businesses.

“As we start winding up here, I'd really like to get your thoughts, insights, and maybe aspirations into where this is going to go.”
42:01

The Role of Technology in Improving Lives

Explore how technology can enhance quality of life and global outreach.

“And the next thing is that the world is becoming extremely smaller.”
43:35

Closing Insights and Farewell

Reflect on key insights shared and the importance of human-centered technology.

“improve people's lives is what drives me day in and day out.”
A man walking through an airport, asking his phone a question

Ask about this episode

Get the gist, explore an idea or ask about something said.

Claude

On Practical AI, what are the key points of this episode?

Searching your listening

Transcript

Automatic transcript. May contain errors.

0:02Welcome to the Practical AI Podcast, where we break down the real-world applications of artificial intelligence and how it's shaping the way we live, work, and create. Our goal is to help make AI technology practical, productive, and accessible to everyone. Whether you're a developer, business leader, or just curious about the tech behind the buzz, you're in the right place. Be sure to connect with us on LinkedIn, X, or Blue Sky to stay up to date with episode drops, behind-the-scenes content, and AI insights. You can learn more at practicalai.fm. Now, on to the show.

0:41Welcome to another episode of the Practical AI Podcast. I am your co-host, Chris Benson. Daniel Whitenack is out. I know that some of you who listen to the show regularly know that he was expecting and he has had his first child, a daughter named Dot, who was born a few days ago. And Daniel is wisely staying out of the show briefly long enough to spend some special time with Dot. So I hope you will join me in wishing the family very well as wife Brittany. And with that, I'd like to dive right into our show this week. We have a fantastic guest, so much experience. I can't wait to ask questions here.

1:28I'm welcoming Dr. Gautam Palapa, who is Principal Director for AI and Innovation at Scotiabank. And he is also the author of a book, Invaluable. And looking forward to talking about all those topics. Welcome to the show today. Thank you, Chris. Thank you for having me. And congratulations, Daniel. It's a great time, especially becoming a new father. It's an amazing thing. Your entire world is going to get rocked. So, yeah, good luck for that. Yeah, I think he's going without a bit of sleep. I know he really wanted to join today. We were texting earlier and I was like, stop talking to me and go back to your baby.

2:03So anyway, with that said, I was wondering if you could give us a little bit just about your background. You have a really interesting mix of kind of skills that come together, I know, and I know we'll get into that in this conversation. Could you just tell us a little bit about kind of where you come from and how you've ended up at Scotiabank and the position that you're at? Yeah, sure. So I actually come from academia. I spent about six years in academia teaching various topics. I did my PhD in machine learning and artificial intelligence. I'm kind of an old person working in traditional AI and ML, as they are called today, or classical AI ML.

2:45I worked at a number of companies, have always been in the cloud native and application development realm. And then I worked with products for a long time. I worked at Pivotal and VMware, where I was working on Tanzu, more on the cloud container space, more all about Kubernetes, trying to make sure that we can transform applications and move them to the cloud. And then I got this opportunity. My current CIO, he reached out to me and asked me if I could come in and help transform portions of the bank. And so here I am. I'm helping drive AI and innovation at the bank for two large business units.

3:30We do a lot of experimentation, and I'm trying to bring in rapid prototyping, iterative development, and all the cool things that everyone's doing nowadays. And I guess as we dive into the conversation, I know a lot will be about the bank. We have a global audience. There will certainly be some people in different places that may not be familiar with it. Could you do a brief introduction to the bank? Of course. So Scotiabank is one of the top five banks in Canada. It has a lot of presence in the entire North America corridor and EMEA. so we focus on not just retail banking that is what people are think of when we look at banks but also global wealth management banking and capital markets private lending a lot of other things so anything related to money and to financial services is kind of what we do at Scotiabank.

4:26I have the honor of working with a lot of very smart individuals and teams across the globe. And our entire goal is to help people on their journey and to help them use the financial assets that they have and help open doors and opportunities for them so that they can grow richer and wealthier and also have a much higher quality of life. So that's kind of the purpose of Scotiabank. And I help lead AI and innovation for two of the business units there. So I'm kind of curious. I think traditionally when people think of banking, they think of conservative and maybe not right on top of the latest technologies and stuff.

5:14And you have clearly, from what I already know, have dived in and really made some differences. Can you talk a little bit about how the bank got to the point where they wanted you to come in and do this? And what does that look like in the world of banking to bring AI? What do some of the key things look like before you've introduced AI? And then as you've done that, how does that change? And what does that mean? And how does that relate to the rest of the banking? Yeah, so banking traditionally, and by good reason, is extremely risk averse. They have to make sure that they are compliant. They have to make sure that they are protecting not only the assets of the people, but also of the bank itself.

6:08There's a lot that happens when you have that level of risk. And so in the past, banks have always been very conservative. But that is because, you know, the risk profile and the appetite is low. We want to make sure that people don't have to ever think about where the money is and they always have access to their wealth in any way, shape or form. I think what happened over the years is that as organizations started moving faster and people and customers started expecting things and services in a different way, and a lot of it actually goes to COVID, right? Like we were completely virtual and there was no way that we could go to a brick and mortar building and actually transact or perform any kind of services.

6:56So it was inevitable and forced every single organization to try to take a step back and change the way that they're approaching customer experience and the customer journeys. And I think a lot of that is what translated into this modern view of looking at things, banking included. So now everyone has a smartphone, they have an application, they want to do pretty much everything on their phone. They don't want to go and talk to someone or introduce artificial friction to make a transaction occur. And so it's inevitable that we need to look at our processes and our approaches and make them ready for the newer generation and for the various people.

7:39And this is why I think all the banks and every financial institution is looking at generative AI and artificial intelligence in order to help them achieve that because you are accelerating the delivery of value and the speed to market with all of these things. That's what the banks started to look at, especially the top five banks here in Canada. The U.S. have already been doing a lot of it in the past, and the top five banks are starting to catch up with them. And so there's a lot of investment into generative AI and agentic systems to try to help them because it's one thing to improve a process.

8:20It's another thing to reduce the manual friction and the way in which people interact with us and with the systems. And I think the organizations that take a deeper view and take a step back and try to look at what business value they're trying to develop and how can AI or any other technology help them are probably the ones that are going to have a huge amount of benefit. I'm curious, as you talk about kind of the risk profile and the fact that there's regulation, there's a lot of laws around banking. As you come in looking for opportunities, how do you make the assessments given all the constraints that the whole business is operating under?

9:08How do you pick a ripe target for generative AI to come in and make a substantial difference for operations or for customer interactions and stuff like that? and how do you know what to stay away from? Like if you could also talk a little bit about I'm not going to go there, you know. Sure. So this is a very vast field and it depends from organization to organization. And the reason why I say this is because every organization has its own heritage, its evolution, and it's set off opportunities that they can work on in order to improve. If you look at every domain, So let's focus a little bit on banking.

9:50There are only certain things, certain services that banking provides. It's not like a huge catalog of things. There are a finite set of things that need to be done. So I think the first question is to find out what exactly is value for the organization, right? Like, let's identify those. What does value mean to us? And how does it connect to our strategic imperatives for our organization? How does it drive? Not just the bottom line, because at the end of the day, it is getting profit. And especially if you're publicly trading, you want to generate more revenue and you want to become more profitable, increase the ROI.

10:33But in addition to it, it's also customer satisfaction. It is about how you can make it much more convenient to people. And so there are so many other strategic imperatives. So once you identify the value, the next thing is to actually understand what is the definition of success. Just because you identify what the value is does not mean that you know what success means. So quantifying what success means is probably the next thing. And once we have those two things, the next question to ask is, so how can we achieve it as quickly as possible? And probably that's where then the question is, how can AI help?

11:10And it is not just AI, because there are multiple ways, right? Like in the past, we've always, especially for fraud, we've been using traditional AI ML algorithms for a very, very long time. But now with generative AI and agentic AI systems, you have this, it started off with this human, you know, task agent bot approach. And then afterwards, as we have started evolving more, it's become the human task agent. So now we have the agent actually going ahead and doing things as much as possible. And then we've gone into the human agent teams and finally agent operated. So there are multiple ways by which you can use AI for this.

11:55And I think exploring that, we would definitely start looking at what is the low-hanging fruit or the things that are not going to impact us that we can use. And then afterwards, it's probably going to be what are the things we should not. So, for example, at this time, I probably don't have the appetite to connect my personal financial accounts or bank accounts to an agent and have it perform transactions or do things. Because pretty soon, I may not even have visibility into what the agents are doing. So maybe today I don't have that appetite. Maybe we'll look at much more simpler things like customer service agents or, you know, chat assistants and trying to help with compliance and risk, any kind of, you know, looking at the help of the portfolio of the person itself and trying to provide support to the advisors is probably what we're looking at.

12:52But I don't think we're going to be radical enough where we're going to say there's not going to be a human in the loop at all or human at the helm. I just have agents do things. I don't think we're ready. And I don't think we trust the agents that much yet. Imagine a smart home you run by talking to an AI assistant like you're talking to another person. I could see myself creating a website showing people how to set that up. But making that site look professional and feel intuitive, that's where I'd want help. Framer is the AI website builder that helps creators, teams, and businesses ship production-ready sites faster than ever while getting every detail right.

13:31Prompt, inspect, edit, and publish in one place at a whole new pace. For a project like that, I'd look to Framer to help turn the idea into a polished site. Agents help draft and refine the pages. I'd decide what goes live. Learn how you can get more out of your site from a Framer specialist or get started building for free today at Framer.com slash practical AI for 30 % off a Framer Pro annual plan. That's Framer.com slash practical AI. Rules and restrictions may apply. so as we come into our our next segment i really wanted to uh start asking you some questions about invaluable the book that you've written um i know uh there's some key things in there that i know uh our our viewers will be interested in uh could you tell us a little bit about what invaluable is about why you wrote it and and some of the the key messages that you're trying to impart with uh with your insights and wisdom.

14:36Yeah, sure. So, invaluable is something that came out of a lot of interactions with executives and with organizations. So, in my previous role, I used to be an executive advisor and a field CTO. So, I used to work with executives from Fortune 500 companies and help them in their transformations. So we had various workshops and exercises that we used to do with the executives and various interviews where we try to help them understand how they have to transform their organizations. And it's not just from a technology perspective, but it's also from a process and a business perspective, because the goal of any transformation is to reduce the amount of friction from ideation to business value, right?

15:26So that's the goal of what we were doing. And so over the last, I want to say the last five, six years, what we've been doing is talking to all these executives and running like over 600 plus hours of workshops and maybe 400 plus interviews with various executives in Fortune 500 companies. And then we started realizing, my co-author and I, we started realizing that there's no actual framework to help identify the value and the delivery of value. And so we started writing about it, and that's what invaluable is. It's a 360 degree view of helping executives, transformation agents, change agents, and even technologists to identify what is truly valuable for the organization.

16:12Then we help them define and quantify what a definition of success means, and I touched upon it a little bit earlier. And once we identify and quantify what success means, the next thing is to actually measure it because if you don't measure it, you don't know if you actually have to pivot or persevere in the direction that you go. And then after that, measuring success, the next thing is to say, okay, let's establish the priorities because everything is not created equal. So we do the prioritization of it. And after that, we ask the question, how can I leverage AI? Especially in this generative AI and agentic AI world, the next thing is to ask yourself, how can I leverage AI to achieve the success that I want so that I can deliver the value that I need to deliver?

17:01And once I leverage the AI, the next question I ask is, so what is preventing us? What are the impediments that are preventing us from doing these things? And that goes into optimizing the processes and any other tech stacks that are necessary to leverage the value. And then finally, we overlay the risk around it because everything that we're doing is about risk. So it's kind of a happy mix of understanding complexity, understanding productivity or value, and then understanding risk, and then seeing which of these levers and appetites we have within the organization, and providing a much more objective and very detailed way for people to start delivering value within their organizations.

17:45And that's why we introduced the value transform. It's got eight different sections that you look at. And that's why we went with an octopus. Like if you look at the cover of Invaluable, it's actually an octopus. So we very fondly call it an octopus. And that was why we wrote Invaluable. It's actually battle-hardened. We have used it with a number of Fortune 500 companies and helped transform them. And so I think it's just a culmination of all the work that my co-author and I have done. So it took a while. I think it took us about, I want to say, two years of writing. And there's one chapter, especially the one around leveraging AI.

18:29We had to rewrite it more than six times because the world was changing so fast. And finally, our editor was like, you need to stop at some point. Otherwise, there's no way you can publish the book. And so, yes, it was a great experience. That's fantastic.

18:48I'm busy working on a book in the late stages, and it's been going for quite some time, like you, a couple of years. And you just now said a couple of things that really resonated, like, where do you stop? Where do you wrap it up? So I may offline have to pester you as one author, aspiring author to another to figure that out. You were well known for bringing empathy of the people in. You have this sophisticated, battle-hardened process that leads to bringing technology, AI in this case, into that. How do the people fit in? We're in this moment in human history where all this, as we've talked about, is changing so fast.

19:37And it's having huge and unforeseen results, the impacts on people and their families. How do people fit into the process so that everyone wins and that they can kind of retain their humanity as they go through? Could you talk a little bit about how you've implemented that? Yeah. So I want to start off with a couple of things. The first thing I want to say is I want to share my primary belief. My primary belief is that happy people are productive people. So everything that I do is to make my people happy and then automatically amazing things happen. It's not that hard to get into that mindset because at the end of the day, it's never technology that actually creates value.

20:24It's people. Technology can only be an accelerator and it can take you in the direction that you want it to go. But it's people who are really the true value creators. So that is the lens that I start everything with. The next thing that I firmly believe is that technology is actually rooted in empathy. If you think about technology and everything that you're doing, the reason why we use technology and deploy it within our organizations is to reduce some kind of pain. It could be pain for the customer, and that's where you have customer empathy. And there are lots of techniques and ways by which you can understand, put yourself in the shoes of the customer and try to understand the pain that they're going through.

21:08Or it could be internal to us, right? Like as employees, we have employee empathy as well. And that's where you're optimizing processes, reducing the amount of friction points and manual toil that people are going through. So that's the second lens that I have. Now, with artificial intelligence and especially with generative AI and agentic AI, what has happened is it's really changed the way that we value our tasks and the things that we do. So, for example, coding used to be like one of the most valuable things for software development. People used to say, like, if you're a software engineer or you're a developer, then you are set.

21:46Like, it will never go away. But all of a sudden, that fundamental principle is shook. Like, you don't actually need people to be coding anymore. And actually, you shouldn't because the systems and the agents and the applications, they can actually write code a lot faster than we as humans can. Maybe it's not performant. It's not, you know, as elegant as we would as humans, but it gets the job done for now. And maybe it's not enterprise grade either, right? So what technology has done, and especially in this last few years it has done, is it has helped us start looking at, and this is where I get super excited, it has helped us start looking at everything that we do and then identify things that are high-value activity for us as humans.

22:31And then our entire goal is to make these low-value activities, like coding, writing documentation, writing tests, all those various things, that are systemic and repeatable. Those are now low-value activities, and so they can be handled over by systems and they can be done. And so all of a sudden, what excites me the most is it's taking artificial intelligence for us to really value humanity and human values and creativity and all the things that make us as a human being and pushing us up the stack. We are evolving thanks to our digital assets. That's an amazing time to be. It's a great insight there.

23:13And I love that perspective. And I certainly, as someone who most of my career with software development, you just described an adjustment that I personally had to make was, you know, after decades of coding to recognize there was a better way and that whether I thought I was a very competent coder or not, that still wasn't the path forward. So I appreciate that. That was hard to do, though. It was hard to make that emotional adjustment. As you're bringing, you know, this insight and perspective into the organization, how do you get all the humans, the resistant Chris's that you're dealing with, to recognize that and to understand that you are pushing them up the stack and you are kind of supercharging them along the way?

24:03How do you get them to make that adjustment? Because that's not an easy one to make, speaking from experience. Yeah, it definitely isn't, right? And I've grown up through ranks. I started off in development as well. So I totally empathize with you. I understand. It is hard. It's a mindset shift. And people get nervous when the status quo or what they perceive as identity is questioned or shifted. And so this is one of those things, like all of a sudden you read so much of hype and hyperbole about, oh, you don't need people anymore. Like agents can do all these various things. One of the things that I do regularly, and I talk a lot about this, not only within our organization, but also externally, is I try to tell people that just because we feel that these agents and these AI systems are intelligent doesn't mean that they are.

25:00At the end of the day, they're just non-deterministic probabilistic models, right? They're giving the perception or the perceived approach of them being intelligent. But at the end of the day, all they're doing is they're doing particular things. They're evaluating the pros and cons, a risk reward function somewhere. and then they are executing the most optimal thing that has to be done. So it's not intelligent. It's just mathematical. So that's the first thing that I do educate. And I tell them that we have not come to the point where you have true artificial generative intelligence, right? Like AGI is like years and years away.

25:38And I don't even know if we're going to get there to that point. What we have as humans is the creativity. We understand the context and the intent of things. working with an agent. So let's say anyone is trying to spin up agentic AI using a hardness. They have all these instructions that they're putting in their, their MD file is like as massive as possible. It still does not understand the inherent context. It probably doesn't understand the entire environmental conditions and the situation and the intent and the goal. Maybe it understands what it's supposed to achieve, but it probably cannot connect all the various points.

26:16And this is where experience from humans comes in. This is where all the scars that we had when we had an incident and we had to be on a bridge and like, oh, shit, now I know this is a pattern and I can recognize it the next time something blows up. Those are things that these agentic AIs do not know. They're looking at it from a very theoretical way. So I relate that to someone who has a lot of book knowledge and trying to now be street smart. And that is not possible. and so while they can process and do things a lot we have the context we have the intent and it's very hard to explain it and the minute you increase the number of instructions or the conditions and all the various things to agents they start they start going crazy they start hallucinating because they don't know which one is really important and as humans we can evaluate conflicting pieces of information in real time and agents cannot at this time so So to people who are feeling really concerned, I really tell them, like, we are not at a point where we can do all this.

27:19We still think that we are giving agency and autonomy to Agentic AI, but we're doing it in small pieces. For me, trust is really important. And I currently, while I do work with Agentic AI day in and day out, they really need to build that trust and reputation for me. And I'm not there yet. and so having these conversations very openly with my teams and with other teams and telling them like we're not here to replace people we're here to make you all reduce the pain that you all are going through the manual friction and convert that into high value activities and improve your quality of life that's truly what we're trying to do and i think when you approach it from a humanistic way a lot of people will understand it and then you turn it around and say okay if you want to evolve.

28:08Here are the various things that you can do to help us on this journey. So that way you become much more valuable. For humans, the most important thing is to understand what's in it for them, right? Like at the end of the day, they do want to, every person, however, you know, altruistic or eudaimonic you are, you do want to have some self-worth. And as long as you can show that you're increasing the worth of the individual and making them more valuable, and it is in their best interest and it is not something from a corporation perspective, I think humans will understand this and come along into this exciting journey.

28:48Every week, our practical AI production calls jump from guests and ads to AI topics and scheduling. And I know this problem all too well. I'm taking notes when I should be listening. That afterwards, I'm piecing together what we decided and who's doing what. That's exactly where I'd put Granola to work. Granola is an AI-powered notebook that makes your meeting notes useful. It captures what happened in your meetings and turns it into clean, structured notes with decision and action items pulled out and made easy to find. For me, that's the appeal. More attention for the conversation, less time reconstructing it.

29:26I'd rather spend that energy making a better show. Once you try it on a first meeting, it's hard to go without. You can try it totally free. Head to granola.ai slash practicalai. That's granola.ai slash practicalai to get your time back. Go to granola.ai slash practicalai and try it on your next call. so tying together the kind of the process that you've described uh from invaluable and and you know where you're you're bringing people on this journey of of evolution of change and um and you know coming back to scotia bank and some of the the kind of the hands-on experience that you've had doing that process.

30:15Could you share maybe a particular task or effort that you and your team have tried to do where you have kind of brought people into this process, they understand how they fit in, it's not a threat, and they see the productivity that they are capable of with agents and sub-agents, and kind of just give us a glimpse of a real-life situation that you faced on that. Sure. So let me start with people aspect of things and then talk about some of the technologies. So I also lead the internship program for two business units here, and we have interns that are coming in. And these are extremely smart people from universities all across Canada.

31:04And then we have a couple from the United States as well. Now, all of these people, they ache to just use AI. They still use the word wipe coding, though I've told them to. I've told them they cannot ever use wipe coding as a word or a phrase within our premises, because what I really want is I don't want to have a developer, a coder anymore. What I want to have is a software engineer. And there's a lot of difference. And I actually walk them through the difference between wipe coding and enterprise software development. Very, very different beasts. So one of the things we've done completely is reboot the internship program and make it more like a startup.

31:47So bringing the Bay Area to Canada is what we're trying to do. So we create a team. It's a stable team. They have a business problem that they have to solve. It can be both external, so like actual customer-related kind of things, or it can be internal, like a workflow improvement or a process improvement. developer productivity kind of thing. So let me talk a little bit more about the developer productivity side. And it's very similar to that for the business side as well. So from a developer productivity standpoint, the thing is we want to improve the experience of the developer, right? Like DevEx is really, really important for us.

32:26But that starts from ideation. It doesn't start from just the development portion of things. Even today, there are a lot of organizations across the board. How much of our agile they claim they are, like a lot of them do end up being very waterfall when it comes to like requirements and design. And now with all these various tools, what we are trying to do is looking at ways by which we can rapidly prototype, get to like minimum viable product as quickly as possible. So we put these interns in this high-pressure situation. I have a tech lead and I have a design lead come in and help them. I have a product owner.

33:02And so now they're an actual team, a startup. They have to win money or get funding from the venture capital, which is me and a couple of other people, the executives. So there's a competition. They have to pitch and they have to convince us that this is one of the best things that they have to do. And every time they say they want to do all these various things, I ask the question, like, why do you need an agent for this? Why do you need AI? Like, tell me, tell me what is the value agentic AI is providing or generative AI is providing. And if they're like, well, because everyone else is doing it, then I'm like, okay, you're doing resume-driven development at this point.

33:41If you're not actually adding value and you can do something with AI and you can do something with automation, go for it. So we try to change their mindset and their thinking. And so with the developer experience, what we're doing is we're taking user stories, And these can be very, very non-deterministic ways of creating it. And you need a lot of context and intent. And then using those user stories, now converting it into design and rapid prototyping and iterating with the customer, whoever the customer may be, and getting to a semblance of what it could look like and then giving it to the software engineers.

34:18We're exploring, we're experimenting a lot with that. But that's something that's been very interesting. Like this is a traditional software development lifecycle. And one of the things I'm experimenting with is, should the software development lifecycle change with AI? Why are we going through the same steps? Why is it not looping multiple times with the feedback loops of continuous improvement rather than being like this sequential approach? Like, is there a better way to do it? Can we solve this problem with having like a swarm of agents working together and just stay talking and making it happen?

34:52Like, these are some things we're exploring right now, especially with developer experience and developer productivity. And yeah, I don't have the right data to say this is the way to do it, but we definitely are having a lot of fun. When you mentioned the swarming, that's a topic of keen interest to me. And I'm experimenting myself in those areas in terms of having a swarm with a bunch of adversarial roles to kind of keep everything honest, if you will. I'm not sure if that's the right word. But to your point about not vibe coding and trying to actually have to bring the tools in with the result being high quality enterprise architecture, as opposed to vibe coding, whatever the agent wanted to go at and having the human experience do that.

35:50Do you have, let's put you on the spot a little bit. Do you have any insights into that? I think the swarming experiment was a great one. And could you expand a little bit on that? Because I think one of the things we hear a lot from folks out there is, you know, there are a lot of people that are doing it just because everyone else is doing it. And I think benefiting from insights into how to discriminate a good opportunity versus just going with the flow would be really useful to people. Anything that you have to share along that lines? Sure. Sure. So I think this is a good example of where we have shifted the value line, right?

36:32So initially we thought development, but truly what we were thinking of is as humans, we want to be the system architects and have a really robust way to design systems from a systemic view perspective and then hand it over to other people to actually create it. I mean, that's truly what we are starting to do now. So we'll have a swarm of agents. I have, so at MCP Dev Summit recently, we actually shared five agentic AI patterns that we have consolidated and we've done a lot of experiments on and we've decided to do. So there are several patterns that we can use now with multi-agent systems, but swarms are not going to solve everything, right?

37:18Like there are very specific reasons why you want to use swarms. ideally you want to you want to try to mimic whatever we have so conway's law everyone talks about conway's law and you like look at the organization and the organizational structure and the software gets built that way but let's turn it around and say let's look at a collaborative team a high performing team you have people who perform various actions or wear or wear different hats to perform the tasks now convert that into the digital twins each one of them is their is a, so you have like a BA agent, a design agent, a testing agent, and all these various people.

37:59So now all of a sudden you have a balanced team that you're using to solve a particular problem and get it together. So as a human, you create the software design, all the specs, everything that is needed, like from a holistic perspective, and then you give it to the manager of that team and use like a magentic or an orchestrator pattern and say, all right, make this happen for me. And this is the outcome. This is what I need to do. And this is what I don't want it to happen. So you give positive and negative examples there. That team will go off and do it. It doesn't have to be a swarm. But now you can observe all of them starting to talk to each other.

38:36You have shared memory. You have all these various guardrails that you put in. And then you have like a recommendation jury or an evaluation jury that will then evaluate and say, okay, you're getting close to it or you're not getting close to it and helping them guide. It's very similar to how we work today. And I think starting to mimic that first will then help us get a much better understanding of how we want to move forward. And after that, if we have much more complex problems to divide and conquer, to our panel processing, all those things, then we can start looking at different technologies like swarms, or maybe you have different agile release strains.

39:12There's different patterns altogether depending on the problems. And these are not unique problems in this day and age. We've been solving this from the beginning of time. If you think about it, these are things that we've done. Anyone who goes shopping, let's say that you and your significant other need to go to two different stores. You're going to divide and conquer. You're going to have parallel processing. Go do it. We do it every day so subconsciously, but now we have to be very deliberate in our approach when it comes to agentic AI. I think Understanding that and realizing that this is not something new will fundamentally change how you approach these problems, in my mind.

39:58As we start winding up here, I'd really like to get your thoughts, insights, and maybe aspirations into where this is going to go. As you are leading a large enterprise in a major industry in banking to kind of into new territory here, you're truly trailblazing for the enterprise. Could you talk a little bit about where you would like to see things end up? you know there's there's so many organizations out there that are trying to navigate the same problems that you're already doing probably more successfully than a lot of folks out there and if you could kind of talk about where this is going where do you expect people to land both not only from the technology standpoint and the business standpoint but from the human standpoint as well I'd love to get your insight that's a deep one Chris let me try to see if I I can make some justice to it.

40:59I think as we start experimenting more and more with agentic AI, it's going to be inevitable for us to try to shoehorn AI into every single thing. We're already seeing it. But I think the most important question to ask is, do we really need AI, especially in this day and age? And organizations that will probably ask that question up front rather than have the FOMO effect and then just go and do. or just because it is shiny right now, we probably will not, those organizations may not succeed really well. It's those who really dig in deep and introspect and ask themselves, what is the value? Where are we going?

41:41That's the most important thing. And a lot of times the value is not just monetary. A lot of it is around the human. So centered around the human and the customer is probably what we already always need to ground ourselves in because at the end of the day, the reason why organizations exist is to generate or deliver value to someone. And the next thing is that the world is becoming extremely smaller. We are seeing like within seconds, we can transfer money anywhere. We can fly to other places. We can do all kinds of things. We need to really recognize that and see how we can reduce the amount of friction we are introducing into these kinds of global activities.

42:30Our goal is to deliver value globally as quickly as possible and to as many people or as many systems as possible. So you want to increase your global outreach. The third thing that we wanna do is, and this is me as a person talking, not just from a representative of an organization, I honestly believe that we, as people, we probably want to really ask ourselves, how are we giving back? How are we improving the quality of life of other people using technology? And I think that is going to be the biggest drivers. It's one of the things that is very fulfilling if you try it. Using technology to improve human quality of life is going to be the ultimate goal, I believe, and it's going to improve the happiness index across the world.

43:27And that's something I really, really am aspiring for and driving to. And the fact that I can take technology and help improve people's lives is what drives me day in and day out. That's a beautiful way to finish up right there. I definitely love that. Subscribe to that. And I think often it gets lost as people move forward. So I think that's a great way to leave folks. Galatham, thank you so much for joining today. A lot of great insights that you've shared. Looking forward as you continue your journey on this. Looking forward to having you back on the show in the future to share more insights as you continue developing this.

44:09Thank you so much. Thank you for having me, Chris. It was a great conversation. Thanks for having me.

44:19All right. That's our show for this week. If you haven't checked out our website, head to practicalai.fm and be sure to connect with us on LinkedIn, X, or Blue Sky. You'll see us posting insights related to the latest AI developments, and we would love for you to join the conversation. Thanks to our partner, Prediction Guard, for providing operational support for the show. Check them out at predictionguard.com. Also, thanks to Breakmaster Cylinder for the beats and to you for listening. That's all for now, but you'll hear from us again next week. Thank you.

From the publisher

How can enterprises adopt AI and agentic systems while keeping people, business value, and trust at the center?

Chris is joined by Dr. Gautham Pallapa, Principal Director of AI and Innovation at Scotiabank and author of Invaluable, to explore how organizations can approach AI-driven transformation. They discuss identifying meaningful opportunities for AI in highly regulated industries like banking, rethinking developer productivity, and using multi-agent systems to bring different roles and capabilities together.

Featuring: 

Links:

Sponsors:

  • Framer: The enterprise-grade website builder that lets your team ship faster. Get 30% off at framer.com/practicalai
  • Granola: An AI-powered notepad that makes your meeting notes useful. It captures what happens in your meetings and turns it into clean, structured notes with decisions and action items pulled out and made easy to find.  You can try it totally free—head to granola.ai/PRACTICALAI. 

Resources and Events:

Chris’s new book The Art of Swarming will be published soon, written to be the seminal foundational book for the fledgling swarming industry, defining the principles and architecture that enable autonomous agentic UxS swarms with emergent distributed embodied intelligence.  You can find out more at his website:  https://chrisbenson.com

More from Practical AI

All episodes