Should kids still learn to code?

0:05Welcome to Practical AI. If you work in artificial intelligence, aspire to, or are curious how AI-related tech is changing the world, this is the show for you. Thank you to our partners at Fly.io, the home of changelog.com. Fly transforms containers into micro VMs that run on their hardware in 30 plus regions on six continents. So you can launch your app near your users. Learn more at Fly.io.

0:42Welcome to another fully connected episode of the Practical AI Podcast. This is the episode in which Chris and I keep you fully connected with everything that's happening in the AI world. We'll hopefully talk through some of the news and also keep you up to date with some of the latest learning materials. I'm Daniel Whitenack. I am CEO and founder at Prediction Guard. And I'm joined as always by my co-host Chris Benson, who is a principal AI research engineer at Lockheed Martin. How are you doing, Chris? Doing well today, Daniel. How's it going? Oh, it's going great. My wife and I have been traveling a bit around the UK, which has been enjoyable other than the train delays and rain and wetness.

1:29I think today we saw all of the above of sunshine, rain, hail, snow, the full gamut of things. It's amazing how you can have so much weather in one little island. Exactly, exactly. They do it all. Variety. Just go a few miles and it changes. Yeah, yeah, variety. Well, there have definitely been a good variety also of interesting AI things happening, as there always are. One of the things that was kind of interesting to me, which was circulating around my feeds was NVIDIA generally because they had their GTC. I always want to say GTX, but I think that's the card. GTC event, which is their kind of innovation, a yearly conference sort of thing.

2:19But Jensen, the CEO, was making some comments. I don't know if it was actually at the event or in another venue, but making some comments about kids learning to code. And his comment was related to, I forget how he phrased it, but basically the gist being kids shouldn't learn to code anymore because AI is going to do that fairly well. So I don't know. I don't have kids, Chris, but what is your thought as a parent? As the designated father on this podcast? on this podcast. Well, I think he's right in the long run. I think he mentioned that in the keynote, there was a little section where he covered that.

3:02And he said, always in the past, we've taught our kids they need to code, you know, in recent years. And he said, now AI is changing all that. And I don't think that's news to anybody in the larger sense. You know, we use AI for coding and technical controls and all sorts of stuff all the time. And that's just built into our ecosystem over the last few years and is increasing constantly. I have to admit, that he was kind of like, we're at the moment, you know, it's, and I'm not quoting him, but, you know, he was kind of like, this is the moment we're not teaching him anymore. And I'm kind of like, maybe, maybe, because I know that even with, with us as adopters of AI technology, you know, for coding all the time.

3:39I mean, if there's anything that we do, it's, it has to do with that. And there's all sorts of complexities and bumps in the road and things like that. So in the large, is it moving that way? Of course, I think everybody would agree with that. Um, But I don't think that we've all just arrived there because Jensen just said it in a keynote personally. I have great respect. I don't mean to be negative. It was like flipping a light switch, kind of the way he put it. And I think it's a very, very slow flip with lots of nuance. I guess one way to rephrase the question would be, at this moment, were you to have a child going into college, let's say, would you encourage them to pursue software engineering?

4:22or computer science or this sort of thing? I would. I think that in the future, and actually I've spent a lot of time thinking about this topic in general, hundreds and hundreds of hours. And this is one of those things where I think we're accelerating into the future. And I think with AI capabilities year by year, making massive changes to how we live and work, humans are gonna have to be fairly dynamic in how they do things. And one of those skills continues to be various technology, you know, orientations. And I don't think that's going away anytime soon, though AI will continue to change where those boundaries are.

5:01So in the spirit of we're always going to have to learn new things anyway, I don't see any problem in diving into technology and coding today with the recognition that the technology will constantly change underfoot and you're going to have to change with it. So I don't think I would recommend. And actually, I do for Georgia State University. I'm one of their advisors in industry for their computer science school. And I would not dissuade any of those students from pursuing a computer science curriculum at this time. They just need to be dynamic enough to change over the years. Yeah. And maybe part of it is also these tasks that like if you go to a three week boot camp on front end engineering or something like that, Probably many of the things that you would learn in such a boot camp, even though I think there will be a need for front end engineers for some time.

5:58also. I think that's true. But that sort of basic level that you would get is maybe at the level where it's going to be more and more cookie cutter sort of things that an AI system is going to be able to do with guided by the hand of maybe a less technical person, like a designer rather than a front end engineer. Right. But sure. I run an AI company and we really need software engineering and programming. So I think at the minimum, all of these AI systems that are coming about are going to need people to build them and maintain them and infrastructure that operates well and scales. Systems are still going to have to scale and people are going to have to worry about distributed systems and all of these sorts of things that are really hard engineering problems from my perspective.

6:51I agree. The human algorithm partnership is going to go a long way for many years, but it will change all the time. But that's not limited to our fields here. This is something that all industries are going to be facing is that constant change on what the partnership looks like. So I'm not inclined, unless somebody sees an area where AI is in the next very few years going to completely take over all human activities in it. I don't see any reason to avoid these things. I think we're in a perpetual learning mode going forward. Yeah, I've actually been thinking about this sort of dynamic a little bit after we've had a couple of guests on the show that are working on these systems like prompt layer and other ones where they're managing prompts and reasoning workflows at the intersection of domain experts and software engineers.

7:49So the technical side, kind of where software meets domain expertise. I was on a panel at Purdue University speaking of students and that sort of thing. And one of the questions was around this, you know, well, hey, I went into this program thinking maybe I would try to become a data scientist. Is that still a thing or should I be thinking about something else? I think one encouraging thing for people is if you're a data person, no one really has more than a year of experience architecting and building these type of generative AI systems. So in a sense, you could do one really compelling project and be ahead of most of the people trying to get these jobs.

8:34So in one respect, that's really encouraging. I think it is shifting, though, what a data scientist means. And this coming from a data scientist that has been a data scientist for 10 plus years. I think there is this kind of hollowing out of the middle where you had the three things where on one side you had software engineering and infrastructure, and that was the land of sort of software engineers and DevOps and all that. And on the other side, you had domain experts. And in the middle, you had data scientists who kind of translated the domain expertise into predictive models and machine learning and such, that then got handed off on the other side to integrate into software.

9:15And I think what you see is kind of this hollowing out of that middle where domain experts are getting much closer to the software side. And so I think there's kind of two maybe takeaways from that from my perspective. Either you could go into the AI engineering side, which is maybe less hardcore infrastructure, low-level programming, and more almost narrative writing of prompts and creating of these reasoning chains and all of that sort of thing and become amazingly good at that and rely on good software and infrastructure people on the other side. or there's still going to be a need because everything is still software.

10:01There's still going to be a really heavy need for people that can make your chains of reasoning and hosted models and software deployments actually go well. Totally agree. And you said one thing in there as well that really, really resonated with me. You said several things that did. But one thing that jumped out that I'd like to reiterate is the notion that if you do that one big project, you're really out in front again. It's one of those things where because it changes so fast right now from month to month that it doesn't take much to do the new thing that's just coming out. And the people that might have had many years of experience in the title haven't had experience in this new thing.

10:46And that keeps on happening. And so the notion of being a title, whatever your title is, for X number of years is really losing a lot of meaning in that. And that you might have been in the space, but with the space increasingly evolving, you can kind of catch up into modern experience pretty quick. So people are very worried about jobs in this space, but that's a little bit of a way where you can be super competitive and jump up in the area of your interest by leaping into the front and disregarding the traditional metrics that we tend to use on that.

11:32if you're anything like me you have a certain tendency to put things off until the very last minute seeing the dentist going to the doctor home improvements that never ending chore list of yours. And while most of the time it works out just fine, the one thing in life that you really cannot afford to wait on is setting up term coverage life insurance. You've probably seen life insurance commercials on TV and thought, yeah, I'll look into that later. No, later doesn't come. This really isn't something you can wait on. Choose life insurance through a ladder today. Here's what we love about ladder and why we allow them as a sponsor.

12:11They are 100 % digital, No doctors, no needles, no paperwork when you apply for$3 million in coverage or less. Just answer a few questions about your health in an application. Ladder's customers rate them 4.8 out of 5 stars on Trustpilot. And they made Forbes Best Life Insurance 2021 list. You just need a few minutes and a phone or laptop to apply. Ladder's smart algorithm works in real time, so you'll find out if you're instantly approved. No hidden fees. You can came to any time. Get a full refund if you change your mind in the first 30 days. Ladder policies are issued by insurers with long proven histories of paying claims.

12:50They're rated A and A plus by A.M. Best. Finally, since life insurance costs more as you age now. Yeah, right now. Now's the time to cross it off your list. So go to ladderlife.com slash practical A.I. today to see if you're instantly approved. Again, that's ladder.com slash practical AI, L-A-D-D-E-R, life.com slash practical AI.

13:39Well, Chris, as people are diving into their first projects and areas of interest and new things in the field, one of the interesting things and kind of learning resources that we don't maybe spend a ton of time talking about, although we are actively engaged in it, is community around the AI space. and where people can connect with that sort of community. We've produced a lot of content, but we've also engaged in various spheres over the years. And there might be a lot of new people, let's say they're web developers or they're backend engineers or whatever, and they're getting into the space, they're doing projects and their kind of normal programming conference isn't, or maybe has some AI topics, but they're wondering, is there a better place to find people that are doing these sorts of projects and that sort of thing?

14:43I know you were at one point involved in kind of the meetup space, although COVID maybe had a little bit to do with the downgrade of some of those communities. Yeah, it's a great point. And it's evolved in interesting ways, kind of what you're getting at there. And to start with the last thing that you said, I was, for a number of years, I ran the Atlanta deep learning meetup. And the phrase deep learning is kind of antiquated now as well in the learning. And it kind of fell off when COVID hit. But we were really the preeminent kind of AI-oriented community in the Atlanta area, which is where I'm at.

15:18It's interesting as another counterpoint to go into this, you and I met in a different community. We met in the Go language community because we were both Go programmers. And we were kind of the two people thinking a lot about AI and data science in that community. So it was a natural thing for us to gravitate together. But interestingly, if you're really focused on different aspects of AI, whether it be generative AI or other fields of AI, since we've recently pointed out that not all things are just generative AI, even though that's the hot thing right now, there are many vendor-specific communities.

15:54We have a podcast-specific community here where we engage our listeners all the time, and there are some platform-specific communities. But there's kind of a, like, where we met in the Go community, there was an overall, whatever you were doing in the Go space, there was a larger community, and you kind of knew all the people and all the names that were there and would follow that and be participant in it. Here, we don't really have that. We have many, many fragmented AI communities and we'll go to a hugging face for us, you know, to get open source models and to see what's going on there. And, you know, there are lots of these smaller communities, but I would imagine if you're coming into the space today and you're one of those people who really want to dive into AI here in 2024, it must be very hard to figure out what space you should be in to make all the connections and to ramp up.

16:46Any thoughts on that? What would you recommend to somebody, Daniel, if somebody were to come into the space today? Yeah, it is a bit of a challenge because it is a bit fragmented. And maybe we could split this up into a couple of kinds of engagement, maybe one from a more technical side and one from a less technical side. So in terms of architecting and building generative AI apps or other kind of AI apps or fine-tuning models and that sort of thing. I think what I would generally recommend is starting out with some sort of learning resource that is probably going to be on Hugging Face, Langchain, Llama Index, LanceDB, one of the other vector database providers.

17:39These sorts of projects have really good tutorials and guides associated with them. Starting out more project related, like those are trusted projects in the AI space and trusted platforms in the AI space. And then looking at one of those projects, like let's say you go and you find a guide that is setting up multimodal rag system to search over videos or images with Llama Index or something like that, right? Well, a lot of these projects, not all of them, but a lot of them have some type of forum or chat kind of interface that the community around those projects gathers in. So oftentimes it's either discord or slack or a forum type of thing so i think if you start kind of in those spaces like a llama index or a lance db and look at a guide that is something similar to what you want to build you try going through the guide but you also look to see if those projects have a discord associated with them or a Slack channel associated with them and go ahead and log into those.

19:06And, you know, it's OK to lurk for a while. But as you're going through your example and, you know, you don't understand this or you're getting that error, just go ahead and be brave and put something in those spaces. I've generally found them to be fairly welcoming. For example, if you go to Llama Index, there's a community page and you'll see right away join Discord. There's many other of these spaces. So like our friends over at the Latent Space podcast have a very, very active Discord server that they're running. We have a Slack channel associated with this podcast, but there's other projects like Lance DB has a Discord channel.

19:46And these are generally people that are building projects within this sort of space, within this sort of topic. and they're generally open to, hey, I might not only be using Llama Index, but I could ask a question about choices of vector databases or choices of models. And everyone in there is kind of working in this space and may have biased or opinionated thoughts on that, but you gradually kind of learn and meet people in that way. So I think in some ways, it's a little bit more project related than kind of overall community related. And Hugging Face is a great community in the sense of GitHub being a community, but it's not where people are having all of these different conversations about specific projects and guides and that sort of thing.

20:38They're collaborating on models and data sets and that sort of thing, but maybe not in a kind of asynchronous chat sort of way. So what do you think about the social element? Because there's some great guidance there on learning and kind of connecting on a project basis and stuff. But where would you go for the personalities, for the friendships that you develop? How would you approach that, Daniel? Yeah, it might depend on people's personality and what opportunities kind of present themselves to those people. There are a good number of events that are gradually happening. Like our friends over at the MLOps community have had a series of online virtual events.

21:23I know there was an AI engineering event out on the West Coast. There are events like Hugging Face, I think, is doing some type of Hugging Face tour with demos at various locations in person. So that's a really great place to kind of meet face to face with people and interact and build relationships. in terms of personalities and that sort of thing. One thing you could do is look at our previous episodes of this podcast and go. And even if you don't listen to all the episodes, which of course you should because they're all great or maybe some are better than others, but they're all pretty good, I think.

22:04But you could look at the guests from the previous podcast and go to LinkedIn, go to Twitter, go to Blue Sky, whatever your favorite social is, and see if you can find some of those people on those platforms. And those are trusted people that we've met over the years. And so in an online sense, you can start following them and see who they are kind of reposting and interacting with online. And that's kind of how your web of connections can form a little bit. So I want to turn from the community questions that we were just talking about and spread it out. The community notion that we were just discussing was really focused on those of us who are embedded in AI work.

22:50We probably do it for a living. This is kind of very central to us, but there is most of the world out there that does not fall into that category. And yet, AI is still impacting their lives in tremendous ways increasingly. And one of the things that I have been keenly interested in lately is for the rest of the 99 % out there that are not building their professional lives on AI in every moment the way we are, they still need some entrances into how to use this in a productive way. We are getting on the podcast and with our audience and the listeners talking about Gemini and ChatGPT all the time.

23:31And there are these other 99%, they're hearing this too in the news, but they don't really understand it. They're probably not using it. They might've tested out one of the free interfaces here or there to see what it was like, but it's not part of their workflow. Right now we're seeing a period in 2024 where organizations are starting to explore and even demand that their employees start using these tools. They're making them available, but they're really struggling with adoption. I've run across all sorts of issues where hitting mainstream adoption with generative AI tools has been a tremendous challenge.

24:09And so I'd like to dive into that for a couple of moments and kind of talk it over where we're going, because that's certainly, I know the organization I'm part of is interested in this topic. And I talk to people every day that are trying to figure out how do we get it out there beyond our software developers and our data scientists. What are your, any thoughts you have there in terms of if you have your typical non-technical worker they're a knowledge worker and they have a set of tasks every day how do you start to break that nut in terms of getting those people recognizing where some of these generative ai tools can help them do their own i have a couple of examples i'll go to in a moment but i'm curious what you've seen out there, Daniel?

24:51Yeah, I think there's one side of it, which is maybe places for those people to start, but also an interesting piece of this is a mechanism for how that knowledge trickles into an organization, which I think is an interesting topic in and of itself. One pattern that I've seen a little bit at organizations is maybe a couple of champions that are higher up on the ladder that see the vision of transformation and see that this is going to be a transformative technology for their organization. And those leaders might take some type of courses or certification or crash course type of thing in the topic.

25:37So MIT has some kind of AI for digital transformation or AI, generative AI related things for non-technical people that they offer online. And I I think maybe some even live. NVIDIA has some courses like what is generative AI, generative AI explained. NVIDIA has some of those types of things. So there might be these leaders who see the vision for how this is going to be a transformative technology. They might do one of those things to understand at a level that makes them comfortable. And I think part of the trickle down is leading by example in that. So when they're having interactions with their team and or other teams, I think it can literally be, you know, something comes up in a meeting and you're sharing your screen and you literally you just have a tab open that is chat GPT or Claude or Gemini or whatever.

26:36And you go over there and you literally just you answer a question or you get something done immediately because you know how to interact with those tools to do something quickly. And that can be a light bulb moment for other people where they see a person leading by example, using a tool and not like, here's how you use this tool sort of way, but really in the flow of how they're doing their own work. And I think that seeps through. That's really impactful because it shows, oh, this person who is maybe influential in my organization is operating in this way and able to do these cool things with these tools.

27:17Can I do that? I think some of it can also be a little bit directed where you're having your one-on-ones maybe with your direct reports, right? And they're asking questions that they should be able to source the answer to or accomplish very quickly with these tools. And you can tell them, hey, you know, there's a pretty quick way that you can get this summary or develop this outline for your presentation out of this article. Let me show you how to do that. and actually have them go to the site, generate the outline for the presentation based on some article or something and actually do that in your one-on-ones, even to the point of encouraging people like, hey, you should maybe just have this bookmarked or have it up on your tab.

28:05So I think that's kind of how some of that trickle down could happen and how I've seen it happening is kind of a foothold in these influential people within an organization. and then leading by example and kind of in a one-on-one sort of way rather than a top-down directive of we shall now do things this way, right? Understood. I actually have an example to illustrate one of the things that you were talking about there. In my own employment, we have both access to ChatGPT and we also host internal models, internal open source models, which we love because that way you don't have to worry about if you're sending proprietary information out, things like that.

28:47And so this morning in my day job, I was working with a team of people. There's a presentation that has to come out of that, a PowerPoint presentation that has to come out as one of the deliverables of that. And as we were having a group discussion, sharing screen, was able to type in some of the things that we wanted to talk about into the model, generated dynamically while we were on a group call. I generated a set of talking points to the various issues that we were addressing. Basically, kind of a presentation within the prompts, if you will, was then able to turn that presentation into VBA code, Visual Basic for Applications code, where it embedded the content in that VBA code.

29:33Then I was able to open up PowerPoint right there, copy and paste out of the prompt. This is totally non-technical, what we're talking about here. Go to the tools tab, down to macros and open the visual basic editor in PowerPoint, which is available to everybody. Pasted in the code as a new module and ran it. And it produced our PowerPoint for our team right there. The whole thing took five minutes to get a 30 page PowerPoint set up. Now, there was a lot of manual tweaking to be done afterwards and adding some graphics and stuff like that. But we probably cut, you know, five, eight hours worth of work out of our workflow by tossing the critical ideas into the prompt, turning them into that code and copying and pasting it.

30:15Doesn't take a developer to do that, that anybody could do that. So that's one of many possible use cases where you're using it. You haven't replaced any of the workers, but you're accelerating everybody's productivity dramatically at that point and saving a lot of time to do it. So as I've been thinking about how we get more people in the world to use these technologies to their benefit, I think having a number of different kind of typical persona, you know, use cases like that, that many people might need. So there's your PowerPoint strategy, folks, is, you know, right now in whatever job you're in, you can do that if you have access to one of these larger models.