AI in 2025: From Agents to Factories - Ep. 282

0:10Hello, and welcome to the NVIDIA AI Podcast. I'm your host, Noah Kravitz. Today we're looking back on the year in AI 2025. But before we begin, if you're enjoying the AI podcast, please take a moment to follow us on Apple, Spotify, or wherever you're listening. Thanks.

0:31Our year began with NVIDIA's Mingyu Liu talking about the importance of world foundation models to advancing physical AI in Episode 240. 40 conversations later, Jacob Lieberman introduced us to the future of enterprise storage, AI data platforms, in episode 281. Along the way were advances in AI models and the infrastructure that they run on, like the rise of agentic AI and the AI factory. We heard firsthand from pioneers in healthcare, higher education, life sciences, marketing, and other industries about how they're using AI to advance their fields and make work better for the people doing it.

1:07And we talk to everyone, from researchers to roboticists, about the dawn of physical AI, where intelligence moves from our screens into the robots building our cars, assisting our surgeons, and walking among us. 2025 was quite the ride. Let's dive in. This year in AI began as last year ended, with lots of talk about agents and agentic AI. So what exactly is an AI agent? An evolution in the way people use generative AI, Agentec AI is a move away from simple call-and-response-style chatbots towards systems that have true agency.

1:47Chris Covert from InWorld AI breaks this evolution down into phases in episode 243, moving from simple conversation to an adaptive partner and finally, full autonomy. me. We have this, you know, first, again, is that conversational AI phase. And I'll use a gaming analogy, right? The conversational AI phase gives avatars, gives agents, I'll use them interchangeably today, extremely little agency in doing anything other than speaking, right? It may be able to respond to my input if I ask it to do something, but it's not going to physically change the state of something other than the dialogue it's going to tell me back.

2:20It is an adaptive partner phase where the AI is observing and responding to changes on its own. It's not micromanaging every decision, but it feels like you're collaborating with an agent or a unit that has just enough context to make smart decisions on its own. Like an evolution of a recommendation engine being driven by a cognition engine here. So it's not just learning, but it feels like it's learning what we need even before we ask it. Again, I think that's phase three. I think there's still a phase four. And I think that's a fully autonomous agent. And that stage, you know, again, continuing our analogy, is a player two, right?

2:57Where player three is it's adapting to us, stage four is, hey, this thing is an agent all on its own. It feels like I'm playing against another human. It is making decisions that feel optimal to its own objectives, alike to mine or not. The immediate payoff of this capability is freeing human workers from repetitive, error-prone, non-creative tasks, what we often refer to as toil. But here's the key. We don't need the agents to be perfect to be valuable. In fact, we don't even need them to do all of the work for us, as NVIDIA's Bartley Richardson points out in episode 258. If it gets you 75, 80 % of the way there, that's fantastic.

3:33That's great. Because what's, you know, I'm sure, you know, you do your fair share of writing, right? Like the hardest part for me about writing is that blank page. That blank page, totally. Right? And if I can get something that's 80 % of the way there, it's great. AI runs on data, and agentic AI is no different. Which is good, considering the sheer velocity of information creation in today's enterprise. Data growth is creating a widening gap between the data we have and the insights we can actually extract. Cytoreason's Shai Shen Orr describes this challenge in The Life Sciences, in episode 276, comparing the struggle to keep up with data growth to the Red Queen effect from Alice in Wonderland.

4:12You can think about it like data is exponential, insight is linear. Everyday percent data utilized to give insight is lower. The analytical side of this and the AI solutions for this have been missing. The field is still largely a manual field where you give people some data, they sit in front of their computer, they try to figure out, they make some value and insight for this. And I figured that's not a sustainable solution. This field needs to move to ultimately build much larger integrative solutions that bring in many different angles of machine learning, AI statistics, and so forth to ultimately bridge this.

4:53The data inside gap keeps growing. So you basically are constantly in a game in which you need to make it faster. It's actually what's called an evolution. And then you remember Alice in Wonderland, the Red Queen? Sure. Right. Where she said to Alice, you have to run just to stay in place. But the red green effect, so this need for us to continuously run is a huge driver for automation, acceleration, and I would even say the cognitive meta-analysis that we as humans need to do to somehow describe to a machine how we make decisions so that we can automate them. Right. To handle this exponential growth, we need massive compute resources.

5:35AI factories provide the infrastructure to support enterprise-scale systems. But traditional ways of approaching storage had a major flaw, data gravity. The data was heavy, and moving it created security risks. Here's NVIDIA's Jacob Lieberman in episode 281. So far, in order to do AI, you've had to send your data out to some kind of AI factory with a GPU, do all your processing, and copy it back. Right. So the data has gravity, and it turns out that instead of sending all your data to the GPU, you can actually send your GPU to the data. And what that looks like is actually putting a GPU into your traditional storage system on that same storage network and letting it operate on the data in place where it lives without copying it out.

6:21And the advantage of generating these AI representations with the source of truth data is that if the source of truth changes, you can immediately propagate those changes to the representations. The new version reverses this. Instead of shipping data out, we bring the GPU compute to the data. This evolves the AI factory from a distant processing plant into a unified, efficient pipeline. Sarah Laszlo from Visa explains what this modern factory approach looks like in episode 256. What that means to me is a single pipeline that goes from a data scientist with an idea about a model they want to build all the way to the model running in production.

7:03It's interesting because I hadn't really thought much about this AI factory terminology like I had heard it. But I hadn't really thought it was what I was doing until I came here to GTC and I started hearing other people talking about it. And then I realized, oh, that's what my platform does. So my platform, recently we've adopted what we call the Ray Everywhere strategy. So we use AnyScale's Ray ecosystem to do the whole thing, the whole shebang. So data conditioning, model training, and model serving, we do all in Ray. And it is intentionally trying to be more of this factory concept where there's not a whole bunch of distinct parts or distinct tools that are living in different places that work differently.

7:46It's just one unified, consistent pipeline from start to finish. This shift isn't just about efficiency. It is critical for data sovereignty. Countries and companies need to ensure their sensitive intelligence stays in their buildings and on their own soil. In episode 247, Karen Hilson from Norwegian telecom operator Telenor explains why they built a sovereign AI factory in Oslo. So like Hive Autonomy, for example, I mean, they work with logistics, robotics. So they are actually innovating, I say, a lot of industries, whether it's ports, as I said, sort of factories or this sort of in their operations and have efficiency cases.

8:28So they have very specific customer needs that they are trying to solve. But they are the reason sort of why they were very interested in coming to the air factory is that they're sitting with sensitive data. So it was very keen. They wanted it to be really on Norwegian soil. The Telenor brand sort of represents security, you know, so there's sort of a gain that really helps them. And then the sustainability part is super key. So that was sort of the combination of these three. Capgemini is also a customer of ours. They are developing products of doing voice-to-voice translation. And we can say, yes, that can be done, but these are for sensitive dialogues.

9:09Not all dialogues can go out in the cloud somewhere. These are very sort of sensitive dialogues, if you think, you know, within the health sector, within the police. So not so much on program, but again, it's sort of a safe, secure environment. And that's sort of really key. And another customer is working a lot with the municipalities in Norway. And again, with sort of sensitive cases that they sort of really would like their data to be secured. To build trust in these factories, openness is essential. Jonathan Cohen from NVIDIA explains in episode 278 how open models, like NVIDIA's Nemotron family, allow for the customization required by sovereign projects.

9:53If you say, you know, NVIDIA trains a model, a Nemotron model, and it's great. But since you've disclosed all your training data and looked at your training data, for whatever reason, we have some policies where this data we can't use. And we can say, that's fine. Everything you need to reproduce what we did is there. You can train your own model. excluding that data. Or you say, well, I like the data, but the mix is wrong. I don't know. I'm a sovereign project, and it really needs to be very good at speaking this language and understanding this culture. And that data wasn't as represented in your training set as I want it to be.

10:23Everything that we did is transparent, and so you can make these modifications yourself. Since our first episode back in 2016, the AI podcast has told stories about the real-world impact of artificial intelligence. 2025 was no different. A big area of impact this year was, once again, in healthcare, where AI is helping with everything from drug discovery to reducing physician burnout. Here's Anne Osdwat of Moon Surgical from episode 272, explaining how their maestro system supports surgeons. Physician fatigue is absolutely real. You know, it's We did our first inhuman study in Brussels in Belgium with a surgeon and he used the system over 50 cases.

11:04And he told us after a few weeks, hey, when I get back home in the evening, my wife tells me that I'm, you know, a lot nicer than before. So like, what's going on? And, you know, I mean, he attributed that just to his own fatigue level, right? He's like, you know, I end my day in a way that is a lot more relaxed. It's about both the physical and the mental load. With AI and healthcare, safety is the number one priority. Hippocratic AI has tackled this by building a constellation architecture, using multiple AI models that constantly double-check each other. CEO Moonjal Shah describes how it works in episode 262.

11:45We literally have multiple models double-checking each other. And what people don't realize is that a lot of the models now, they say you can give a lot of input tokens to them now. Just put it all in there. It'll figure it out. And Gemini is like, what, a million? I think it is now, a million tokens. So it's like, oh, okay, no problem. But he can't reason across it all. They'll show you examples of what we call needle in haystacks, where it'll be like, okay, it'll find that one thing. Yeah, I mean, grepping for a word is not that hard in computer science. It's like, we can find a word. But what you're really trying to do is reason across it.

12:21So I'll give an example. If you ask your care manager, can I have ibuprofen? And they say, sure, you can have ibuprofen, but don't take too much. That's fine, right? Because it's an over-the-counter medication. Unless you have chronic kidney disease stage three or four, then it'll kill you. Right. Well, if you put the rules for ibuprofen and CKD into GPT-4 and then ask it, it'll do great. If you put in all the rules for all condition-specific over-the-counter medications and ask, it'll still do pretty good. start missing some sometimes, which is still okay because you could kill people, but fine.

12:54Have you put in the patient's medical history, the patient's last 10 conversations with you, all of those rules for over-the-counter medication disallowance and the current checklist for what you're supposed to follow with that patient and maybe a few other things and then ask it? Yeah. Good luck. And what it is, is we have an attention span problem. But if you have multiple models, we have these other models only focused on checking one thing at a time. So there's an overdose engine and it listens to every turn of the conversation. It's like, are we talking about drugs? Are we talking about drugs?

13:24Yes, we're talking about drugs. Okay. And then it's like, well, okay, did somebody just say a number that's an overdose relative to their prescription or relative to max toxicity of what you can have of that drug? Okay, he did. And it may not seem that hard, four pills versus two pills, but when you're talking about creams and injectables, it gets quite hard. I took a whole bunch of my testosterone cream even I rubbed it on my hand. Was that an overdose? Right. I don't know. How much cream was in your hand? Right. What's a little bit? What's a little bit? Was it a pea size? Was it a cherry tomato size?

13:53Was it an apple size? RLM knows how to ask all these questions and knows how to navigate assessing whether it's actually an overdose. And you cannot have, if a patient shares an overdose information with a care manager in a clinical setting, you need to do something. AI is also changing healthcare from a totally different angle by transforming agriculture. Paul Mikesell of Carbon Robotics explains in episode 270 why his company's approach to weed control swaps chemical herbicides for AI-guided lasers. I've also learned a lot about the quality of our food system, and I know that there's lots of discussion about this now.

14:30We are becoming more aware of it, that different herbicides are being banned in Europe, United States, etc. We are learning about more of the long-term negative health effects. again the ones who really suffer from it over the lifetime is the farmers who get exposed to this stuff in much higher doses than the consumer but even the consumer you know even you right now are participating in some form of a multi-decade maybe multi-generational science experiment we all have glyphosate in our system at any and so if you were if you take everybody listening to this uh podcast right now if we all went and did a urine sample you would find about 90 percent of us would have glyphosate in our system right now.

15:13What's glyphosate? It's the active ingredient in Roundup. We know that it's carcinogenic. Like any carcinogen, it's only a question of exposure over time. So we should be able to, with the kinds of technology that are available today, with the things that AI can do, we should be able to take a step back and say, do we really need to be spraying this stuff on our food in order to grow it and survive as a population? My answer to that question, I think, is no, we don't need to do that. And we should be able to do things like laser reader. Yeah. Beyond the healthcare benefits, carbon robotics robots help farmers operate more efficiently and sustainably.

15:51And they look really cool, too. Speaking of cool, in the world of marketing and media, agents are fundamentally changing the relationship between brands and consumers. First Hands John Heller joined episode 242 to describe a shift where AI agents curate the web specifically for the user's intent. I've been working in the gaming world and some of the generative AI abilities for gaming assets when language models really and something struck us, something very powerful, which is, and this is a metaphor for the math inside, but AI now understands the ideas and intents, needs you may have from what you're reading, what you're watching, what you might ask it outright.

16:36And it can go find the right response or take the right responding action. And everything is presented to you in a very natural human way. And if you back up a step and think of that happening all the way through a consumer's use of the digital world from when they're searching and becoming aware of things they might need, when they do some investigation and read up on products or services, when they go to a browser shop, when they buy, all of those modes change pretty fundamentally. They don't replace. We think they get enhanced because instead of the world of the past, where I maybe did a search, got some directions and a link, went to a place, read up on something, browsed for something, went to, saw an ad maybe, went to another place to try to find the version I want.

17:21Those are all sort of separate hops. The internet where it's the same content everybody sees. AI instead is going to understand and learn at each moment what it is you need. And as with most things, AI data is the core. The people who have the most and best data about a product or service are the brands. They are the retailers, the people who sell it. So they can create brand agents, which means your experience on the internet at all of those moments in the journey, from first learning about it to figuring out what the right configuration is and comparing and browsing and buying, is going to adapt on the fly through these agents.

18:02So it doesn't replace the web, but it changes things from you looking at stuff someone wrote to something that's partially adapting to what you actually need, understanding your needs. But the agents that are doing that for you are from the retailers and brands themselves because it's their data that is what you need. And that sort of changes the internet into kind of your internet for both parties. While software agents are transforming the digital world, a massive shift is happening in the physical world as well. This is the dawn of physical AI, where AI models don't just generate text or images.

18:36They control things that move, like the aforementioned farm machinery. According to Sonia Fidler, VP of AI Research at NVIDIA, the scale of this opportunity is staggering. Here's Sonia in episode 249. At the end of the day, robots need to operate in the physical world, in our world. And this world is three-dimensional and conforms to the laws of physics. And there's humans inside that we need to interact with. We typically hear the term such AI that operates in a real physical world as physical AI. So I'll maybe use that term quite a lot. Physical AI is really kind of the upcoming big industry.

19:18Very likely larger than generative and agentic AI. You know, Jensen typically says everything that moves, all devices that move will be autonomous. Right. So that's kind of the vision. So a robot to operate in the real world obviously needs to understand the world. What am I seeing? What is everything I'm seeing, doing? How is it going to react to my action? Right. So understanding it needs to act. But there is a catch. You can't train a physical robot the same way you train a chatbot. If a chatbot makes a mistake, you might get a typo. If a robot makes a mistake, it'll probably break something.

19:56To solve this, researchers like Mingyu Liu are building World Foundation models, AI that understands physics and space-time, allowing robots to simulate thousands of futures before they take a single step in reality, as Mingyu explains in episode 240. So I think World Foundation models is important to physical AI developers. You know, physical AI are systems with AI deployed in the real world, right? And different to digital AI, these physical AI systems that interact with the environment can create damage, right? So this could be real harm, right? Right, right. So a physical AI system might be controlling a robotic arm or some other piece of equipment changing the physical world.

20:41Yeah, I think there are three major use cases for physical AI. It's all around simulation. The first one is, when you train a physical eye system, you train a deep learning model, you have a thousand checkpoints. Do you know which one you want to deploy? And if you deploy individually, it's going to be very time-consuming. And so then it's bad. It's going to damage your kitchen. So with a wall model, you can do verification in the simulation. So you can quickly test out this policy in many, many different kitchens. and before, you know, you deploy in the real kitchen. And after this verification step, you may be narrowed down to three chip points, and then you do the real deployments.

21:27So, you know, you can have an easier life to deploy your physical AI. Once these brains are trained safely in digital worlds, they need bodies. And while we may see many form factors in factories, there is a massive surge in humanoid robotics going on outside those factory walls. Yashraj Narang from NVIDIA's Seattle Robotics Lab explains in episode 274 how this isn't just an aesthetic choice. It's a practical requirement for robots that need to work alongside us. You know, there's a group of people, you know, forward-thinking people, Jensen very much included, this is near and dear to his heart, that felt that time is right for this dream of humanoid robotics to finally be realized, right?

22:08You know, let's actually go for it. And, you know, this begs the question of why humanoids at all? Why have people been so interested in humanoids? Why do people believe in humanoids? And I think that the most common answer you'll get to this, which I believe makes a lot of sense, is that the world has been designed for humans. You know, we have built everything for us, for our form factors, for our hands. And if we want robots to operate alongside us in places that we go to every day, you know, in our home, in the office and so on, we want these robots to have our form. And in doing so, they can do a lot of things, ideally, that we can.

22:49You know, we can go up and down stairs that were really built for the dimensions of our legs. We can open and close doors that are located at a certain height and have a certain geometry because they're easy for us to grab. Humanoids could manipulate tools like hammers and scissors and screwdrivers and pipettes if you're in a lab. These sorts of things, which were built for our hands. As AI moves from the screen to the physical world, it is also fundamentally changing our creative and professional lives. In episode 265, Canva's Danny Wu talks about AI and creative superpowers. You kind of see like the magic of Canva is integrating all the different steps and different parts of design into a simple page, as I like to call it.

23:34And so we really invested in our content library, in millions of templates that make it easier to start. And what we saw and got really excited about AI was that, firstly, we can offer all the amazing high-quality content for people to use. But when the user might want something, they might want to have an idea that didn't necessarily exist. Maybe it has actually never been created in the world. Like AI just gives us this superpower and ability to actually create things on demand specifically for what someone has in mind or in mission. and just kind of turn that idea, turn that search term or prompt into something they can use to express themselves.

24:17But as these systems become more widespread, we must focus on inclusivity. We need to ensure that the data feeding these models represents everyone. Angel Bush, founder of Black Women in AI, reminds us of the goal of true equity in episode 250. One of the things that I've always said to people is, I want Black women in artificial intelligence to be so successful that it no longer has to exist. We're really not looking for members. We're looking for people to be a part of a movement. The community, yeah. And really understand and trust that vision of the movement that we're going to make sure that you have all the tools you need in order to be a part of the AI economy, in order to pivot into your career.

24:59And in education, leaders like Dr. Cynthia Teniente-Matson at San Jose State University are teaching students that no matter how powerful the tool, the human element remains essential. Here's Dr. Teniente Mattson in episode 275. There are some students who are using the tools that I've talked to for study guides. There are some students that are using the tools for first drafts. I think however we use the tools, it's important if we're going to be writing about things or communicating that we're citing references and saying, you know, this was co-developed based on whatever sort of information they might have retrieved from the instrument.

25:41And also to validate it, because no, these hallucinations exist. But as time goes on, the hallucinations are diminishing, especially if you're building your own custom GPTs. That doesn't mean mistakes aren't going to happen. But that's, as I say to students regularly, NOAA and faculty and staff, You are still the human in the loop. We're not trying to replace the human in the loop. You have the tool be your co-pilot or your assistant that you're directing. So, looking back on 2025, what's our best piece of guest-given advice for the year to come? It's simple. Start now. As Derek Slager of Imperity puts it in episode 271, If you're still on the sidelines when it comes to artificial intelligence, it's high time to get in the game.