Godmother of AI: The Missing Piece of Intelligence LLMs Can't See | Fei-Fei Li

0:00Hey Chicago, class it up with Crocs. You know back to school is coming in fast. So why wait to find your new Fei footwear? Step into a local Crocs store and step into your new look. Try it. Style it. Make it yours. Because the right pair doesn't just show up, it shows off. First day fits, handled. Walk out ready for whatever's next. Visit your nearest Crocs store today. This episode is brought to you by Google Chrome. You think you know a browser, but Gemini and Chrome, that's new. It can help you with practically anything on the web, like restoring a vintage motorcycle from a 50-page restoration block, or finally break down that long article you've had open for weeks.

0:45Gemini and Chrome is here for it. Ready to make anything online make sense? There's no place like Chrome. Check responses set up required, compatibility and availability varies 18+. You know what I think will help this conversation? Because when I'm thinking about my kids' education, I want to imagine a workplace, where are they going to be? So when I was growing up, the workplace says, big company, you're doing this. And so in order to get there, you need to study this, this and that. Can you paint me a picture of a workplace or a company in 10 years? What does it look like? What should people be preparing for?

1:18Agency. I think AI will give people more agency. So a lot of the future of work, I think, will rely on people who know how to use these tools in a very effective way. So let me give you a concrete example. One of the very coveted jobs in Silicon Valley in the past 20 years is product manager. You know, there's a lot of conversations of the shifting nature of product management job. It used to be 10 years ago, fairly standard product manager's job is more the thread between users, markets and engineers. They're more like conductors. They don't have to code. They fairly often they were not software engineers.

2:12So if they want a prototype, they go to a designer, they go to a software engineer, they get a prototype, and then they send the prototype to users and they listen to the users and synthesize the feedback. And that life cycle of product management might take typically months in a company. Today, if you look at the job of product manager, actually, a lot of companies are experimenting with different things. But there are some fundamental changes. A lot of product managers just now code themselves. They don't have to wait to prototype from a team of people. They can use AI to help to design something very simple and vibe code.

3:05So that part shortens the lifecycle. Doesn't mean we should get rid of designers or software engineer, but it just saves time. And so that software engineer and designers can do much more sophisticated work. Also, user side, things are shifting. AI can actually simulate user behaviors. And there are much more efficient ways to reach to the users, to close the loop with users. So I'm looking at these young product managers, and when I look to hire them, I look for those who are riding the wave of changes. I don't look for those product managers who are still talking about the textbook workflow of even five years ago.

3:57So what I think the future of companies, there's a lot to imagine and depending on the company from healthcare to education to whatever industry. But I think our workforce will be much more empowered or can be much more empowered by powerful tools like AI. So that personal agency, creativity, and also the boundaries of what a person can do and cannot do is just a lot more blurred and lowered. or lowered. So to me, that's kind of just fundamentally shift the structure of corporate America. And every student today should try to imagine who they want to be in that new structure. It feels like you're describing entrepreneurs within workspace, or you're like, either you're an entrepreneur or you're an entrepreneur with an organization, which means you're handling multiple things and you're responsible for multiple things.

5:07Fei-Fei Li:I mean, my hypothesis on this, you will get a barbell effect. And this is what we are seeing at Masterclass, where you have one group that are becoming the specialists. And it used to be like, I remember in school, like I was told to pick one area and just go deep in that. And that's how I build a long term career. I think that's eroding except if you're in the top one if you're like the actual best what I mean by this is if I'm a copywriter if I'm an okay one anybody that now uses an LLM can do a decent job at that but if you're the best in the world at it or if you're in the top one percent I can't beat you at it and so we're seeing a the rise of people that are specialists that are very good other thing and I think that extends to tons of crafts.

5:58Fei-Fei Li:And then the other role we're seeing is this high agency generalist who's able to do lots of different things well and has good on it has really good skills on the judgment side on the agency side. And those people when you see them interact is really neat because they then interact with somebody who's in the top one percent at their craft and they're like, whoa, I couldn't do that. Right. And so my guess is that it's a bifurcation of those specialists and the people that can do lots of things well. Hey, Chicago, class it up with Crocs. You know, back to school is coming in fast. So why wait to find your new Fave footwear?

6:43Step into a local Crocs store and step into your new Look. Try it. Style it. Make it yours. Because the right pair doesn't just show up. It shows off. First day fits. Handled. Walk out ready for whatever's next. Visit your nearest Croc store today. This episode is brought to you by Google Chrome. You think you know a browser, but Gemini and Chrome, that's new. It can help you with practically anything on the web, like restoring a vintage motorcycle from a 50-page restoration block or finally break down that long article you've had open for weeks. Gemini and Chrome is here for it. Ready to make anything online make sense?

7:23There's no place like Chrome. Check responses set up required compatibility and availability varies 18 plus. That's interesting and I agree with you. I think both whether you're on the specialist side or generalist side you both have agency.

7:38Fei-Fei Li:Yes that's that. And you should both be able to use tools in ways that's uniquely creative and deep, right? I'm already seeing this, right? For example, designers, you know, they bring so much human creativity, but I see some of them use all kinds of AI tools in ways I cannot personally imagine. So I know that's where their craftsmanship comes. And also the word entrepreneurial, in Silicon Valley, that's almost like I'm going to do a Delaware Incorporated startup, and that's the label entrepreneur. And I disagree. I think the word entrepreneur is very much a synonym to agency. It doesn't matter.

8:23You can be a doctor, specialty doctor. You can be a K-12 teacher, but agency is the key. And in the face of a technology that is so cognitively advanced, Just be brave. Have your human agency and command that technology. Use that technology. Get familiar with that technology. Don't be afraid. Don't shy away from it because that's where the wheels of history is turning towards the future. And I think everybody, it doesn't have to be a Silicon Valley founder. Everybody can be entrepreneurial for their craftsmanship or whatever they want to do. You mentioned so many tools, like use tools, use tools.

9:10Can you give me an example of some of the tools that have been transformational to your job? Obviously, all kinds of from ChatGPT to Gemini to Cloud, I use it in many different ways. They have so many features from helping me to study some deep topics or to have a conversation. Here's a fun example. I'm in charge of laundry in my household. So every weekend I have to do loads and loads of laundry. And it used to be my audiobook time, but sometimes I get bored just listening to audiobook. And just about a few months ago, I realized I could have a conversation of a deep topic with AI as I was just folding laundry.

9:57And that has been so much fun. And somehow it's even more motivating for me to go fold laundry because I can have me time with AI to learn anything I want. And of course, software engineering has been completely transformed. And also, you know, on the art and design side, I mean, World Labs, we are creating models to help our creators and to imagine 3D worlds and all that. So we also see change in the creative world. Once again, that's also a very contentious area because some companies have positioned AI's creative tools as if it's a replacement. And I just deeply, deeply protest that positioning.

10:50I think that human creativity, even just on the visual side, human creativity is so vast, but even just on the visual design side is profoundly intertwined with our emotional intelligence, with the story we bring, with the values we bring, each creator's brain. I just think AI is such a powerful tool to help them solicit their, you know, express their creativity instead of to replace it. Totally.

11:25Fei-Fei Li:Do you feel AI can never be very smart until it figures out spatial intelligence? Yeah. So this is the work I'm doing now in World Labs. So what is spatial intelligence? Spatial intelligence is a term that encompasses multiple abilities today that humans display in an environment like this one, 3D environment. If we look at movement, we call it 4D environment. We can understand what's going on. I see people. I see equipments. I see this beautiful home. This is the understanding part of spatial intelligence. We can reason if I want to go and, you know, go grab a bottle of water in the fridge. I have to reason about the space, reason about I can go up the staircase, I can recognize the fridge, I reason about my movement.

12:19So that's reasoning. That's another part of spatial intelligence. A third part of spatial intelligence is generation, is that in my mind's eye, even though I'm not seeing your living room, but I actually have a view of what that living room looks like. If I'm a better artist, I can actually generate a lot of visual 2D or 3D or 4D visual artifacts and pieces. So humans can generate a lot of space. And the fourth, last but not the least part of spatial intelligence is interactivity, is how I focus on interacting with the space, right? Like how, again, laundry folding, that's my favorite weekend activity these days.

13:15That's deeply spatial. How you fold each piece of garment and now you hang them in the closet and all that is highly interactive. So spatial intelligence is these four things, understanding, reasoning, generation and interaction. And we are working on that. We have made tremendous progress. I'm saying collective we. You know, today you use, say, a nano banana or if you use GPT image, that tool can actually help you to generate a lot of 2D imagery. It can actually explain to you what unknown flower is in your garden. That understanding is quite advanced. It can help you to reason. and now we can actually draw figures in AI tools.

14:14The generation part right now, the more mature products on the 2D side, what World Labs is doing is on the 3D side. 3D is so fundamental for robotic interaction, for truly controllable creativity, such as design, architecture, game development, VFX. So that's the piece we are working on. Is it separate from LLMs? Like, I mean, do LLMs have their limit and then world models step in? Yes and no. I think they're complementary. You can think about humans, right? Just as you were saying, to put a basketball in the hoop. First of all, that's such a fast action that people don't like sit there and think and talk in their head.

15:07But I do think that is a, even that act itself is a highly complex, intelligent moment where language reasoning come in because you probably as an athlete, you are keenly aware of the scoringness or missingness, what it means to the game or to the moment. And some of that is probably going on in the language way. But seeing the court, seeing the other players and aiming the ball, that is deeply spatial. And then orienting your body, like knowing how to make that move is deeply physical. So many things we do in life is actually a mixture of language, linguistic intelligence, spatial intelligence, and physical intelligence.

16:07So to me, they're very complementary. They work together. I do deeply believe spatial is a huge piece of it. Evolution took 500 million plus years to get spatial intelligence to maturity. It took a much shorter time for language intelligence. So it's a very profound, ancient, fundamental, intelligent capability of animals and humans. And how far are we from understanding the fullness of it, like 100 % of? Wow. As a scientist, I never know what's 100 % because science itself is pushing the boundaries of unknown. If the goalpost is human intelligence, the challenge is we don't even know how far human intelligence is, right?

17:04We never know the boundary of human intelligence. But if you think the daily capability of humans, the average capability. Laundry folding. Right. The cooking omelet, the laundry folding, the playing basketball. How far are we? We're not there yet. But is it going to take 100 years? I don't think so. My goal is we can get there in my lifetime. And I think a lot of people are working on that. So that put a kind of a bound, right? I don't think it will take 100 years. It might not even take 50 years, but it's not going to take one year either. Well, what is your estimate? When does Dr. Fei-Fei Li retire from laundry folding on Sundays?

17:58How many years? Yesterday. I know. Like I said, I don't know. Laundry photo itself also involves physical embodiment. So that also involves sensor technology and hardware technology. So that goes a little bit more complex. But again, I'm hoping it's our lifetime. Yeah, me too. As a mom, I'm hoping.

18:28Fei-Fei Li:I mean, I know this is a term that you avoid for a whole host of factors, but my hypothesis would be you can't get anywhere close to what AGI, which I know is the word that you avoid for a host of reasons, is you can't even get close to it until we do the spatial intelligence. Because that's about that's to read people. That's to interact in the world. Yeah. You know, look, I'm not going to find the popularity of this word. It's just as a scholar, we always, the field in the academic world is called artificial intelligence. It's not scientifically rigorously clear what the G means. Right. So, but whatever, that's just a word that we can, it's just a nickname, I guess.

19:19Yeah, I agree with you, David. I think AI or intelligence is complex. I don't think the picture of AI will be complete without spatial intelligence. If you want to stay ahead in the AI era, follow Silicon Valley Girl podcast on your favorite platform. New episode every week on AI, careers, and how to not get left. Close your eyes, exhale, feel your body relax, and let go of whatever you're carrying today. Well, I'm letting go of the worry that I wouldn't get my new contacts in time for this class. I got them delivered free from 1-800-CONTACTS. Oh my gosh, they're so fast. And breathe. Oh, sorry.

20:01I almost couldn't breathe when I saw the discount they gave me on my first order. Oh, sorry. Namaste. Visit 1-800-CONTACTS.com today to save on your first order. 1-800-CONTACTS. I see you. Avatar Fire and Ash is now streaming on Disney+. It's the film critics are calling the best Avatar yet. Go, go, go, go! A true epic and completely jaw-dropping. This is the only purest thing in this world. Return to Pandora on Disney+. It will be an adventure for the whole family. And watch the Oscar-winning phenomenon at home. This is sick! Avatar Fire and Ash now streaming on Disney Plus rated PG-13 behind