1. Podcasts
  2. StarTalk with Neil deGrasse Tyson
  3. What Is Intelligence? With David Krakauer
StarTalk with Neil deGrasse Tyson

2 Oct 2026 · 1h 17m · 29 chapters

Episode artwork

What Is Intelligence? With David Krakauer

In short

The episode asks “what is intelligence?” and argues that intelligence is tied to life’s adaptive problem-solving, evolves via major transitions, and differs from AI “capability.” It also contrasts intelligence with consciousness and discusses how language and tools change cognition.

Guest

David Krakauer, evolutionary biologist and president / William H. Miller Professor of Complex Systems at the Santa Fe Institute (complex systems, intelligence, evolutionary biology).

Key claims

  1. Life implies some form of intelligence: organisms that sense and act adaptively to increase survival/replication have intelligence.
  2. Intelligence is continuous (life is binary), and collective intelligence can be paradoxical: simple parts can yield smart wholes (brains), but human crowds can become a “shit show” in aggregate.
  3. Language adds flexibility: “human language is making infinite use of finite means,” enabling arbitrary complexity beyond simple signaling.
  4. Intelligence = making hard problems easy; consciousness = being/feeling (citing Neil Seth’s framing).
  5. LLMs differ from humans: they start with language, lack an unconscious, and solve problems inefficiently (language-only “brute force” vs human energy/time constraints).
  6. Tools can be complementary (scaffolding like maps/abacuses) or competitive (replace competence like GPS), risking dependence and loss of competence; “intelligibility” matters more than mere capability.

Notable examples

flocking/fish turning together; vervet monkey predator calls (index/icon/symbol distinction); humpback “backup” calls; slide rule vs calculator; abacus training; GPS vs maps; LLM solving Navier–Stokes “singularity” problems via text; protein folding as high-dimensional computation.

Written by AI. May contain mistakes.

Chapters

0:42

Exploring the Nature of Intelligence

Discussion centers on defining intelligence and its evolution.

“which lets you personalize your learning around what you actually care about right now.”
2:52

Exploring the Nature of Intelligence

Discussion centers on defining intelligence and its evolution.

“Neil deGrasse Tyson, you are a personal astrophysicist.”
4:46

Life and Intelligence Relationship

David Krakauer discusses the relationship between life and intelligence.

“So I like the fact that you study complex systems, but you have roots in evolutionary biology because that's where we are life forms, and that's where it all begins.”
7:30

Collective Intelligence vs. Individual Intelligence

The hosts and guest delve into collective intelligence and its implications.

“Because when you said bacterium, is there any kind of collective intelligence where the whole is greater than the sum?”
9:30

Communication and Language in Animals

The conversation shifts to the complexities of communication and language in various species.

“The less intelligent that mob is, the more in constant they act.”
14:03

Understanding Signals in Animals

Learn about the distinctions in communication signals among different species.

“So I'm going to get into the signal thing.”
18:37

Exploring Quasars and Their Significance

Understand what quasars are and their role in the universe.

“The word is a pseudo acronym for quasi stellar radio source.”
19:43

Intelligence vs. Language Development

Examine the relationship between intelligence and the evolution of language.

“I want you to say, I have an answer to that.”
22:30

The Nature of Consciousness and Intelligence

Discuss how consciousness relates to problem-solving and intelligence in organisms.

“Now, unconsciousness, that we were talking about, that's very interesting, which is for most of our evolutionary history, we didn't have language.”
24:24

The Unconscious Mind and Its Role

Delve into the functions of the unconscious mind and its evolutionary significance.

“And the examples you gave in animal behavior, there are clues in terms of how they're manifesting their intelligence in their behavior.”
Show all 29 chapters
28:00

Exploring the Nature of Dreams and Cognition

Discusses the relationship between dreams, cognition, and visual intuition.

“Because when you're dreaming, you're not really responsive to touch.”
30:00

The Unconscious Mind and Communication

Examines the evolution of the unconscious mind and its communication methods.

“I mean, it's visual, olfactory, and linguistic.”
31:40

Cultural Biases in Thought Processes

Investigates how cultural biases influence thought and insight.

“But getting back to your point of the source of where an insight might come, there's the famous discussion of the mathematician Ramanujan.”
33:40

AI, Dreams, and Human Intelligence

Contrasts AI's capabilities with human intelligence and the role of dreaming.

“So there's a few things to say about this, right?”
36:18

Efficiency in Problem-Solving: Humans vs. AI

Discusses the differences in problem-solving efficiency between humans and AI.

“And there was this long-lost, you know, an outstanding question with a prize behind it about some properties of these equations, which is do they blow up and so on?”
38:18

Cognitive Artifacts and Human Evolution

Explores cognitive artifacts in relation to human evolution and intelligence.

“and you got him, ran around the room 20 times and then gave it to me.”
40:00

The Interplay of Tools and Humanity

Analyzes the connection between tool-making, memory, and human identity.

“So this goes back, in fact, to a French philosopher, Henry Bergson, who debated relativity with Einstein, as you know, right in the 20s.”
42:01

The Role of Tools in Human Intelligence

Explore how tools like the abacus and GPS affect our cognitive abilities.

“And there's archaeologist, French archaeologist, André Goulran, and he said, what are tools about?”
44:49

Generational Impacts of Outsourcing Skills

Discuss the consequences of relying on technology for navigation and calculations.

“So we need more vocabulary here than just intelligence, right?”
47:32

The Evolution of Learning Tools

Examine how reliance on tools like calculators impacts our understanding and intuition.

“And let me move on to some other thing that requires my intellect to solve.”
50:34

The Distinction Between Capability and Competence

Understand the difference between being capable and being competent in using technology.

“So you do this, and there's only a certain number of figures you carry with you into the next calculation.”
53:19

AI vs. Human Intelligence in Problem Solving

Delve into how AI tools function differently from human cognitive processes in problem solving.

“Because you have said human intelligence potentially unlimited.”
56:00

AI Model Scaling and Efficiency

Learn about the differences in scaling efficiency of AI models compared to traditional methods.

“So double the size more than doubles the amount of computational effort.”
57:51

AI Model Scaling and Efficiency

Learn about the differences in scaling efficiency of AI models compared to traditional methods.

“Ernesta creates designer-quality rugs custom-fit to the exact size of your space, so every room feels beautifully pulled together.”
58:51

Human Intelligence and AI's Role

Explore the limits of human intelligence and how AI can assist in complex problem-solving.

“This is StarTalk with Neil deGrasse Tyson.”
1:02:02

Energy and Information Parallels

Understand the relationship between energy use in the Industrial Revolution and information processing with AI.

“especially in modern astrophysics, from information theory.”
1:09:41

The Nature of Knowledge and Misinformation

Discuss the implications of knowledge accumulation and the risk of misinformation in AI systems.

“Now, what's weird here that is worth discussing is that coal is depleted, natural gas is depleted, but in principle, knowledge is not.”
1:10:00

Understanding Intelligence in AI vs. Humans

Explore the differences between human and AI learning methods, and how they affect intelligence.

“Now, you could have done that with coal deposits, but it would be difficult.”
1:20:20

The Nature of Evolution and Intelligence

Discuss the relationship between evolutionary processes and the development of intelligence.

“You didn't hear what I was about to say.”
A man walking through an airport, asking his phone a question

Ask about this episode

Get the gist, explore an idea or ask about something said.

Claude

On StarTalk with Neil deGrasse Tyson, what are the key points of this episode?

Searching your listening

Transcript

Automatic transcript. May contain errors.

0:00Meu Deus, é lindo. Obrigado por me ouvir. Translation, my God, you're beautiful. Thank you for listening. Yes, I'm talking to you, but I'm talking to you in Português. That is correct. You never know when you're going to find yourself in Portugal or when you're going to talk to somebody from Brazil who also speaks Portuguese. You know, if you're going to travel anywhere, you'd be surprised how much it helps to know the language, even if you don't know it fluently. But let's say you do want to know it fluently. Well, I have an answer for both. Rosetta Stone. That's right. Rosetta Stone has just launched Rosetta Stone Sapphire, featuring Sapphire Studio, which lets you personalize your learning around what you actually care about right now.

0:48Now, we all know that I use Rosetta Stone so that I can understand what my mother-in-law is saying about me behind my back. But maybe you're traveling and you just want to know, hey, what do I say when I check in? How do I talk to the taxi driver? Rosetta Stone Sapphire is going to allow you to talk to people in real world situations in their own language. And the great thing is you can do it on your phone, on your tablet, at your own pace, on your own time schedule. So what are you waiting for? Go ahead and take your language skills to the next level. Don't wait to try Rosetta Stone Sapphire.

1:23StarTalk listeners can get 20 % off their Rosetta Stone Sapphire subscription when they sign up today. This gets you access to Rosetta Stone Sapphire in 25 languages. So go to rosettastone.com and sign up today. StarTalk Radio is presented by ChatGPT. ChatGPT Work, a new way to work in ChatGPT, helps you move from goals to real outcomes. ChatGPT Work can use info from your apps, files, and plugins like Slack, calendars, and meeting notes to help produce finished materials. Plus, it can stay with bigger projects for hours while you still remain in control. Put ChatGPT to work on your most ambitious ideas and projects.

2:12Get started at ChatGPT.com by selecting Work Mode. Available on Plus and Pro Plans. That was quite the overview on what it is to be intelligent. It went places I didn't even know intelligence went. Deep. Yeah, and for some reason, I still feel stupid. Coming up, StarTalk Special Edition. Everything you need to know about intelligence. Welcome to StarTalk. Your place in the universe where science and pop culture collide. StarTalk begins right now. This is StarTalk. special edition. Neil deGrasse Tyson, you are a personal astrophysicist. And if it's special edition, it means Gary O 'Reilly in the house.

3:01Hi, Neil. Hey, former soccer pro. Yes. Soccer announcer. Of course, we got Chuck Nice, baby. That's right. Tempest in a teacup. The Lord of Nice. Lord of Nice. All right. Exactly. So, Gary, what did you and your producers stitch together for today? Well, with all this talk of artificial intelligence, has everyone stopped to think, what is intelligence in general? That's what we're doing today. Everybody thinks they know what it is and no one can really define it. That's because they're all dumbasses. To Chuck's point, how did intelligence evolve and why? What chances are there of beings far smarter than us?

3:41That's a low bar. Are we? Yeah. If we are the universe's way of knowing itself, is the universe screwed? Neil, please. I mean, if we're the best, it's God. It's God, yeah. To figure itself out. You know, maybe I want to know that answer, maybe I don't. But we're going to ask it anyway. And that quote, I think, is traceable to Carl Sagan. Yes. It might have been in one of the episodes of Cosmos, the original Cosmos. Well, let's find out what our guest has to say. You talk about did intelligence evolve and in what way? Yeah. We have an evolutionary biologist, You need them every now and then. Straighten things out.

4:20And he's also president and the William H. Miller Professor of Complex Systems at the Santa Fe Institute. Of course, that would be in New Mexico. Yes. I'm sorry, you mean New America? Well spotted, Chuck. And he specializes in complexity and intelligence. Join me in welcoming David Krakauer. David, welcome. It's wonderful to be back in person. In person. We can verify that. Poke him. Make sure he's real. I'm here. Not a hologram. Not a hologram. So I like the fact that you study complex systems, but you have roots in evolutionary biology because that's where we are life forms, and that's where it all begins.

5:07So could you just shed some luminosity on the evolution of intelligence as we think about it? Yeah. Well, okay. So the first question is, what is the relationship between life and intelligence? Can one conceive of a life that wasn't intelligent? Can one consider or conceive of an intelligence that's not alive? I think the latter, yes, and we might talk about that. But the former, probably no. And so as soon as you have life, you have some form of intelligence. So what is that? and I guess the canonical simple argument would be these are some form of organized matter that can sense the environment and act in a way that increases its representation in the world, either through replication or what have you.

6:04In the interest of its own survival. In the interest of its own survival. And so any life form that can sense and behave in a way that's adaptive, we would have to grant has some form of intelligence. Okay. So the interesting theoretical problem here is that life feels a bit binary. You don't say that a flea is less alive than an elephant. True. So that's kind of an interesting fact, whereas intelligence is not. So how does a kind of binary system give rise to a continuous one? And that's kind of the theory challenge for the origin of intelligence. Tell me again what you mean by the binarity of this.

6:40So for example, I mean... You're either alive or you're not. Exactly. But that doesn't mean that the level of intelligence you have is dependent on you being alive or not. I see what you're saying. It's a gradation. So intelligence has a continuum. Yes. You're either alive or dead, does not. Right. Got it, okay. Just to clarify that. So that's, okay, so that's the first question, right? So over the course of time, what are the forces that have created higher levels of intelligence, if they have? That's an interesting question in itself. Maybe it's entirely context-dependent. Maybe there's a sense in which a bacterium in the world is more intelligent than a human destroying a world.

7:13But, you know, one could go there if one wanted. In other words, you would say humans with high intelligence who destroy their world are not acting in the interest of their survival. No, I would say they're stupid. And that would be a demerit against their intelligence scale. Absolutely. And what about this? Because when you said bacterium, is there any kind of collective intelligence where the whole is greater than the sum? For sure. I mean, in a sense, that's our own brains, right? So we have billions of nerve cells, each of which is quite simple on its own. That's right. And they connect and they create thought, mathematics, music, all the things that we have.

7:50Chuck, that was a stupid question. Well, no, I didn't mean as a part of one entity like our brain. I meant like our gut, where those bacteria are all different types, but they work together to cause us to have emotions and cause us to think certain ways. They're operating in tandem with our brain, but they're all separate bacteria. Absolutely. I mean, there's this slight paradox that happens. So this is the world of collective intelligence, like swarms and shoals and schools. Right, because normally when you think of a collective intelligence, is the ensemble of organisms operating in a way that one individual would not otherwise understand, but the ensemble does.

8:36Right. I mean, this has emerged in things like flocking. Flocking. Of birds, I guess. Yeah, or when you see fish change all direction all at once. Yeah. I don't even know if that's like electrochemical or not, but who knows, you know. No, but there's an interesting thing that happens here that's surprising, right, which is that brains made of very simple cells produce extraordinary thoughts, whereas human societies kind of made of extraordinary individual thoughts produces a total shit show in the aggregate. So there's an interesting relationship between parts and holes. If you have very smart parts, you don't necessarily have a smart hole.

9:14That's true because there's nothing less intelligent than a mob of people with pitchforks and tiki torches. True. It seems to be inverse correlated with the number of people who are part of the mob. They act less and less Less intelligent, but more and more as a unit. Yes. Isn't that funny? Okay. The less intelligent that mob is, the more in constant they act. The more monolithic. Yeah, the more monolithic they are. The more monolithic that is an intent and action. Right, and that is in some sense gets back to this question of evolution because in evolution you call these major evolutionary transitions.

9:54So you go from a single cell, like a prokaryotic cell, like a bacteria, bacterial mat, kind of a collective, a single eukaryotic cell to a multi-cell, to a tissue, to an organism. So that is the story. And in every case, it's not clear whether the aggregate is somehow more restrictive, less intelligent than the parts. So if you're talking about around evolution here, when it comes to our human intelligence, what's the turning point when we get complicated language? Or was it something else? Well, I mean that, you know. Wait, let me prepend that. All right. Because you're saying, well, we have language and, you know, other animals don't.

10:36Or do they not have language? I mean, so let's broaden that question to when organisms communicate complex information. Mm-hmm. Do we call it language when a bee communicates to another bee in a hive where to go or where to move the camp? And on the limit that we would think of as a limit as our complex language, do you distinguish as an evo-bio person, not evil-bio, but evo-bio person, do you distinguish dolphins squeaking at each other from humans squeaking at each other or not? Yeah, it's a difficult one. So I think the jury is out. But one quite useful distinction I quite like, So in the biology community, people talk about signaling and communicating as being somewhat distinct from language.

11:34Sure. And so I guess with human language, Alexander von Humboldt had a nice phrase that I like here. Tell us briefly about him. So he was a great 18th century naturalist, kind of invented ecology as we know it, was a great explorer, took extensive measurements, worked on weather systems. And he was German-French? German. German. German, yeah. And actually my friend Andrea Wolf wrote his biography, The Invention of Nature. Beautiful book. Plug for the book. And if I remember, I think I own some of his books. Didn't he write about... Cosmos. What's that? He wrote a whole series of books called Cosmos.

12:07Yes, and I think one of his books tries to connect our understanding of science to make a better society. I mean, I think he was a civic scientist as part of his intellectual efforts. Oh, he'd be so happy if he saw us today. I know. Well, but that's an interesting point. I mean, that romantic movement where they were all, in some sense, entangled with each other. You didn't get to just be a scientist or a good citizen. You should be both. Entangled in a good way. In a good way. So tell us more. I'm sorry I interrupted you. So yeah, so he has this phrase where he says, human language is making infinite use of finite means.

12:46And what he meant by that is if you have a grammar, like a rule system, you can construct almost any thought out of it. And that flexibility that you get with language is not as evident in simple signaling systems, like chemical ones or even gestural ones, actually. And how about, now we know whales have a certain type of language. We don't know how extensive it is, but humpbacks call for help when killer whales or orcas are around and the other whales respond. They call for backup? They call for backup, you know, and they'll even attack the orcas when they're going after seals. They're not just going after the other whales.

13:32So that's language. How are monkeys warn each other about jaguars who are in the forest? Just to be clear, jaguars, if memory serves, can climb trees in ways that lions cannot. So a monkey is not entirely safe in a tree. And that's exactly why they warn each other. You have the concern. Right. So what I'm saying is that can be considered signaling, but it can also be considered language. Well, okay. So there's an American philosopher, Charles Peirce, and he made a distinction. So I'm going to get into the signal thing. And he made a distinction between what he called an index, an icon, and a symbol.

14:11So the point is this. So vervet monkeys, Cheney and Sefer famously worked on these different signals. Birds. So if you say falcon, they emit a sound, they crouch down so there's a correlated behavior. And if there's a kind of terrestrial predator, they're kind of a tree and so on. So they have those and in the kind of signaling literature, that would be described as an index. There's a kind of mapping one to one. That sound always means, watch out, there's an aerial predator. Now with humans... Pavlov knew all about this. And power, completely, absolutely. So you could say that's how it's acquired, maybe, or innate and so on.

14:50Or that's where it is. It doesn't even have to, it can be just a sound, like the bell. It can be a sound. Right, okay. Now, in the human case, you can substitute any sound for any appropriate response of almost arbitrary complication. Correct. And that's something you learn in your lifetime. Wow. And I think that, so it's not that they don't have something that's embryonic of our ability, but what we do is quite extraordinary. Oh, yeah. I didn't think of it that way, but you're absolutely right. Because now I'm thinking about in all the movies, they're like, and here's the signal. And that means take out your math textbook.

15:27So, yeah. Okay. All right. Well, that's very good.

15:38Curiosity is fundamental to progress. So why not take what you're curious about and turn it into a master's degree? Whether you want to build on existing expertise or study something entirely new, SNHU offers over 80 graduate programs you can complete online. Learn from instructors with real-world experience. Connect with people from all over the country and gain knowledge you can use at work and in everyday life. Give in to your curiosity and visit snhu.edu.

16:36Progressive.com. Progressive Casualty Insurance Company affiliates and other insurers. Not available in all states. Hmm, let's see. Cashmere hoodie. Cashmere crew neck. Long sleeve tee. Performance pants. Hmm, what else? Oh, what am I doing right now? I am kind of counting some of the pieces in my closet that make up the staples in my wardrobe. I'm talking about easy pieces that make fashion effortless, and make me look like a fashion guru. Not that I'm not, let's be honest. Quince is what I'm really talking about. Because Quince makes elevated everyday essentials using premium materials in designs that are timeless, thoughtful, crafted, and made to be worn again and again.

17:25And that's exactly what I do. And when the temperature starts to drop, Quince makes it easy to build on those everyday staples with versatile layers designed to keep you warm and comfortable all season long. If you're new to the podcast, you probably don't know that I've been a longtime customer of Quince long before they started supporting StarTalk. And that's why I'm super happy to tell you about them. All the pieces that I named up front, I have and more. Not to mention the number of family members that have received their excellent cashmere pieces from me as a gift. Keep that in mind because you know the holidays are coming.

18:06Find your next fall favorites at Quince. Download the Quince app for app-exclusive offers or go to Quince.com. Get free shipping on your order and 365-day returns. Now available in Canada and the UK, too. And when Quince asks where you heard about them, let them know that it was StarTalk Radio and the fashion guru Chuck Nice that told you all about it. It's the best way to support the show. Quince.com. Go there right now.

18:37Mmm, quasars. The word is a pseudo acronym for quasi stellar radio source. What's a quasar? These are objects that are among the most distant things known in the universe. How do we know about them at all? Because they're really, really luminous. Some of them as luminous as 500 trillion suns. That's why we can see them to the edge of the universe. If you like that fact, you can find 4 ,999 more in Lost in Space. 5 ,000 facts to help navigate the universe. Lost in Space is now available wherever you get your books.

19:42Does the expression of complex language predate the development of what we think of as our intelligence, or did it follow it? Good question. Oh, wow. Good question. Why don't you have answers to this? Yeah, I'd like to say. Why don't we invite you on the show? I don't know. To humiliate me. I don't want you to hear that. I must have a good question. I want you to say, I have an answer to that. Yeah, these don't, you know, the reality is, you know this. They don't have final, conclusive answers. Okay. They're not even close. But I would say that, okay, so I'm going to define it. I think I did last time I was talking to you guys.

20:12So intelligence for me is making hard problems easy. That's basically it. Across the animal species, every species, even plants. So, you know, finding an efficient way of solving a problem, not an inefficient way of solving it. We'll get to AI in a minute, which is all about inefficient solutions to problems, but that's something else. So I think that's everywhere. All life forms find elegant ways of solving problems in their world. Now, the question is, what does language add above and beyond an innate repertoire or even a simple Pavlovian association? And I think the possibility for almost arbitrarily complex behaviors, which don't necessarily produce intelligent behavior, right?

20:53They can produce warfare and so forth and strife. But that's the thing that we do. And I think it somewhat decouples from the question of intelligence, right? It creates great intelligence, but it also creates great stupidity. All right. How are we distinguishing between intelligence and consciousness? Wow. Yeah. We're just barely getting intelligence here. You could throw consciousness right on top of it. I actually think consciousness is easier than intelligence. Easier. I read some of your work and you cite the fact that mathematicians will tell you their subconscious mind, subconscious unconscious, will solve the math problem but not your conscious mind.

21:31Yeah, interesting. So between intelligence and consciousness. How we distinguish it. So, okay, I want to say two things. You're talking about the old edge, sleep on it. Yes, sleep on it. Exactly, sleep on it. The Kekulé problem, exactly that. So let me do a bit of both here. I'm not sure the best way to do it. So on the consciousness side, I quite like this way of defining it and Neil Seth, who works on consciousness, does. He'll say, intelligence is about problem solving and consciousness is about being and feeling. So I consider consciousness very primordial, right? In other words, any organism that lives in an environment that it has to sense and maintain its integrity in some way, it could be a single-celled organism, it could be a cat, it could be a whale, they will manifest in consciousness.

22:17It's about feeling and the sense of self that's required to survive. If you didn't have a sense of self, it's like, oh my God, my foot's gone, it doesn't matter. It sort of matters. And intelligence is about problem solving. So that's the first point. Now, unconsciousness, that we were talking about, that's very interesting, which is for most of our evolutionary history, we didn't have language. And so somehow we were having to solve problems in the world as every other animal does, without that kind of declarative self-awareness. And so, in that sense, there's more if you like, neural resources available to solve problems unconsciously than in that tiny little thin layer of cells that we call the frontal cortex that we associate with conscious deliberation.

22:57Wait, wait. Just because early on we didn't have a language doesn't mean the thoughts were subconscious well that's also an interesting question right so for most people stop telling me i have interesting well you do man and so this is the thing where a lot of people would associate self-consciousness with deliberation which seems to depend on the possession of language yes yes but that's only because we have the language that we have, okay? Because we don't know if a lion is deliberating, you know, or if other apes that were a part of that family, if they actually look up and go, damn, you know, if I didn't want to throw my poop right now, that'd be a very beautiful thing to look at.

23:46You know, we don't know that. You don't know. But the fact that we have this inner dialogue is the reason why we believe that we are, I think, therefore I am. Right, because we've all seen Animal Kingdom videos where two animals, typically the same species, there's a standoff. And they sort of pace back and forth. You know something's going on in their head. Something has to be going on. Something's like, should I do this? Right. Will I make it out of this alive? You don't want none of this. Don't make me. You don't want none of this. You're not built like that, son. don't make me put my foot up your ass you can't tell me nothing's going on I wouldn't say that for a second I think that so the question of intelligence as I said at the beginning is ubiquitous and degrees of it and high degrees of it in the non-human world but there's an interesting fact which is that there is a tighter coupling between signaling and behavior in non-humans and humans you could watch humans all day long in a library and have no idea what they're doing or deliberating about.

24:52And the examples you gave in animal behavior, there are clues in terms of how they're manifesting their intelligence in their behavior. Language is this weird thing that's kind of almost decoupling us from our immediate space-time context. That bit is the bit that feels, and it might not be, somewhat unique to our species. No, and it might not be, but you're absolutely right. And earlier offline, David and I were talking about comedians and how improvisation is this very unique thing that they do. And I mentioned to him that when I'm on stage and I'm improvising, the thing that's weird is I can almost feel my brain being semi-conscious.

25:37There's like a part of my brain that takes over that moment. And I'm not actually thinking. Have you seen a doctor? I know. Most people right now are listening like, Chuck, are you ever actually thinking? Is that intuition? Does that become an intuition? Well, no. It's funny because the way I look at it is people say that you have a subconscious mind or an unconscious mind. And what I feel when I'm in that moment is that that part of my being, my subconscious is accessible to me. So that it's kind of a slight overlap in the Venn diagram of my consciousness and unconsciousness, where my executive function is able to dip into the subconscious and pull something out.

26:28That's the way I describe it. I mean, there's an interesting point that's not talked about enough, this distinction between... If you break intelligence down a little bit into skill and expertise. so expertise the essence of it is practice that gives rise to automaticity that you don't have to think about it if you're a great athlete right we're talking about that you're taking a shot the last thing you want to do is think about it because you're not going to make it and exactly the same thing you're not going to take the shot it's exactly the same with math right you're learning mathematics stay out of your head you exactly it so there is this very thing that thing that happens it looks as if you need language that early deliberative process yeah and then you practice out of the language, and then you're returning to a state that's not even linguistic.

27:12So it's almost pure program, pure reflex. But you have to do it via language. So we learn mathematics, like we learn sports. You practice it enough, you're not thinking about, oh my God, how do I integrate that function? You just do it. And I think expertise is in fact paradoxically not thinking. Yes, because you've built the muscle memories. Or the conceptual memories. Right, so you're not consciously thinking. When you're in that zone, your subconscious is feeding you in the moment. Without forethought, it's happening in the moment. Right. Yeah. So our conscious mind has access to our senses.

27:48All the whole sensorial palette. It's a survival. But our subconscious, our unconscious mind, does that have access to the senses? And then doesn't want anything to do with our survival. It's got another executive sort of mission statement. Because when you're dreaming, you're not really responsive to touch. I mean, nobody, you know, you're disconnected. You can play music. The dream is in its own space. It's almost like it's making its own sensory world. So actually my colleague, the novelist, Cormac McCarthy, he wrote this beautiful essay called The Kekule Problem. Yes. He wrote the discovery of the structure of the benzene ring, and there was kind of a dreamt solution.

28:28The snake eats its tail. The snake eats its tail. And Cormac's point was very interesting. He said, the unconscious mind evolved long before language emerged. Because other animals presumably have an unconscious too, right? And it doesn't want to communicate to us in language. So it communicates with us visually. So for example, the Ouroboros, the snake that eats his own tail. And so Kukuli wakes up and he says, wait a minute, what's going on? What are you trying to tell me? Why can't you just tell me? And the unconscious said, I don't do language, you moron. Right? I do symbols. So I do visual intuition.

29:02Yes. And then he imposes on it the language of modern chemistry through language. Wow. Why are we programmed to absorb information that way in a better way? Because that's the problem-solving aspect. Obviously, if we're asleep, there's no noise. The brain is quiet. Well, you value judging it, saying it's better. I would say it's different. Okay, I take that point. And as an educator, educators know some people are visual learners. Some are rote learners. summer so what you just said it cracks this nut of human cognition for me because like for example when i'm speaking typically i use my hands and not just in a in an italian way we put emphasis like this i will gesture an image of what i'm also saying i'll say earth is going around the sun so that there's another way it's entering their mind.

29:57And I find it to be much more potent that way, accessing both parts of that brain. Yeah, we're totally multimodal. I mean, exactly as you say. I mean, it's visual, olfactory, and linguistic. They all buttress one another, right, and consolidate. But this question of, I mean, the argument would be that what we're calling for at the present moment, the unconscious, whatever that means, and these words are all a little bit fluid, is older, so to the evolutionary question, been around for much longer. Ancient animal brain, don't you? It is, it is exactly that. So animals are calculated trajectories using rules of thumb heuristics all the time.

30:36We then give it this additional gloss. But a lot of the calculation, and this has been written about endlessly by mathematicians reflecting on how they solve problems, they're not necessarily solving the problems deductively, symbolically. They can go to sleep, dream clues to the solution to the problem, and then wake up and impose on top of it this secondary armature of language, which is useful because you can communicate it. How could I communicate to you? Well, I dreamt of this snail that's sort of eating a leopard, and you'd say to me, I don't know what you're talking about. So the symbolic thing doesn't naturally lend itself to communication in the way the language does.

31:13However, for the longest time, we did communicate in symbols written form. So before we had alphabets, which everybody does now, which some of the alphabets of the world right now are pictograms. They're not actual Chinese. Well, Chinese. The Chinese is the kanji, right? So, you know, for the longest time, we drew pictures to communicate our thoughts. And once we figured out words, that's where we are now. But getting back to your point of the source of where an insight might come, there's the famous discussion of the mathematician Ramanujan. if I remember his name correctly, who, he was Hindu, and he would say the solution just came to him, and it was Vishnu or Krishna putting the solution on his tongue to be shared with others.

32:06Well, he was wrong. It was Jesus. Jesus.

32:12You're only encouraging him. So in what way does one's cultural bias influence what they think is the operating force on their thoughts? That's a very difficult question to answer, right? Because presumably, I would guess that the underlying unconscious process is quite universal. And then the secondary form it takes when we communicate it. On this show, I think when he says universal, he means earthwide. I mean, yeah, I do. I mean global. I mean global. On this show. I mean global. Yeah, terrestrial. For all life. For all human life. Human, the earth life. Earth life. And this secondary cultural layer that we impose, whether we call it Jesus or Vishnu or what have you, or the Buddha, that's where the variability probably exists.

33:03But I would guess that the underlying dream state or unconscious solution is probably quite universal. Interesting. So let me get back to that dream state. Do we know the title of the short story that became Blade Runner? Do androids dream of electric sheep? So that brings us - Do androids dream of electric sheep? There you go. Yeah. Now somebody was high. Somebody was high. He was. Philip K. Dick was always high. Oh, awesome. Philip K. Dick. I love it. So that gets us to the question, will AI never be us because AI doesn't dream? Ah. and will solutions available from our dream state never be available to AI?

33:47So there's a few things to say about this, right? I hope more than a few. There are many things to say about this. So we started with the evolution story, and I made the claim that sentience or consciousness or sensation was primordial, that all beings have it. That is definitely not true of Nellalem. So, point one. The large language model. The large language model, right. It has a completely different path towards its intelligence. Secondly, it immediately starts with language. It doesn't have an unconscious. There is no unconscious. Right. So it's just got a linguistic foundation right at the beginning.

34:26Thirdly, it's a collective linguistic. It's not an individual language learner. It's every book ever written. That's right. So there are some really fundamental differences. Including 14 of my books that are now in a class action suit. Just thought I would tell you that. Absolutely. So these are important differences. So start with the last thing that we got, which is language. And ignore what every other organism has, which is this, if you like, homeostatic, sentient form of existence, pre-language. Right. Wait, so where are you taking us with that? You can't just say that and not take me somewhere.

35:04Okay, so now this lead opens this whole debate about what we mean by an LLM, a large language model, an AI being intelligent without being alive. And I'm asking you, do they dream? They definitely don't dream. Definitely don't dream. So does that limit where it can take us relative to where we can go ourselves? Okay. So we were talking about this before. I mean, you should repeat that earlier offline, that point you made, because I think it's an interesting one about what you can do with language. So offline, when David and I were talking, I said that with language, I can explain anything to you, no matter what it is, that if I can find the right words, and you know those words, right?

35:55It doesn't make a difference. What it is that I'm trying to convey to you, I can do it. And that is extremely powerful. And then you said what? Yeah, so we were talking about the recent thing in the last week that everyone's talking about, which is LLM solving a mathematics problem. The singularities of the Navier-Stokes equations, this kind of stuff, right? This dynamics of fluids. And there was this long-lost, you know, an outstanding question with a prize behind it about some properties of these equations, which is do they blow up and so on? have singularities in them. And so out comes an LLM recently, and at considerable expense, I mean, tens of millions of dollars, thousands of agents, it finds a solution.

36:43But it's doing it by being fed text. Not geometry. It doesn't have a visual apparatus. So what does that mean, that we can solve math problems by only being trained on language? And that's what we were talking about. And I think what we've discovered, the interesting thing about purely linguistic intelligence, if you like, an LLM, is that you can solve almost any problem with it, but you solve it very inefficiently. Right. And then you gave the example of eating soup, which I thought was brilliant. Well, yeah, you could eat a bowl of soup with a fork. Slowly. You could. Slowly. There you go. Enough time, enough energy.

37:23You can solve math problem with language. Enough time, enough energy. And human intelligence is based on a tough world where you don't have enough time and you don't have enough energy. That's why we invented all these other languages to solve problems. It's a very important distinction. Plus we have a billion years testing ground to make it happen efficiently. Exactly. Because if we only got smart doing LLMs, we would have burnt our energy load hundreds of thousands of years ago. and we would have never gotten to where we are. Yeah, we'd have a lot of knowledge sitting in the dark. But that's an important point about why I don't like calling them intelligence because they're very capable.

38:09They can solve problems. But for human beings, you don't call someone intelligent just because they're capable. If I said, you know, Gary, could you pass me that glass of water and you got him, ran around the room 20 times and then gave it to me. we'd all say that's kind of weird what's Gary doing what's his problem he achieved the solved the problem right he gave me the water at the end he got the water and I think a lot of what they're doing now is getting up and running around the room 20 times and people are calling it intelligence because it solves the benchmark just call it Gary no just call it capability so that could implode because it could exceed our capacity to deliver the energy it needs to solve that problem.

38:53Exactly. So there could be an upper limit, a functional upper limit, short of tapping the sun directly, like we tap a keg. But see, if we were truly intelligent, if we were truly intelligent, then we would use this as a motivation to create that energy. No, I got a better answer. Go ahead. If the AI were truly intelligent, it would figure out how to do it with less energy. There it is. No, you're right. That's it. I got a mic drop. No, you got a mic drop there. What happened to my plastic mic? There it is. You dropped it. Okay. Wait, and mic drop. Mic drop. There you go. By the way, do you just carry around a microphone?

39:36No, I just have stuff in arm's reach in my office. You discuss things called complementary and competitive cognitive artifacts. There's way too many syllables. I didn't invent my fault. And where does AI sit in which column? Cognitive and... No, complementary and competitive. Cognitive, artificial. As two separate. Yes. Got it. So take us there. Okay. So this goes back, in fact, to a French philosopher, Henry Bergson, who debated relativity with Einstein, as you know, right in the 20s. But in 1907, he writes this book, Creative Evolution. And he says, we shouldn't be called homo sapiens, wise humans.

40:19which came from Linnaeus, we should be called homo faba, humans that make things, humans that make tools. And Bergson's whole theory was what makes humans different to the extent that we are is we not only make tools, but we make tools to make tools. True. Right? So that has been somewhat neglected in this discussion of intelligence, right? Because in some sense, you can't really think of human intelligence without thinking about painting, symbols, writing various kinds of calculating tools and artifacts. So that's the background, and that has its own development. Quick question. Yes, we have opposable thumbs.

41:00Yes, we make tools. Why should that alone distinguish anything when we don't know if whales had opposable thumbs, would they be making tools themselves? They just can't. But we do know that if we did not have opposable thumbs, we would make opposable thumbs so that we could make other stuff.

41:24I'm just saying... Are we in the we team? Just because they don't doesn't mean they wouldn't if they could. That's true. I mean... That's a good sense. And there's a lot of debate about this. I mean, there was a lot of early discussion, I remember, on language, which is whether or not the reason why other primates don't speak is there's some anatomical constraint. And if that wasn't in place, perhaps they would have evolved language. Oh, the position of the larynx. That sort of debate, exactly. Evolved to be in a lower position. Exactly, so breathing. It was a genetic mutation, basically, that enabled this.

41:57That's nature. So that's where it begins, right? This idea that humans make tools. So I got very interested in that idea. And there's archaeologist, French archaeologist, André Goulran, and he said, what are tools about? And he said, it's an additional memory system, is what he said. He said, we've got genetic memory, stored in our genomes. You've got learned memory stored in our brains. And you've got cultural memory stored in language, art, stuff. And so he actually argued, he went further than Bergson. He said to be anthropogenic is to be technogenic. He views them as indissoluble. Look at that.

42:37That somehow technology and humanity are kind of wrapped together in some way. So that's where I jump off with this kind of mathematical theory of tools. And the basic idea is that, right, there are tools which I call complementary, things that enhance our ability to reason, like a map. We talked about it last time. You might even have an abacus in here. Yes, there is an abacus in here. Yeah, somewhere. Okay, but that's a good example of what I call complementary. And it helps you reason. If you don't have it, as we know from studies of abacus schools, these kids can then do that calculation. Don't even need it.

43:17That's right. Don't even need it. It's in their head. So this is the key point. The abacus is a scaffolding for thinking better. Look at that. Right? So now in the competitive case, these are tools that don't scaffold anything. They replace it. So take a GPS versus a map. Interesting. So the idea is so you can develop this kind of theory. Oh, no. And it says that if you outsource completely, you lose the ability to... We're becoming dumber. and dumber. The smarter we become. The smarter we become, the more stupid we become. Yeah, because we're replacing the accrued knowledge. Oh, no. Wait, wait, wait, pause, pause for a second.

43:54What? I have to restate what you said just so I believe I understand it. In the case of the abacus, the abacus is a means to calculate and this becomes autonomic within me and then I do it, but the act of doing it is implicitly in reference to the abacus that trained me. Now, also, we have at least two or three generations of people still on earth who know how to read maps and they can translate what's on a map to where they are in the world. There are no maps anymore. It's just GPS barking at you, turn left, turn right, so up ahead on the right. and you're saying we are handicapping a generation of people who do not know how to read maps, even how to orient a map or what the legend is on a map.

44:50They have no idea. But why is that a bad thing? Okay, so it's interesting. So we've got... Did I get it right? Exactly right. Okay, okay. So we need more vocabulary here than just intelligence, right? So we have, let's just introduce some terms. One is capability. So using a GPS or using a map both make you capable. They both help you to navigate. No problem. So benchmarks on AI are testing capability. They can do it. They can calculate. They can solve problems. They can navigate. Good, right? So that's capability. Then there's competence. Different. Competence is, okay, give me the GPS. Now navigate.

45:29And that reveals dependence. And so what we're doing is we're moving into a world to when you say, does it matter? As long as you always have it. Yes. And you're not interested in competence, but only capability. Oh. Right. And the problem is that gives you wise to a world of total dependence on the provider of your capability. Correct. And that provider, who will not be named in this conversation because we know who they are, don't necessarily have our best interests in mind. Absolutely. So I went through this intellectually some years ago. I'm old enough to have, I think I'm older than you, to be formally trained, formally trained on a slide rule.

46:13Okay? It must have been the last year that happened because between that year and the next, the four-function calculator dropped in price from$200 to$40. So it became the price of like a textbook. And so thenceforth, they stopped teaching you the slide rule. And I got a slide rule here too. This was my high school slide rule. All right. Now there's a lot of sort of mathematical insights into the design of a slide rule. And you learn about logarithms implicitly. And then this is made of plastic. But earlier I have a vintage model. You know, this used to make these out of elephant tusk. And I think this is just wood.

46:58But anyhow, in my high school, you had a holster with your. And the bigger the slide rule, the more precise you can be in your measurements. So we'd be walking down the... This math class ain't big enough for the two of us. But here's my point. My intellectual challenge was, if I never see a slide rule again because a calculator renders it obsolete, what am I missing? and I said to myself, if I'm always near a calculator, I'm missing nothing. And let me move on to some other thing that requires my intellect to solve. So that was my coming of age to embrace a calculator and release the slide rule to the dustman of history.

47:50In fact, when Hewlett Packard made their first affordable calculator, all of the slide rule companies went out of business. The same year, 1973. Yeah, right. That's when that's it. That time. That's it. So there is something missing though. So right, so one possibility, it's a bit like vitamins, like vitamin C. You might say, you know what? I can't synthesize it myself, but it'll always be in the environment until you sail and get scurvy. So one possibility is we do find ourselves in a case or a situation where we don't have access to the technology and then we're useless because we've outsourced it all.

48:27apocalyptic earth. Well, just dumbass earth. No, you know, a power cut. A power cut, yeah. Doesn't take much. Okay. But the other one that's interesting is that the intuition that you built, which relates exponentials to multiplication and what the slide rule does, that kind of intuition that came out of using that is useful beyond solving that particular problem. Completely. And that's where it becomes deep for us because we don't know whether or not some of these things that we're learning by using these analog devices doesn't somehow diffuse into everything else we think about and develop a stronger intuition.

49:09And that's beyond losing the capability because there's a power cut. Okay, let's throw this forward. How many generations, if just one generation, will it take if we outsource all of these sort of capabilities to an AI for us to be as dumb as a rock? Yeah. So in the... That's a depressing question. It is. So I can tell you that in the mathematics, there's a key distinction to be made. And that is that if you learn first, let's just do it hypothetically, the slide rule, and then move to the calculator, your memory kind of helps you out. Yes. So if you take it away, you still have, in some sense, some intuition for how that works.

49:51But if you began with the calculator, That is, you never learn the logic behind the calculation, then you're lost. And I think what we're entering now is a world where all of these kinds of things are being outsourced. Being outsourced. And you'll never acquire the calculus. Here's what I found. I'm sorry, I was just going to say, it sounds to me like what you're saying is these analog devices are mapping onto our brain. That's what they are doing. Exactly. Whereas the other devices are replacing the brain and creating dependency. Because, not to get inside baseball here, but a slide rule implicitly trains you to think about what's called significant figures in a calculation.

50:36I think about that all the time, Neil. No, stop. I'm just saying. Significant figures. So you do this, and there's only a certain number of figures you carry with you into the next calculation. Is it 3.67894 or 3.68? Okay, because you can't carry that many decimals forward by this device. But it tells you that often those other decimals are not relevant to the major point of the calculation you're conducting. I saw someone do a calculation on the slide rule, and they somehow believed that all the digits that were returned on the calculator were important and wrote down every single digit without having a clue how irrelevant they were.

51:24And so that was just ignorance. It is. This idea, I think, I don't know if it was Bertrand Russell who said, so approximation is the supreme sophistication. learning when something matters and when it doesn't when these decimal places when you can think about powers of 10 or approximation is a part of our intelligence in graduate school we have a recurring it's like a seminar it's called back of the envelope universe right you just ask a question blunt questions like how many pianos are in the world how would you estimate that you say well how many have you seen how many people are they making more You don't have to know the exact number, but get an approximate number and know how to make approximations.

52:09If you don't know how to do that, you're a victim of false precision in the world, distracted by what you think is real, when in fact it's a distraction on your path to the truth. And this gets to a concept which I think is for humans as important as intelligence, and that is the notion of intelligibility. Not intelligence, but intelligibility, which is about understanding things. And that's the other point. If you're in the world of capability, prediction and utility are all that matters. In the human world, science is about making the universe and the world intelligible. We want to understand it.

52:49Different game. On that point, if we don't outsource the capabilities and we retain a large chunk of what intelligence we possibly do have. Wishful thinking. I know. Are we going to, at some point, solve the problems, the big problems, the universe, why, how, what? Are we going to get there, or are we just going to be clutching at thin air? If we fully outsource, you mean? Yeah, but if we retain, if we haven't outsourced completely, and if we retain some intelligence, do you think we're capable enough? Because you have said human intelligence potentially unlimited. Yeah, what do you mean by that?

53:26Okay. So this gets back to Bergson and the others on tool use. So humans are always hitting limits. I mean, Neil just talked about the slide rule. You can't do that with your fingers. And this gets to why we use tools. There are things we can't do. We build them. We understand how they work, and they solve problems that we couldn't in some raw state solve. So in that sense, an LLM, an AI, is just a tool like any other. And it's important to understand what kind of tool it is. because this tool is a tool that needs tons of data. Most of our tools don't. Good point. I don't have to feed the slide rule to get my answer.

54:07A little bit. And they're very good, and we can unpack this, at doing high-dimensional problems where lots of variables matter. So think about protein folding. It turns out protein folding, lots of variables matter. And so doing the molecular dynamics, the full computation. It's just too computationally expensive. And so LLMs come along, these models, actually, they're not LLMs, they're different kinds of networks, deep neural networks. And they're good at doing high-dimensional problems. And so they help us. So they do protein folding. And a lot of problems are going to turn out to require high-dimensional representation.

54:45Lots of variables matter. And they're going to help us solve the problem. Just to be clear, so everyone's on the same page, when you solve a problem, the number of variables can be thought of as a dimension, how many dimensions need to be accessed to get the solution. And multivariate problems require vastly more computing power. However, is that really intelligence or just brute force? Yeah, so tell me the difference between the AI solution to the protein folding. Previously, we had really powerful computers. give them the protein folding problem. What did the AI deep learning neural nets, what was that able to accomplish that just sheer computing power wasn't prior?

55:34So there's two factors here. One is, and I'm going to go a bit nerdy on you guys. Bring it on. Okay. We like it. This is a nerd safe space. Okay, I'm going to say it. Is that when you do these full physics simulations of a protein to get it to fold, So you're looking at all the bonds formed between all the atoms. This has something called a scaling relation, which is that the amount of computation increases non-linearly. It goes up quadratically. So double the size more than doubles the amount of computational effort. Now it turns out, because of some architectural feature of these AI models, when you increase the scale of a problem, it scales linearly.

56:17Ooh. It has a much more efficient scaling property, this architecture. So things that would not have been computationally feasible with the full physics become feasible with the deep neural net. That's a very important point. Well, that answers it right there. And that's basically the answer. That's AlphaFold III. These are AlphaFold. The Dennis Hedde Pacifist Company. We've had a couple of guys from there. Yeah, they were on the show. Now, the other factor, though, is not just the scaling, which is slightly more subtle. is that you can feed all sorts of different data into these models. So in the physics simulation, it's just the physics.

56:54But in the folding, it's not just the physics and chemistry, it's the evolutionary history. And so you can put all sorts of different data and drop it into these black boxes. And that's the second source of that advantage over physics. Wow.

57:21Whoever says saving money is hard doesn't know that new customers who bundle and save with Progressive save hundreds. Because switching your home and auto insurance is better than cutting down on things you love, like those iced lattes that help you get ready to face the day. So switch your home and auto to Progressive and see if you could save and keep sipping away. Get your quote today at Progressive.com. Progressive Casualty Insurance Company affiliates and other insurers. Not available in all states. A rug shouldn't just fit your room. It should make your home feel finished. Ernesta creates designer-quality rugs custom-fit to the exact size of your space, so every room feels beautifully pulled together.

58:02Explore Ernesta's range of options, all ready to be custom-cut, finished, and delivered to your door in as little as two weeks. Start with five samples for just$10 and get$50 toward your rug when you order. Visit Ernesta.com today. That's E-R-N-E-S-T-A dot com. I'm Serena Williams, and I'm healthier on Rho. I've lost 34 pounds in a year with GLP-1's diet and exercise. On Rho, you can access GLP-1 options, including the first FDA-approved GLP-1 pill for weight loss. Go to Rho.co slash journey to see if you qualify. 14 to 20 % average weight loss in one year in non-diabetics with obesity or overweight with a weight-related medical condition versus 2.2 % to 3.1 % in placebo R.

58:45Rx only. To stay informed about serious side effects, go to roe.co slash safety. I'm Brian Futterman, and I support StarTalk on Patreon. This is StarTalk with Neil deGrasse Tyson.

59:03Occasionally, I lose sleep. on this very thought. Are humans intelligent enough, however you want to define it, to completely understand the universe with no stone left unturned? And if we're not in the individual, in the collective, might we be? I don't have to invent calculus because Isaac Newton did. I stand on his shoulders. And we just keep ascending this ladder incrementally. can we incrementally become super intelligent? Or is this the work of an AI that can train on itself and then just bullet past all of us to contemplate the cosmos? So I think we already know that we have limits. I think the protein folding case gives us that answer, that there was no theory.

59:56Well, that was a scale problem. It was a scale problem. Not a, how deep is your thinking? But I would argue that all of our hardest problems are scale problems. And then let's give an example, because it relates to this concept of emergence. So we wouldn't have been able to do simulations of large numbers of particles unless we had fluid dynamics. So we found a way of making it more comprehensible. And we don't have to track every particle. To say that more precisely, the laws of fluid dynamics allow us to not have to track every single molecule of the fluid. We treat it in an ensemble, like the gas laws.

1:00:33The gas laws are blunt equations that describe pressure, temperature, volume of gas. We're not tracking what the particles are doing. In principle, if you did, you should get those formulas out. But we don't have to because we have the macroscopic description. So continue. Exactly. And most of human understanding, once we hit this barrier given by the lower level, in that case, particles, but you could be this case. It could be, I'm feeling unhappy or I love you. This is a macroscopic description. Very macroscopic. Of a very large chemical system inside my body, right? And that's what we do every time.

1:01:12And we consider that understanding, a form of understanding, right? Now, it turns out there are problems, like protein folding, that we couldn't do that. There was no macroscopic description. We had to worry about all the molecular interactions, you see. And so this particular tool helped us to solve the problem where there wasn't an emergent theory that would solve the problem. Okay, so now this is AI being our agent in that quest. It's not AI running amok, becoming a superintelligence on its own. No, that's right. It's AI as a tool to deal with irreducerably high-dimensional systems. Which I'd like to think our future relationship with AI is precisely that in every way that best serves us, not one where it becomes our overlord.

1:01:59In recent decades, there's been a lot of discussion, especially in modern astrophysics, from information theory. Is there a limit to how much information is in the universe? Can we somehow create more than that? Does that information go away? because the entropy seems to be a clock that we cannot stop. Would the universe approach this ever greater entropy in the future than it does in the present or in the past? Do any of your calculations touch on this? Yes. So two different ways. One is about the fundamental limits to computation, what gets called the thermodynamics of computation, and that takes us to quantum and all that.

1:02:41So right, there is a fundamental energetic limit. So that would be, the quantum computer would be, in principle, the most efficient computer we can conceive. Exactly. Whether or not we're there yet. Exactly. And then there's the other entropic limit, which is the cost of calculating with a classical von Neumann computer. The kind of computers that we all have are iPhones and so on. So we have these massive data centers. They're consuming megawatts of energy. Big gigawatts. Big gigawatts. they're boiling the planet all to make your emails better. But it's okay, because they're going to solve climate crisis.

1:03:23Eventually. This is fascinating. That's the whole thing in itself. Once they've melted the planet, for self-survival purposes, they're going to have to work out. But only then. It's not just being a co-pilot to your writing. So that's the other entropic problem. So again, I mean, a long story here. Can I just give a little narrative? I think it's a useful historical one. You're the guest. Okay. So try to make sense of what is going on in the current moment in terms of these kind of energy-guzzling AIs. There's a useful comparison to the Industrial Revolution and to ecology. So most of the history of life is predator and prey.

1:04:06That is how energy got transferred. You ate something. in parallel in the Carboniferous period and the Mesozoic period back there hundreds of millions of years ago fossil deposits are being left in the earth becoming coal seams becoming petroleum and natural gas and that energy is not accessible to us just there then the industrial revolution happens and we get steam engines and they get more and more efficient and what steam engines do is they liberate all of this energy that was buried in the earth. Just to be precise, only when they discovered coal could do that. Exactly. Beautiful, clean coal.

1:04:50You can't beat it. Otherwise you just burn wood. That's right. Vastly less efficient. Yes, the energy packing capacity of wood versus coal is no contest. No contest. I think the calculation is you could burn all of the standing forests of the world and provide enough energy for the current population for six months. Wow. That's it. That's pretty serious. That's it. And by the way, before we knew about thermonuclear fusion, we said, well... It's a hoax. No. The sun, you know, the sun is like really efficient. And we knew there's a lot of carbon in the universe. It must be a lump of coal. It must be a big lump of coal.

1:05:28Because it was efficient and it could go a long time. That was our first calculations where maybe the sun is made of coal. Man, somebody should tell our president at that right now and maybe we'd get to renewable fuels. Continue, I interrupted. Yeah, so, right. So we discovered super energy-dense, power-dense materials. Power means you could liberate it fast, like in a nuclear reaction. Okay. So the world changed. It went from being networks of predators and prey, highly constrained by interaction, to all of a sudden this massive high-energy-dense archive that we could access. Okay. That's the energy world.

1:06:04So let's talk about the information world. Nearly all the information we have, we get from talking like this. It's a bit like ecology. Predators and prey, right? It's like, oh, I'm going to tell you a fact. You could read a book. Problem is with reading books, you read like, I don't know, maybe 250 words a minute. Over your lifetime, if you're lucky, you read a few thousand books. That's how it works. So what happens? So a thousand books, let's use the number thousand books. So just like in the Cambrian, right? or the Carboniferous rather, and in the Mesozoic, where fossils were being deposited in the earth, we've been depositing texts in libraries, starting in ancient Summa all the way to the present.

1:06:43So we have now order hundreds of millions of books deposited. And it's mostly in the present. Mostly in the present. The rate of book publication has grown exponentially over the decades. Yes. Yeah, okay. However, the knowledge also covers all of our past because we've discovered our past in the present and deposited that information in the depositories you're talking about. Exactly, but here's the thing. So this is why the LLM is interesting. The LLM is like the steam engine. I see where you're going. Because what happened is - It's mining. It's mining, exactly. It's liberating that energy, which is our literature, which is our language, which is our thoughts and cultures and everything that we are, all in one depository, that it can now go in the same way we went in and dug for coal.

1:07:33It can go in and get all of that very, very quickly and turn it into power. Exactly. Wow. Exactly. But this time, conceptual power. Right. Mechanical power. Exactly. So there's this strict analogy between, if you like, the fossil deposit and, as you say, the cultural deposit. The steam engine liberated the energy deposit. The transformer architecture liberated the conceptual deposit. Look at that. Now, both of them produce what economists call euphemistically externalities. In other words, they pollute. So that's the problem with the Industrial Revolution. It produces smogs. It generated a huge amount of entropy in the environment just as these data centers and transformers are producing a huge amount of entropy in the environment.

1:08:20So there's this very interesting parallel. And wait a minute. And the culture. Look at that. they're creating entropy not only in the environment, but they're creating entropy in the culture itself. Yes. Wow. Yes. So that's a really interesting point. In the conceptual space, the disorder is not just thermal, it's knowledge-based. Yes. It's basically crap. No, it's misinformation. No, we call it AI slop. Yeah, look at that. So there's a very weird thing going on here. Just to be clear, in the Industrial Revolution, not all coal or oil deposits were equally as refined. Equally, I mean, different sources of oil in the world are not as good.

1:09:04It's not a uniform. It's not a uniform deposit. No, correct. No, you're absolutely, you have light sweet crude, you have tar sands, you have, yeah, go ahead. Now look what happened. So we created, so out of, you know, the Pennsylvanian, out of these deposits, come all the big corporations of another era of BP, Shell. And the steel companies that use the coal. Exactly. So now what's happening? U.S. Steel. Well, we have our analogs. We have Anthropic. We have OpenAI. These are the mining companies of our time. Look at that. Right? Generating the kind of entropy that you were discussing. Yeah. Now, what's weird here that is worth discussing is that coal is depleted, natural gas is depleted, but in principle, knowledge is not.

1:09:54Right? But there's a difference, which is that we can foul that knowledge with the entropy in concept space. Right. That's your point. Now, you could have done that with coal deposits, but it would be difficult. Yeah, and why would you? Why would you? Right, right, right. But now, unfortunately, we can take this knowledge, synthesize it, and put back crap. Right. So it's different and similar in rather interesting ways. Well, is the crap because it doesn't know how to do it, or is the crap because so much of what we do have in the library is just horseshit? I mean, just because it's a book doesn't mean it is correct or even contributes to the greater good of us all.

1:10:37And the LLM doesn't know that because it's not trained at a university to be able to sift the wheat from the chaff. It's just words statistically associated with other words and outcomes. It's a probabilistic aggregation. Oh, I like that. But the difference is the crap that's in our libraries is an example to us of our journey and how we got to where we are. So they become guardrails so that these are the mistakes, the thoughts, the things that we know, that is horse crap. Whereas the LLM, if we didn't know those things, it would give us that and we'd just say, oh, here we are. Wait a minute. If I say, what should I do with a witch?

1:11:25It goes back and finds all the literature on what you do with witches. Which witches? You should obviously burn them. Burn them. And this is how you burn them. Right. Whereas when you go to the library, you find out, oh, The witch trials were an attack on women. Tell me about context. Well, this is, I've been working on papers on mathematical ability in these machines based on this notion of the chronology of the development of the concept. So one really important difference between humans and these things is that we learn at school using a curriculum, right? You typically learn what a number is before you learn a natural number or an integer, before you learn a fraction.

1:12:09And then you learn fractions typically before you learn pi, real numbers. And you learn that typically before you learn algebraic geometry or group theory or something more refined. So there is a sequence. It's understood we learn incrementally using a curriculum. These models learned everything all at once. There is no curriculum. Another question is, what does that mean for how we do math and they do math? And it means lots of things for how we do math and they do math. And one of the things it means is this, which is that they basically find very complicated, what we would call heuristics, rules of thumb, approximations actually, for solving problems that we solve exactly using algorithms.

1:12:53Let me make that explicit. So when I learned how to do long division, right, Assuming as I did it right, I'd get the right answer. You have to learn how to do it right, but it'll always be right regardless of the scale. The current best models, LLMs, will not get it right regardless of the scale, guaranteed. They'll get it wrong at large scale. Long division. They'll get long division wrong at large scale if you have too many digits because they're using heuristics. And so part of our training was to learn these rules piecewise through a curriculum. Their mode of learning is giving rise to a situation where despite the fact they look great, at large scales, they're going to confabulate and make wrong answers.

1:13:38And we're not going to be smart enough because we've outsourced them to know the difference. Well, this is what Geoffrey Hinton was saying, that they're overconfident. Yes. So they're expecting now us to just take that for granted as the answer. Yeah, I always loved Douglas Adams, Hitchhiker's Guide to the Galaxy. and they build this supercomputer and they ask it, what's the meaning of life, the universe and everything? What's the answer? And the answer is 42. Yeah. And you think, what does that mean? What's it mean? We are now in a world where we could be told that 42 is the answer and we wouldn't know what it meant.

1:14:11We wouldn't know it, right. Do you think the universe will allow a super intelligence to be created, to evolve and therefore solve the mystery of the universe and hopefully it's not 42? And that presumably would be an alien somewhere. Yeah. So we... So I have problems with the concept of superintelligence, I should just say. If you buy my definition, which is making hard problems easy, it's not clear to me that the path we're on now is about making hard problems easy. I think it's about solving some hard problems, but doing it in a very convoluted way, which I do not consider superintelligence.

1:14:49That's number one. In terms of... I subscribe to the idea of kind of universal Darwinism. Now, I do mean universal. Granted. You need permission, and I just gave you permission. I'm just saying, and that in most life forms, however different they would be, would be living under conditions of scarcity. That's sort of prerequisite for evolution in the theory, actually, because to compete for scarce resources. And so, oddly enough, they will look more like us in their intelligence then they might look like LLMs. Now it could be that that alien intelligence is all that's left once those AIs have devoured the life forms that built them in which case they will be more like LLMs.

1:15:34But I think it's an important point to note that under the conditions that evolution takes place you want to be intelligent by having a small amount of data and quite restricted experience for the world and making a decision relatively quickly so that it actually enhances your survival. And not using megawatts of energy to come to the solution. So we can imagine a planet where the environment shifts with some frequency. Let's say you could program this so that you're always forcing an evolutionary change. The organism never stays happy. It finally settles in. You give it some assault. Make sure you don't kill them all.

1:16:21because that's what happens most of the time, but there's some portal that it can move through and start evolving. Is it inevitable that that will lead to what we call intelligence? Or just more appendages or more senses or more, does that give us the super intelligence that we're thinking, the biological super intelligence? So the open question is why we didn't just stay bacterial. That worked pretty well. They outnumber us. It still works. Still working, and we're dependent on it. Yeah. And the way to think about this is that there is a fundamental limit to how information can be acquired by an evolutionary process.

1:17:04Because a mathematical theory tells us that you can only put one bit of information into a genome every generation. And as you get bigger, you get more energetically efficient, but your generation time gets longer. so at large scales it takes more and more time to get a bit by selection into the genome why? because the way bits get put into life forms is through differential survival so imagine you had to learn but why is it only one bit? why can't it be a suite of bits? yeah because selection would get confused about which bit it put in it would be confused about which bit was important for the survival exactly got it So for it to know the difference, it has to be one-only.

1:17:50So it's like a brick at a time, basically. Brick at a time. It's a brick at a time. So when you're very small, like a microbe, a brick at a time can be fast. But as you get bigger and longer lived, that's slow. So what did we do? We evolved brains. So brains can add bits more quickly than genomes can add bits. That's why we have brains. So there's two things going on. We get bigger to get more efficient energetically. but it makes us slower evolving, which makes us have to have brains to pull information from the world when the world changes. So there is a kind of underlying ratchet towards what we would call higher complexity and therefore towards greater intelligence.

1:18:33Wow. That's great though, because that means out there somewhere is probably another intelligence along the same track as we, but maybe there's a variable that they didn't encounter that keeps them from killing each other, destroying cultures and enslaving one another and all of these stupid things that we do. And maybe they're just so much more advanced because they don't retard their own advancement. Although everything he said about a species moving through derives from, in most cases, competition. And that's competition. is what creates that other stuff that I was just... And that's our reptilian brain.

1:19:20Goddammit! Goddammit! You were onto something for a little bit there. I've never had something! So... Well, it does make it sound like there's some kind of plan. Plan? Yeah, rather than it's just random occurrence. Plan? Some kind of... Well, there are trends. You could say there are trends in evolution. I mean, the question to your observation, Chuck, is at this point where we could transcend the competitive basis of evolution by building AI, could we? That's the way. Could we? That's the pathway. That's the pathway. Unfortunately, it's not what we're doing. It's not what we're doing. Right. Man, this is, whew.

1:20:09I tell you, it's so much easier to tell dick jokes. Okay. Probably not. Probably not. One last point. How long have you been at the Santa Fe Institute? About 20 years. Oh, that's a long time. It is a long time. A big part of your career. It is a big part. It is my career. And they're famous or infamous for... Yeah, famous. You didn't hear what I was about to say. For dangling people at the edge of what is known and exploring places that are just, on the surface, crazy sounding. but might be something profound. So that's still kind of an operating principle? Yeah, I think the history of science is risk, and then it got institutionalized.

1:20:54Yeah. And it became a bureaucracy that was enforcing norms. And SFI wants to be heterodox. SFI, the Santa Fe Institute. And that's a different environment. To be in a high-risk environment is a little bit going back to the time of early science. I was about to say, you're just taking it back to when science was kind of the Wild West and people were just like, hey. Try this. We should do this. Try this. Smell that. Smell that. Poke that. Right. Exactly. And so that sounds like it could be quite fertile for people on the frontier with powerful imaginations for what could be true. Yeah, I mean, I think now, because of all these tools that are solving technical problems, what we have to cultivate is amazing question askers.

1:21:47That is what remains for humans, right? Because it's like, you don't need to be good at arithmetic once you've got a calculator. Probably don't have to be good at calculus anymore, but you have to be able to ask good questions. And that environment is something different. So on that point, let's land this plane on a quote from a poem by the German poet Rainer Maria Rilke. I think I'm pronouncing it right now. Okay. Here it goes. As quoted in my alien book, Take Me to Your Leader. Be patient toward all that is unsolved in your heart and try to love the questions themselves. That's a great quote.

1:22:31Yes. That's beautiful. And right after that, she said, we have ways of making you talk.

1:22:42You couldn't help us. Professor, thank you. Thank you so much. Thank you for yet another tour of duty on StarTalk. Yeah, it's wonderful to be with you guys. Yeah, too much. Too much to think about. Now we got to think about it. I can't even. I'm out for two months now. How do we find you? Are you online? Oh, you find me. You find me at the Santa Fe Institute. You can find me at davidccracauer.com. There you go. Okay. Find me anywhere. Just keep up with you, because you're doing fun, interesting things. Thank you. And I have a special appreciation for your evolutionary biology background, because I work here as an astrophysicist in a museum famous for its evolutionary biology.

1:23:24And so I have an extra little osmotic attachment to your... Well, thank you. It's wonderful being with you guys. To your work. Your people keep him working. Chuck. Always a pleasure. We're good here. Gary. Pleasure, my friend. All right. This has been another installment of StarTalk Special Edition. And we're going to call this the intelligence installment. Are we or are we not? Until next time, keep looking up.

1:24:04Talk about regrets. We all know someone who's been in a car accident and said, I don't need to call a lawyer, only to regret it after their pain and damages were worse than expected. When someone hurts you, you deserve to be compensated fairly. Morgan & Morgan is America's largest injury law firm, fighting for the people for over 35 years. Injured? Visit forthepeople.com slash podcast. That's forthepeople.com slash podcast. Their fee is free unless they win. The real cost of a break-in isn't your valuables. It's the feeling that your home stopped being safe. SimpliSafe keeps danger away from your family with three layers of protection.

1:24:38One, smart AI cameras and live U.S.-based agents help stop intruders before they break in. Two, we sound the alarm at points of entry. Three, our agents request emergency response. Plan starting around a dollar a day. Right now, get 60 % off your new system with professional monitoring at simplisafe.com. Outdoor deterrence plans start at$49.99 a month. Visit simplisafe.com slash licenses for alarm license information.

From the publisher

Why did intelligence evolve in the universe? Neil deGrasse Tyson, Chuck Nice, and Gary O’Reilly explore the nature of intelligence, information theory, consciousness, and whether AI is actually intelligent at all with David Krakauer, evolutionary biologist and president of the Santa Fe Institute.

NOTE: StarTalk+ Patrons can listen to this entire episode commercial-free here: 
https://startalkmedia.com/show/what-is-intelligence-with-david-krakauer/

Thanks to our Patrons Vipin Sharma, Saahith, Matthew Rapp, Billy Durr, Gail Lena Martin, Mads Holm, Mothman’s Coroner, Nicholas Strang, Cirwintech - Christopher M. Irwin, Jacqueline West, Casey Gatti, Clem Carlos Schermann, Samuel Jeffman, John Lasher, Shelley Collett, Aerimis, Anthony Schneider, Lolo, Mark M., kegler718, Hayden Scheibe, J Miller, Mark Ulibarri, Mandy Lauber, John McQuiston, Don, Olivier d'Entremont, Shaun Carter, Andres Chavez, Joshua Perks, JonRueben Bubar, Marlin Mark, Michael Lee, Ash Morris, Nate, Bobby Williams, DeborahD, Ciprian Bobe, David Bailey, Boop Doop, Amirali Rabiee, jessie miller, Liva Apse, Jesse, NATE LUKAS, Chris Archer, Keith H., and Huchel for supporting us this week.

Subscribe to SiriusXM Podcasts+ to listen to new episodes of StarTalk Radio ad-free and a whole week early.
Start a free trial now on Apple Podcasts or by visiting siriusxm.com/podcastsplus.


Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

More from StarTalk with Neil deGrasse Tyson

All episodes