#150 — The Map of Misunderstanding (From the Archive)

0:01Sam Harris:You're listening to Making Sense with Sam Harris. This is the free version of the podcast, so you'll only hear the first part of today's conversation. If you want the full episode and every episode, you can subscribe at samharris.org. There are no ads on this show. It runs entirely on subscriber support. If you enjoy what we're doing here and find it valuable, please consider subscribing today. Welcome to the Making Sense podcast. I'm Kirby Ferguson, producer here at the show. Sam is on vacation this week, so we are reaching into the archive and bringing back one of our favorite episodes. This is Sam's conversation with the Nobel Prize winning psychologist Daniel Kahneman, who passed in 2024.

0:40Sam Harris:It's a timeless conversation and actually one of our funnier episodes. If you've heard it before, it rewards a second listen. Sam will be back next week with a new episode. For now, enjoy the Map of Misunderstanding.

0:57Sam Harris:Okay, well today I'm bringing you the audio from my live event with Danny Kahneman at the Beacon Theater in New York. This was a sold-out event in a very cool old theater. I'd actually never been to the Beacon before, but it has a storied history in music and comedy. Anyway, it was a great pleasure to share the stage with Danny. Daniel Kahneman, as you may know, is an emeritus professor of psychology at Princeton University and also an emeritus professor of public affairs at Princeton's Woodrow Wilson School of Public and International Affairs. He received the Nobel Prize in Economics in 2002 for the work he did on decision-making under uncertainty with Amos Tversky.

1:41Sam Harris:Unfortunately, Tversky died in 1996, and he was a legendary figure who would have certainly shared the Nobel Prize with Danny had he lived longer. They don't give the Nobel posthumously. In any case, I think it's uncontroversial to say that Danny has been the most influential living psychologist for many years now, but he's perhaps best known in the general public for his book Thinking Fast and Slow, which summarizes much of the work he did with Tversky. Michael Lewis also recently wrote a biography of the Kahneman-Tversky collaboration, and that is called The Undoing Project. Anyway, Danny and I covered a lot of ground at the Beacon.

2:23Sam Harris:We discussed the replication crisis in science, systems one and two, which is to say automatic and unconscious cognitive processes, and more conscious and deliberative ones. We talk about the failure of intuition, even expert intuitions, the power of framing, moral illusions, anticipated regret, the asymmetry between threats and opportunities, the utility of worrying, removing obstacles to wanted behaviors, the remembering self versus the experiencing self, improving the quality of gossip, and many other topics. Anyway, Danny has a fascinating mind, and I think you'll find this a very good introduction to his thinking.

3:12Sam Harris:Of course, if you want more, his book Thinking Fast and slow also awaits you if you haven't read it. And now I bring you Daniel Kahneman.

3:29Sam Harris:That's unusual.

3:35Sam Harris:Well, well, thank you all for coming. Really an honor to be here. Danny, it's a special honor to be here with you. So thank you for coming. My pleasure.

3:49Sam Harris:It is it's it's often said and rarely true that a guest needs no introduction. But in your case, that is it's virtually true. We're going to talk about your work throughout. So people will if they if for the one person who doesn't know who you are, you will understand at the at the end of the hour. But I guess by way of introduction, I just want to ask. But what is the worst thing about winning the Nobel Prize? that's a hard question actually there weren't many downsides to it okay well nobody wants to hear your problems Dan

4:30Sam Harris:so how would you how do you think about your body of work how do you summarize the intellectual problems you have tried to get your hands around you know it's been just a series of problems that occurred that I worked on. There was no big program. When you look back, of course, I mean, you see patterns and you see ideas that have been with you for a long time, but there was really no plan. I was, you know, you follow, you follow things, you follow ideas, you follow things that you take a fancy to. Really, that's a story of my intellectual life. It's just one thing after another. Judging from the outside, it seems to me that you have told us much of what we now think we know about cognitive bias and cognitive illusion.

5:19Sam Harris:And really, the picture is of human ignorance having a kind of structure. It's not just that we get things wrong. We get things reliably wrong. And because of that, whole groups, markets, societies can get things wrong because the errors don't cancel themselves out. I mean, bias becomes systematic. And that obviously has implications that touch more or less everything we care about. Let's just, I want to track through your work as presented in your now famous and well-read book, Thinking Fast and Slow. And I just want to try to tease out what should be significant for all of us at this moment, because human unreason, unfortunately, becomes more and more relevant, it seems, and we don't get over these problems.

6:08Sam Harris:And I guess I wanted just to begin to ask you about a problem that's very close to home now, what is called the replication crisis or reproducibility crisis in science, in particular social sciences and in particular psychology. And for those in the room who are not aware of what has happened and how dire this seems, it seems that when you go back to even some of the most celebrated studies in psychology, their reproducibility is on the order of 50-60 % in the best case. So there was one study done that took 21 papers from Nature and Science, which are the most highly regarded journals, and reproduced only 13 of them.

6:52Sam Harris:And so let's talk about the problem we faced in even doing science in the first place. Well, I mean, you know, the key problem and the reason that this happens is that research is extensive and it's extensive personally and it's extensive in terms of money. And so you want it to succeed. So when you're a researcher, you know what you want to find. And that creates biases that you're not fully aware of. And I think a lot of this is simply self-delusion. That is, you know, there is a concept that's known as p-hacking, which is people very honestly deluding themselves about what they find. And there are several tricks of the trade that people know about them.

7:40You are going to do an experiment. So instead of having one dependent variable where you predict the outcome, you take two dependent variables. And then if one of them doesn't work, you stay with the one that doesn't work. You do that and things like that a few times, then it's almost guaranteed that your research will not be replicable. And that happens, it was first discovered in medicine. I mean, it's more important in medicine than it is in psychology, where somebody famously said that most published research in medicine is false. And a fair amount of published psychological research is false, too.

8:19Sam Harris:Yeah, but even some of the most celebrated results in psychology, like priming and the marshmallow test and... Well, yeah, I mean, it's not only... It's actually, they get celebrated in part because they're surprising. Yeah. And the rule is, you know, the more surprising the result is, the less likely it is to be true. So that's how celebrated results get to be non-replicable. Right. Well, and the scariest thing I heard, I don't know how robust this study was, but someone did a study on trying to replicate unpublished studies and found they replicated better than published studies. Did you hear this?

9:01Sam Harris:I don't think that's replicable. Oh, yeah. Okay, yeah. Let's hope not. Let's talk about system one and two. These are the structures that give us so much of our, what can be a dispiriting picture of human rationality. Summarize for us, what are these two systems you talk about? I mean, before starting with anything else, there are clearly two ways that ideas come to mind. I mean, so if I say two plus two, then an idea comes to your mind. You haven't asked for it. You're completely passive, basically. Something happens in your memory. If I ask you to multiply, you know, 24 by 17 or something like that, you have to work to get that idea.

9:44So it's that dichotomy between the associative effortless and the effortful. And that is phenomenologically obvious. You start from there. And how you describe it and whether you choose to describe it in terms of systems, as I did, or in other terms, that's already a theoretical choice. And in my view, theory is less important than the basic observation of, you know, that there are two ways for ideas to come to mind. And then you have to describe it in a way that could be useful. And what I mean by that is you have to describe the phenomena in a way that will cause, help researchers have good ideas about facts and about experiments to run.

10:33And the system one and system two was, it's not my dichotomy and even not my terminology. And in fact, it's a terminology that many people object to, but I chose it quite deliberately.

10:47Sam Harris:What are the liabilities? Because people, In your book, you try to guard against various misunderstandings of this. Well, yes. I mean, you know, there is a rule that you're taught fairly early in psychology, which is never to invoke what is called homunculi, which are little people in your head whose behavior explain your behavior or explain the behavior of people. That's a no-no. And system one and system two are really homunculi. So I knew what I was doing when I picked those. but the reason I did was that system one and system two are agents they have personalities and it turns out that the mind is very good at forming pictures and images of agents that have intentions and propensities and traits and they're active and it's just easy to get your mind around that and that's why I picked that terminology which many people find sort of objectionable because they are really not agents in the head.

11:50It's just a very useful way to think about it, I think.

11:53Sam Harris:So there's no analogy to be drawn between a classical, psychological, even Freudian picture of the conscious and the unconscious. How do you think about consciousness and everything that precedes it? I mean, you know, it's clearly related in the sense that what I call system one activities, the automatic ones, one characteristic they have is that you're completely unconscious of the process that produces them. You just get, you know, you get the results. You get four when you hear two plus two. In system two activities, you're often conscious of the process. You know what you're doing when you're calculating.

12:32You know what you're doing when you're searching for something in memory. So clearly consciousness and system two tend to go together. It's not a perfect, and who knows what consciousness is anyway, but they tend to go together and system one is much more likely to be unconscious and automatic.

12:53Sam Harris:Neither system is a perfect guide toward tracking reality, but system one is very effective in many cases. Otherwise it wouldn't have evolved the way it has. But I guess maybe let's start with a picture of where our intuitions are reliable and where they reliably fail. How do you think about the utility of intuition? I'll say first about system one, that our representation of the world, most of what we know about the world, is in system one. We're not aware of it. So that we're going along in life with producing expectations or being surprised or not being surprised by what happens. All of this is automatic.

13:35We're not aware of it. So most of our thinking, system one thinking, most of it goes on in our mind, goes on and we're not aware of it. So that's, and intuition is defined as, you know, knowing or rather thinking that you know something without knowing why you know it or without knowing where it comes from. And it's fairly clear, actually, I mean, that's a digression, but there is a guy named Gary Klein, a psychologist, who really doesn't like anything that I do.

14:06Sam Harris:and he How does your system one feel about that? I like Gary a lot actually so but he believes in intuition and in expert intuition and he's a great believer and he has beautiful data showing beautiful observations of expert intuition so he and I I invited him actually to try and figure out our differences because obviously I'm a skeptic so where intuition marvelous and where is it flawed? And we worked for six years before we came up with something and we published an article called The Failure to Disagree because, in fact, there is a fairly clear boundary about when you can trust your intuitions and when you can't.

14:53And I think that's summarized in three conditions. The first one is the world has to be regular enough. I mean, First of all, intuition is recognition. And that's how Herbert Simon said that. You have an intuition, it's just like recognizing, you know, that it's like a child recognizing what a dog is. It's immediate. Now, in order to recognize patterns and reality, which is what true intuitions are, the world has to be regular enough so that there are regularities to be picked up. then you have to have enough exposure to those regularities to have a chance to learn them. And third, it turns out that intuition depends critically on the time between when you're making a guess and a judgment and when you get feedback about it.

15:44The feedback has to be rapid. And if those three conditions are satisfied, then eventually people develop intuition so that chess players, chess is a prime example where all three conditions are satisfied. So after, you know, many hours, I don't know, 10 ,000 or not, but many hours, a chess player will have intuitions. All the ideas, all the moves that come to his or her mind are going to be strong moves. That's intuition.

16:13Sam Harris:Right. So the picture is one of intuition. I mean, they're intuitions that are more innate than others. We're so primed to learn certain things innately that no one remembers learning these things, you know, recognizing a human face, say. But much of what you're calling intuition was at one point learned. So intuition is trainable. There are experts in various domains, chess being a very clear one, that develop what we consider to be expert intuitions. And yet much of the story of the blind spots in our rationality is a story of the failure of expert intuition. So where do you see the frontier of trainability here?

16:56I mean, I think that what happens is that when those conditions are not satisfied, people have intuitions too. That is, you know, they have ideas that come to their mind with high confidence and they think they're right. And so the main thing...

17:12Sam Harris:I've met these people. Yeah, I mean, you know, we've all met them and we see them in the mirror and, you know, that's... So it turns out you can have intuition for bad reasons. So all it takes is a thought that comes to your mind automatically and with high confidence, and you'll think that it's an intuition, and you'll trust it. But the correlation between confidence and accuracy is not high. That's one of the saddest things about the human condition. You can be very confident in ideas and the correlation. You shouldn't trust your confidence. Well, so that's just, you know, yes, a depressing but fascinating fact that the signature of a high probability that you are correct is what you feel while uttering that sentence.

18:06Sam Harris:I mean, psychologically, confidence is the marker of your credence in whatever proposition it is you're entertaining. And yet we know they can become totally uncoupled and often are uncoupled. Given what you know or think you know scientifically, how much of that bleeds back into your life and changes your epistemic attitude? My personal level. Do you hedge your bet? How is Danny Kahneman different given what he has understood about science? Not at all. Not at all? I mean, it's even more depressing than I thought. You know, in terms of, you know, my intuition's better than being better than they were, no.

18:48And furthermore, I have to confess, I'm also very overconfident. So even that I haven't learned. So it's hard to get rid of those things.

18:57Sam Harris:You're just issuing a long string of apologies? I mean, how do you get through life? Because you should know better. If anyone should know better, you should know better. Yeah, but I don't really feel guilty about it. So how hopeful are you that we can improve? How hopeful are you that an individual can improve? And how hopeful are you that we can design systems of conversation and incentives that can make some future generation find us more or less unrecognizable in our stupidity? Well, you know, I should preface by saying that I'm not an optimist in general, but I'm certainly not an optimist about those questions.

19:39I don't think that, you know, I'm a case study because I've been studying that stuff for more than 50 years, and I don't think that my intuitions have really significantly improved. I can catch sometimes, and that's important, I can catch, recognize a situation as one in which I'm likely to be making a mistake. And this is the way that people protect themselves against visual illusions. You can see the illusions, and there's no way you can not see it. But you can recognize that this is likely to be an illusion, so don't trust my eyes, take out the ruler. There is an equivalent, you know, there is a similar thing goes on with cognitive illusions.

20:22Sometimes you know that your intuitions, your confident thought is unlikely to be true. That's quite rare. It doesn't happen a lot. I don't think that I've become, you know, in any significant way smarter because of studying errors of cognition.

20:40Sam Harris:Right. Okay. Let me just absorb that for a second. I would get what you must thirst for on some levels that this understanding of ourselves can be made useful or more useful than it is because the consequences are absolutely dire. Our decision-making is, one could argue, the most important thing on Earth, certainly with respect to human well-being. How we negotiate nuclear test ban treaties, everything from that on down, this is all human conversation, human intuition, errors of judgment, pretensions of knowledge, and sometimes we get it right. And the delta there is extraordinarily consequential.

21:27Sam Harris:So if I told you that we, over the course of the next 30 years, made astonishing progress on this front, right? So that we, our generation, looks like, you know, bumbling medieval characters compared to what our children or grandchildren begin to see as a new norm. How did we get there? You don't get there. You know, I mean, that's, you know, it's the same as if you told me, will our perceptual system be very different in 60 years? And I don't think so. Let's take one of these biases or sources of bias that you have found. The power of framing, right? We know that if you frame a problem in terms of loss or you frame the same problem in terms of gains, you get a very different set of preferences from people because people are so averse to loss.

22:18Sam Harris:So the knowledge of that fact, let's say you're a surgeon, right? And you're recommending or at least, you know, proffering a surgery for a condition to your patients who you have a, you know, you have taken a Hippocratic oath to do no harm. And you know, because you read Danny Kahneman's book, that if you put the possibility of outcome in terms of mortality rates versus survival rates, you are going to be moving several dials in your patient's head one way or the other reliably. Can you conceive of us ever agreeing that there's a right answer there, like in terms of what is the ethical duty to frame this correctly?

22:56Sam Harris:Is there a correct framing or are we just going to keep rolling the dice? Well, I mean, this is a lot of questions at once. In the first place, you know, when you're talking about framing, the person who is subject to the framing, so you had a surgeon framing something for a patient, first of all, the patient is going to be completely unaware of the fact that there is an alternative frame. That's why it works. It works because you see one thing and you accept the formulation as it is given. So that's why framing works. Now, whether there is a true or not true answer, so I should, let me mention the sort of the canonical problem, which actually my late colleague Amos Sversky invented.

23:47So in one formulation, you have a choice between, well, there is a disease that's going to cause 600 deaths unless something is done. And you have your choice between saving 400 people or a two-third probability of saving 600. Or alternatively, other people get the other framing that you have a choice between killing 200 people for sure and not allowing them to die and a one-third probability that 600 people will die. Is there a correct answer? Is there a correct frame? Now, the interesting thing is people, depending on which frame you presented to them, they make very different choices. But now you confront them with the fact that here you've been inconsistent.