In short
VR and learning; why reading is a weak way to learn; decision-making biases (sunk cost, escalation of commitment, status quo bias, “tomorrow is like yesterday”); and Sendhil Mullainathan’s learning app PEEQ that turns behavioral-econ books into interactive experiences.
Guest backgrounds
Sendhil Mullainathan is a world-class economist, a MacArthur “genius” recipient, and a University of Chicago professor (a rare endowed title). He has researched topics including racial bias, AI algorithms, poverty’s psychological effects, CEO pay, corruption, and driver’s-license allocation in India. He also worked as a research lead at the Consumer Financial Protection Bureau during the Obama administration.
Key claims
VR can make “bring the place to you” experiences that improve science and education; play and tinkering build adoption. Memory is fallible and can be tricked (e.g., false recall of “sleep”). Learning improves when it’s experiential, not passive reading. People avoid feedback and resist admitting ignorance, harming experimentation.
Notable examples
Oculus/VR classroom use; a “$20 bill” auction showing sunk cost/escalation; a coin-flip job/relationship experiment (~20,000 participants); Proust’s madeleine and salience; a word-list memory test (dream vs sleep); “Jurassic Park” VR dinosaur tail causing reflexive ducking.
Written by AI. May contain mistakes. Listen to the episode to check what was said.
Chapters
Tap a time to open that second in VOExcitement Over Oculus VR
1:24 to 2:00
Discussion on the impact of Oculus VR on education and personal experiences.
“His mix of brilliance and childlike curiosity make him unlike anyone I've ever known.”
The Future of Work and Virtual Reality
2:00 to 5:40
Exploration of virtual reality's potential to change how we work and interact.
“Lots of people are interesting if you only talk to them once a year, but not many people can make everyday conversation fascinating.”
The Nature of Memory and Learning
5:40 to 7:54
Insights into how memory works and the effectiveness of experiential learning.
“And the same is true of Feynman diagrams, et cetera.”
Personal Anecdotes on Learning
7:54 to 11:48
Discussion on personal experiences with learning and memory recall.
“This is going to seem off point, but about 20 years ago in a seminar, you said something, Sandal, and I remember virtually nothing from 20 years ago.”
The Psychology of Memory and Attention
11:48 to 14:00
Exploring how attention and salience affect memory retention.
“So that's at the heart of this app that we're releasing that I want to tell you about in a second.”
Understanding Auction Dynamics and Sunk Cost Fallacy
14:00 to 25:26
Learn about auction dynamics and how they illustrate the sunk cost fallacy.
“So the key is that unlike every other auction in the world, both the high bidder and the second place bidder both have to pay.”
Understanding Auction Dynamics and Sunk Cost Fallacy
25:34 to 26:31
Learn about auction dynamics and how they illustrate the sunk cost fallacy.
“I'm the founder of Yaoi, a gift shop from the lens of artists and handmade objects.”
Listener Questions and Recommended Books
26:31 to 28:00
Steve and Morgan discuss listener questions and recommend significant books.
“And so my view is, look, if you don't think I'm doing a good job, why don't you come on here with me and help me do a better job?”
Book Recommendations and Influences
28:00 to 30:28
Discussion on impactful books and their contributions to thought processes.
“So really, I don't read anything else besides the books of our guests, because it takes forever to read all those books.”
Introducing the Learning App PEEQ
30:28 to 31:28
Introduction to the app PEEQ and its approach to learning through experiences.
“As always, we love to get listener emails.”
Show all 16 chapters
Experiential Learning Through Games
31:28 to 34:45
How the app transforms book concepts into engaging learning experiences.
“It's called PEEQ, P-I-Q-U-E, like pique your interest.”
False Memories and Learning
34:45 to 37:58
Exploration of how false memories can illustrate the fallibility of recall.
“you can go through them and then you walk away having learned it.”
Experiences in Government and Learning
39:22 to 42:00
Discussion about experiences in the government and the challenges faced.
“You live and breathe ideas like few people I've ever known and academics was made for you and vice versa.”
Rethinking Educational Environments
42:00 to 48:29
Explore how educational systems can better prepare students for real-world learning.
“If you give me the data, I can write my academic papers.”
The Value of Change and Exploration
48:30 to 53:00
Understand the importance of change and exploration in personal and professional growth.
“We ridiculously underweight the value of change.”
The Value of Change and Exploration
56:00 to 56:35
Understand the importance of change and exploration in personal and professional growth.
“followed by injections under the skin every four or eight weeks.”
Transcript
Automatic transcript. May contain errors.0:00How's the new place? Get your Wi-Fi figured out? I got T-Mobile 5G home internet and I'm loving it. It's the fastest 5G home internet. My old provider was so slow. Mine is slow. And only 35 bucks a month. Do I need to try this? Try it for 15 days. Love it or get your money back. I love it already. There are over 250 reasons to join T-Mobile. Find yours and check availability at T-Mobile.com slash home internet. that. This is according to Oculus B test intelligence data second half of 2025 all rights reserved redeem money back guarantee within 30 days of cancellation. At Edward Jones, we believe rich is more than caring about the latest and greatest.
0:35It's also taking care of what gives your life meaning. That's why your dedicated financial advisor meets you where you are with personalized financial strategies that help protect what matters so you can preserve your progress while creating a path forward. The key to being rich is knowing what counts. Let's find your rich together. Edward Jones, member SIPC.
1:04I am especially excited about today's episode because my guest is Sandal Mulinaten, one of my absolute favorite people in the world. Sandal is a world-class economist and MacArthur genius recipient and holds a university professorship at the University of Chicago. That's a special position reserved for only the most highly esteemed faculty. Only 10 of the university's 3 ,000 faculty members have that title. What makes Sendhil so special? His mix of brilliance and childlike curiosity make him unlike anyone I've ever known. His research reflects his curiosity. He's written about everything from racial bias and artificial intelligence algorithms to the psychological effects of poverty, from the determinants of CEO pay to corruption and who gets a driver's license in India.
1:48Welcome to People I Mostly Admire with Steve Levitt. I've known Sandal for 25 years, but it wasn't until he left Harvard to come to the University of Chicago a few years back that I came to fully appreciate him. Lots of people are interesting if you only talk to them once a year, but not many people can make everyday conversation fascinating. He just never fails to amaze me with his creativity and breadth of knowledge. And I'm quite confident that once you hear him talk, you'll agree.
2:26Sandal, I always eagerly look forward to our conversations. And two reasons I love talking to you are, first, there's always something that has you so excited you can barely contain yourself. And second, what that something will be is completely unpredictable. So the last time we talked, it was an Oculus virtual reality headset that had transformed your life. So is your love for the Oculus still going strong? Absolutely. I have to say it is one of the more amazing inventions. I'm sure that lots of people out there who've been using it for years are like, how is this an insight? But these media for communication by which we can translate ideas to each other, they They may start off as novelties, but they have profound consequences on how we live our lives.
3:10So I was convinced when we talked and you were so excited, I went right home and I immediately bought an Oculus for my research center because one of our goals is to transform the educational system. And the way you described your experiences, all I could think about is that the possibilities if we got this technology in the classrooms must be infinite. And I must say, the workers in my center, I've never seen them tackle a project with such gusto. Our Oculus has been in use, I'd say, 10 to 12 hours per day every day. And all that time, I'm sure, is devoted to exploring the educational potential of the device.
3:45One thing I know about you is you don't think small. You always think big. What's your big vision for what happens with VR? Let me throw out an idea for you and see what you think. Why do we go into offices at all? I mean, at all. Why do we fly across country? Why do we do any of it? And it's because there is still a reality that somehow when you and I talk on the phone or when you and I even talk on Zoom, it's not quite the same as being in person. Now, it's entirely possible that we can recreate that experience 100 % with virtual reality, which if you think of the knock-on consequences, let me give an example.
4:22One of the things that people say is that the cell phone decoupled a phone number from a location. suddenly the cell phone made it so that a phone number referred to you, not the address at which it was sitting. Now that has profound consequences. If similarly, your office location was not a physical place, but was you, you can work from anywhere, you can do anything. It totally transforms our capacity to interact with each other and how we interact. So I'm curious what you think of that one. I actually thought you were going to say something different. I thought you were going to emphasize the fact that with virtual reality, you can bring any place to you.
5:01Oh, I love that. As well as you bring you to any other place. I love that. So you can be in the Grand Canyon or under the water or inside a molecule. You can be miniature now moving around NaCl, sodium and chlorine atoms. Yeah, that's a great idea, including places that aren't really places per se. You could be inside of an atom, as you said. You could be inside of the brain watching neurons fire. You've seen this, right? Like a good figure, a good drawing of some effect suddenly changes your understanding of it. So people say Maxwell, for example, came up with his equations for electricity in large part because he came up with these good diagrams.
5:41And the same is true of Feynman diagrams, et cetera. Imagine what it's going to do for science if you can put yourself in high fidelity simulations of the thing that you're studying. bring the place to you is a terrific way of putting it. What's the path? One problem is you've got this two-sided market issue, which is that, let's just say schools are the target. If schools don't have the technology and adopt it, then it doesn't make sense to develop the programs for it. But the schools won't adopt until you have the programs. If you look at a lot of the early day uses of computing, they won't blow you away.
6:14They're just things that really got some people excited. I remember calling up bulletin boards to do virtual Dungeons and Dragons. There was a modem. I still remember going... Now, you would have said, we built all this technology so you can play a role-playing game. Well, whatever. But it's related to your research assistants who work at your center. They're playing. And play is so underrated because it just fuels this first phase of all sorts of infrastructure building. And so I think even if 10 years out, we imagine all these grand changes, It heartens me that right now, people who start playing with it enjoy playing and then start tinkering and make stuff they enjoy because that gives you that kind of base layer of stuff and just creates demand.
6:54And from it, you get all this other cool stuff. And never having done it myself, what makes it so special? Here's a psychological fact that I think many people may not realize. It's like when someone says to you optical illusion, you think, oh, I know that. It's like this image where it's an old lady or a young woman. You can look at it both ways, but they forget that like every photograph, every TV screen is an optical illusion because it is truly two-dimensional, but your mind creates three dimensions. There's no three dimensions. It's just two. But that optical illusion is actually relatively low fidelity.
7:31You put on the VR set and it feels 100 % like 3D. So for example, there's this little thing with Jurassic Park and a dinosaur. And I was like, oh, let me play this video. Your heart is beating. And when The thing's tail comes at you. You say to yourself, it's not a real tail. Do not duck. And then you're like, I'm ducking before I know it. It taps into this very basic sensory system. And that's just amazing. This is going to seem off point, but about 20 years ago in a seminar, you said something, Sandal, and I remember virtually nothing from 20 years ago. It's incredible that I remember this. You were giving a seminar.
8:07We were both just young professors getting started. and you said something like, a stranger tells you some random fact. You're far more likely to remember that fact if the stranger is wearing a bright orange clown wig than if she's average looking, even though it's the same fact. And your point was about salience and how things that are unrelated to the actual content have a huge impact on how people perceive it. Now, I find it so ironic that I can remember this point you made about salience. Somehow you turned into the clown. Do you remember saying that? I don't remember the clown specifically, but it is something that stuck with me.
8:44The mind doesn't code information because it's important or you really want to remember it. It codes information because of these kind of salient things. And it reminds me of, I'm not going to ask if you read it, but have you at least pretended to read Marcel Proust's Remembrance of Things Past? No, I've never even pretended to read it. Some of us have pretended to read it. It's six volumes or something. So at a minimum, them, you can say things like, I read volume one, even though you basically bought it. So the opening scene in there is exactly this. He's in bed and he bites into this madeleine, this pastry, and suddenly he's flooded with this memory of being at his aunt's house.
9:23And he realizes it's because the flavor of this pastry is strongly associated with that time at his aunt's house. And there's something as simple as the smell and flavor brings with it these evocative, beautiful memories. And you'll notice this in yourself, like smell, so salient, brings with it so many things. The memory system doesn't work the way you want it to work. And so is it your hypothesis that lessons taught through virtual reality might be much stickier than other means of learning? Absolutely, yeah. I'd say that in general, we learn so much better when we're doing things than when we're just listening to things.
10:03I'll give an example. If I say to you, think of one of your favorite meals from a past vacation five years ago, you can probably remember, like you had it exactly once, but you can probably remember the dish and you can probably remember what was in it and you remember the feeling you had. That's astonishing. If I said to you, remember a good conversation, I'd be like, I don't know, we talked. It was nice. It was fun. But taste, smell, these things, they're just hardwired back in. So along those lines, I told you something I remembered from 20 years ago, but I also want to make a confession to you.
10:37You wrote a book, and it must have been almost a decade ago, and the book was called Scarcity, and I love the book. I read it in two or three sittings. My blurb is on the cover of the book, and I raved about it to anyone who would listen. So as preparation for this conversation today, I went back and I looked at the book for the first time in ages. Obviously, I remember the key thesis of the book. Like you have a really simple point that has stuck with me. But I would have sworn I have never read the book before. It's loaded with these stunning experimental results and these interesting stories.
11:09And as I read them, I felt like I had literally never read about this experiment before. When obviously I had. And I would have thought, sure, I couldn't reproduce it. Someone said, what's on page seven of Sandal's book? I wouldn't be able to do it. But I would have thought that, oh, yeah, of course, this is the study when the people weren't allowed to have lunch and then they had to do the word search. Oh, yeah, I came back. Nothing. The good news is I enjoyed it just as much the second time because it was all new to me. But the bad news was it really scared me because I would have expected that seeing the stories, I would remember them.
11:42I wonder if my chronic lack of sleep from having too many kids has really left me somehow deeply mentally impaired. What do you think? So that's at the heart of this app that we're releasing that I want to tell you about in a second. But I also want to tell you that your experience is the experience everybody has. Lately, I've asked people the following question. Hey, what's a novel that you really like? And they'll tell me the novel. And I'm like, great. Can you tell me how it ends? And they're like, oh. I said, okay, fine. You can't do that. Can you tell me two of the main characters' names?
12:11They're like, I remember one kind of. And it's amazing how quickly things that you've read, they come in and they go out the other ear. It's just astonishing. Do you think that's particular to reading? It's reading an especially bad way to gather information? Or you think it's more generic? I think it's two things. We imagine the mind to be this sort of warehouse of information, but don't appreciate how much is just open doors. It's like a train station that people walk through. Like ideas are just going through the train station of our mind. Not many things stay behind. But you're on to something.
12:46I think reading is just such a bad way to learn because in many ways, it's passive. It's not experiential. Like you remember your experiences. You remember the feeling of being on a roller coaster. Those physical highs, those ahas that you yourself have experienced, but not the things that you've read about. One of the things, therefore, I try to do in class is rather than teach people things, I try to create little experiences for them. You'll like this one, Steve. So do you know this$20 auction? You basically say, I'm gonna auction off this$20 bill. It's a both pay version, where both people have to pay.
13:28Both people have to pay. I love that. Yeah, tell people about it. It's incredible. Yeah, in class, I hold it up and say, here's a$20 bill, I'm gonna auction it off. And if someone would give it to the winner, just to make things interesting, the highest bidder wins the bill and pays. The second highest bidder doesn't get anything, but they also pay. So at first, everyone's a little hesitant. You're like, okay,$20. And minimum increments of bids of$1. So, of course, somebody says$1. And you say, okay,$1. Going once, going to, I'm going to let this guy get$20 for$1. So someone else bids two. And that's all you need.
14:01So the key is that unlike every other auction in the world, both the high bidder and the second place bidder both have to pay. They pay whatever their bid was. Exactly. And the highest bidder wins the bill. Yeah. Okay. So once you have one person bid a dollar and somebody else has bid$2, think of what is about to happen. I say, okay, going once, going twice, the dollar bidder is like, well, I'm not going to get it for two to get to three. And they just keep leapfrogging each other. A crucial thing happens when someone has bid$10 and$9, the$9 bidder says, I'll bid$11. At that point, I'm making a profit.
14:36I'm now just auctioned off a$20 bill. At a minimum, I make a dollar profit because someone's bid 11, someone's bid 10. I'm getting 21. I'm giving up$20. That seems absurd that I'm making a profit off of this. And the second crucial thing that happens when the highest bid is at 19, because at that point, both players know this is not going to end well, but they don't want to be the one for whom it ends badly. So the$18 bid is, wow, I'm going to lose 18 anyway. Let me bid 20. I've seen this happen. It's always the same. Until that point, they don't feel that bad because they feel like this is going to end at 20.
15:10Just because I think people so often, they bring rules of thumb with them to problems without thinking. So I think, okay, fine. I'll bid 20. I'll break even. The other guy will bid 19. He'll lose 19. We'll be done. But then when you get to that point, something awful sets in because what happens then? The$19 bidder is like, I'm losing 19 and I'm not getting anything. If I just bid$21 for this$20 bill, I can at least recoup some of my losses. Once you cross that boundary, there is no stopping this freight trade. It's especially awesome doing classes when you have these sort of more bro-ish, because they just won't let go.
15:49You have to just pull the plug. You have to say, I am calling it here at$42 highest bid. It's absurd. Obviously, the two people involved feel the lesson, but so does everybody else, having been part of it. And I'd say, now let's talk about the sunk cost fallacy, the idea of throwing good money after bad. Now, when you talk about the sunk cost fallacy, it has real personal resonance. Like people will remember this experience and that lets them understand sunk cost fallacy more than if I just talked it through, don't throw good money after bad, etc. I never thought about that in terms of sunk cost.
16:24What's always been to me so interesting is it's a game that once you start it, doesn't have an obvious equilibrium. because if I've bid 40 and you've bid 41, each time I'm faced with roughly the same problem, which is for$2 more, I get a chance at winning 20. And so if the other guy will quit with a 10 % probability, it makes sense to do it. Yeah, exactly. I should walk through how I do it. I say, here's a sunk cost fallacy, throwing good money after bad. Here's something called escalation of commitment, where you consistently keep ignoring. You're like, we've already done it. It's only a little bit more.
17:02And I think a lot of sunk cost fallacies play out like this$20 bill auction. They're like these little escalation of commitments, if that makes sense. It's like you're in a bad relationship. Let's give it another week. Okay. But a week from now, where are you going to be that's that different to today? This project doesn't look that good. Let's give it another$10 ,000 investment and let's see how much. So there's this element of the thing where you've spent some resources, put yourself actually, ironically, not that differently from where you started. And you don't step back and say, where does this whole thing end?
17:36Locally, every single extra dollar seems to make sense. But if you step back, you're like, where does this thing end up? Yeah, the fact that every time you've spent the extra two dollars, the other guys topped you over time, that should change your probability about what's going to happen next. And related to that decision making, I woke up in the morning for maybe five straight eight years. And the first thing I thought about every morning is should I quit my job as a professor? And every morning I thought, God, I would so like to quit, but I can always quit tomorrow and maybe something will happen today that will make me change my mind.
18:12And so I literally delayed my decision because I had this third option, which is, well, as long as I wait till tomorrow, the cost of waiting is really small. Like a good example in this game is if you weren't given the chance to go up by$2, which is essentially like pushing the decision until tomorrow. If you just had to make a decision, look, I'm either going to play this game until I'm dead or I'm going to stop now. Everybody would stop now. It's the fact that you introduce this third option, which is like a wasting away option that completely defines my life. I would say my entire life, that has been my rule of decision making.
18:46Your point about deferring to tomorrow is so profound because I think there's a deep psychological bias that you tend to think tomorrow will somehow be different. It shows up in so many aspects of life where if you just say to yourself, if tomorrow is a repeat of yesterday, how would I behave differently? And so many things change. There's an employee, they're not that good, they haven't done very well, and you're like, well, let's give them a chance. The first time, giving them a chance may make sense, but after four times, you're like, if tomorrow is going to be a repeat of yesterday. What am I doing?
19:22And that simple heuristic, tomorrow is a repeat of yesterday, really cuts through a lot of clutter, like so much decision clutter. Do you use that in your own life? I try to use that in my own life. The place where I've gotten better and better at it is in trying to decide what I should do. What should I work on? And it's tempting to work on things that give you some pleasure in the future, but they're painful right now. And you end up with so many of those things, you say, wait a minute, will tomorrow be like today and yesterday, which is just a lot of grinding out in the hope of some big payoff in the future?
19:58That doesn't make any sense. It's like I'm lifting weights for some weightlifting competition that doesn't seem to ever appear. I loved your coin experiment. The coin experiment that Central refers to is a research project I did to learn about whether or not people make good choices. I built a webpage for people who were struggling with a hard decision. So should they quit their job or not? Maybe should they end a relationship or stick with it? And I invited those people to be part of an experiment. And if they agreed, I did something really simple. I flipped a coin. And if the coin toss came up heads, I encouraged them to make a change, to end that relationship, to quit the job.
20:36And if it came up tails, I encouraged them to stay the course. And the amazing thing is, almost 20 ,000 people flipped coins. and the outcome of the coin toss actually affected the way people behaved. And six months later, I surveyed those people to figure out how happy they were with their choices.
20:56I've taken away the fact that when you're near indifference, which is a lot of the people in your coin experiment, they're like, hey, I'm indifferent, I'll let you decide. And when you're near indifferent, you're not actually near indifferent. Exactly. Right? You should be able to figure out which way the bias goes. You're like, I'm indifferent. Guess what? You have status quo bias. So if you're near indifferent, it's easy. Change. And there's so many things like that. You're like, if you're near indifferent, what's your bias? You tend to pick the better known option. Great. You're near indifferent.
21:29Pick the less known option. I found that just a very powerful situation, a powerful tool. Yeah, for me, it's just a great heuristic because every problem ends up turning into the same problem. As long as I have strong preferences, I follow my preferences. When I don't know what to do, I know that I'm just messed up because history tells me that I'm always stuck with the status quo, and so I should always make the change. Even knowing that, I don't make enough changes. It's interesting that I'm the author of a study that says when you're indifferent, you should make a change, and my whole body convulses at the thought of change, and I don't do it.
22:02Like incredible. I completely and utterly know that I'm doing something crazy and I do it anyway. So that's how powerful my status quo bias is. Oh my God, status quo bias is so powerful. I don't know if you're into food. One thing I've noticed with food is if you say to somebody, try this and they're like, oh, it has mushrooms. I don't like mushrooms. Go ahead, just give it a taste. No, I couldn't. I don't like mushrooms. What, are you allergic or poisonous to what? No, no, no. And I am completely like this. So much so that my ex-wife, I didn't like soy sauce. I was like, I don't like soy sauce, but I don't like that at all.
22:35So he would secretly cook me things with soy sauce that I actually liked. It's this thing of like, why am I so wedded to this status quo that I don't even experiment a tiny bit? What does one mouthful cost me? Nothing. And it has got to be a given that I don't dislike everything with mushroom. That is absurd, right? I'm sure I dislike some mushrooms, but not all. And so in food, I really see it because the cost of experimentation is zero. And yet we do so little of it. I often say to people, oh, they'll say, let's go to this restaurant. I have a favorite this year. OK, great. Have you tried any of the other dishes?
23:13No. How many times have you been here? Like 30 times. Each time, though, I have my favorite. I don't want to give up on my favorite. You tried one thing. Try a few others. I have a rule of thumb at restaurants, which is I try one thing. If I like it, I'll go back there over and over. And if I don't like it, I will never go back. I almost never sample two things on a menu. Go back a second time. Do you try something else or you just try it? I wouldn't even think about it. Almost every restaurant I frequent, I hit the jackpot the first time and I can't imagine how anything could be better than the thing that I got the first time ever.
Read the full transcript
23:48But I'm happy about that. Actually, that one doesn't bother me. I do a lot of things that bother me, but that one seems to me, that's sensible. Once you hit something good, Why would you ever mess with success? Next time you go to your favorite restaurant, order the thing you like. And since I know you have the cash, order something else on top. It's like costless experimentation. Just see what it tastes like. Who knows? If they did one thing, maybe they do a second thing, right?
24:14You're listening to People I Mostly Admire with Steve Levitt and his conversation with economist Sendhil Molinatan. After this break, they'll return to talk about Sendhil's new app that helps people learn new ideas.
24:54If your doctor decides that you can self-inject Tremphaya, proper training is required. Tremphaya is a prescription medicine used to treat adults with moderately to severely active Crohn's disease and adults with moderately to severely active ulcerative colitis. Serious allergic reactions, increased risk of infections or lower ability to fight them and liver problems may occur. Before treatment, get checked for infections and tuberculosis. Tell your doctor if you have an infection, flu-like symptoms, or need a vaccine. Explore what's possible. Ask your doctor about Trimphia today. Call 1-800-526-7736 to learn more or visit trimphiaradio.com.
25:34My name is Shannon Maldonado. I'm the founder of Yaoi, a gift shop from the lens of artists and handmade objects. I chose Shopify because when I was testing other platforms, it was definitely one of the most user-friendly. It was important to me to think about where we would be in the future. All of the tools for reading your sales, like planning inventory, they're just right there on your dashboard. For anyone starting a small business, the biggest thing I can tell you is it doesn't have to be perfect. Shopify can help you build upon it. Start your free trial on Shopify.com. Hey, Chicagoland, the Wayfair store is in your neighborhood at Edens Plaza and Wilmette.
26:08Finally, you can feel the fabric, sit on the sectionals and even open the refrigerators. Plus, our in-store designers will help you bring it all together with free one-on-one design support for any project on any budget. Yep, we said free. Oh, and did we mention the cafe? So what are you waiting for? Come see all that's in store. Visit the Wayfair store today at Edens Plaza and Wilmette. Wayfair, every style, every home.
26:37so if there's one thing we value with people i mostly admire it is the power of ideas and experimentation for making things better and honestly most of the good ideas we have on this show come from my producer morgan and so i want to introduce her to everyone morgan can you please say hello hi steve how's it going it is going great except that we put this new segment into the show, which has me answering listeners' questions, and you don't think I'm very good at it. And so my view is, look, if you don't think I'm doing a good job, why don't you come on here with me and help me do a better job?
27:11And so we're going to give that a shot today. I didn't say you were doing a bad job, but I do think that you answer questions that are easy for you to answer. Oh, my God. Absolutely. I also just don't want to hear the answer to any more golf questions. So I thought I'd come on here and start helping you choose them. Okay, fine. I hand over the reins. What are you going to make me answer today? Okay, this is one that we get from a lot of listeners. And this question specifically came from someone named Eric. And he wanted to know, what books do you recommend for someone interested in economics or books that you'd recommend in general?
27:47Morgan, that's exactly the kind of question I would never choose to answer on my own because I'm just going to say all the books that we've already covered on the show. No, I'd like to know what else you are reading besides the books of our guests. So really, I don't read anything else besides the books of our guests, because it takes forever to read all those books. So I'm going to talk about books I've read in the past. So the first one is a book called Fist, Stick, Knife, Gun, and it was written by Jeffrey Canada. And it's an old book. I must have read it 25 years ago. and it is a very personal account of violence in his life and in the communities around him and it's just incredibly thoughtful and it's changed the way I think about crime which is something that I've thought a lot about.
28:37Now it's not an economics book, it's a sociology book. When it comes to economics, I'm going to go back even further to two books that I read in college. The first one is a book called The Evolution of Cooperation by Robert Axelrod. And it is this amazing book on game theory. It's actually a book we've talked about on an earlier episode because Yul Kwan, one of my guests, had used that book as the cornerstone of his strategy in Survivor. It's about how cooperation emerges in the prisoner's dilemma. It inspired me more than anything I had ever read in economics, except for the last book I'm going to mention, which is a book from 1960.
29:19And it is by a professor I had at Harvard, Thomas Schelling. He won the Nobel Prize. This book is called Conflict and Strategy. And it is a book of game theory with no math. It's just a really smart guy who thought deeply about the implications of strategic behavior. And I couldn't believe how big and deep the ideas were. It was the thing that pushed me to want to go get a PhD in economics. Okay, those are great, but those were all written over 25 years ago. Do you think you've read a book in the past two decades that you could recommend? if I had to pick one I guess I would say Nudge by Richard Thaler and Cass Senstein and the basic idea is so simple and so obvious that I kick myself and I say how did I never think of that before and that to me is the best advertisement you can make for a book okay I think I let you off the hook a little bit with this question especially since I know you're good friends with Richard Thaler so of course you're going to recommend Nudge but hopefully our listeners will enjoy hearing those recommendations.
30:26And I think now we should get back to the interview. All right, let's do that. As always, we love to get listener emails. The email address is pima, P-I-M-A, at Freakonomics.com. Morgan and I both read every email.
30:49This has been such a typical Sindel conversation. In 15 minutes, he managed to go from Feynman diagrams to Marcel Proust to the sunk cost fallacy to not liking soy sauce. In the second half, I want to hear more about this new app. Since when do econ professors develop apps? And I also want to hear about his experiences in the Obama administration, I just cannot imagine the chaos that must have ensued when Senda was put in charge of a government bureaucracy.
31:21So earlier in our conversation, you referenced an app that you developed. It's a learning app. What does it do? It's called PEEQ, P-I-Q-U-E, like pique your interest. And at its core, it's trying to say, look, we have a fundamental problem in learning new ideas. We read about them. but reading is a bad way of learning. So what it tries to do is it takes books and the ideas in books and says, we're gonna turn those into experiences. So like the dollar auction, you're actually gonna go and experience something in the app and then we'll say, look, you've learned about escalation of commitment. You say books, what do you mean by books?
31:58Like real books? Yeah, like real books. The first set we're doing right now is behavioral economics, behavioral science books. I'll give you an example. There's this great book by Leidy Klotz. It's called Subtract. It just came out. It's awesome. Oh, yeah, I've heard of that. I haven't read it. It's really nice. And it's one of the books in our app. And what we do is he has an experiment where there's a grid. OK, so people come in the app. They see a grid. And the grid has different colors. And so your job is when you click on a tile, it changes the color. It flips it. It's a little game. And what you want to do is you want to try to make the grid symmetric color-wise.
32:36OK? And you go, you play with it, and you find that in about 12 flips, you can make it symmetric. And there's actually a much easier way to do it than 12. I think it's four or eight steps, much fewer. But when you do the 12, it's because you're looking to add colors to create symmetry. The way you do four is you remove colors to create symmetry. And Leidy's point in the book is that in many situations, we look to create good changes by addition. We rarely look to get to where we want through subtraction. Reading Lighty's book is a delight, but playing games like this where you're kind of struggled with the game, you're like, well, I can't get it.
33:16I can't get to the best. And then you have the aha moment. You've learned the subtract lesson by doing it. And you remember that far more. And so the app takes these books and creates these experiences. Have I ever told you the story of the Stephen Hawking book, A Brief History of Time? No. So this is a book where you see it on everybody's shelf, but nobody's actually read this book. I'm sure Stephen Hawking has read this book. I'm hoping his editor has - Kind of like thinking fast and slow. Yeah. I didn't say that. Danny's our friend. I would never say that about that. Right. Exactly. Exactly.
33:53Oh, yeah. So Brief History of Time. I'm convinced nobody has read Brief History of Time. And I was like, maybe I'm being cynical. And then I realized, no, the publishers know this, and they're even more cynical than I am. So I think it was 20th year anniversary of the book. They published a new book, an even briefer history of time. Because they realized, surely people have bought that 200-page one and feel a little guilty not having read it. Let them buy a 100-page version and feel guilty a second time around. It sold pretty well, I think. Yeah, I bet. But I wonder if it doesn't work, if the point is to impress people.
34:27Yeah, exactly. That thickness might actually be really important to them. Exactly. It's one thing to say, have you read a brief history of time? It's another thing to say, have you read an even brief history of time? Yeah. So what the app does is it's our ambitious attempt to change the way people absorb and learn information. And so the activities are just fun and interesting and they're illustrations of stuff so that you can go through them and then you walk away having learned it. Is your thought that people will read the books first and get the lessons reinforced through the app or that the app potentially becomes a very time efficient way to avoid having to read 300 page books that only make a couple of points.
35:07Yeah, I imagine that for a lot of people, they will do the app and then for some, it'll motivate them to read more detail in the book because it's also more interesting to read a book when you've got a lesson from it motivating you and pushing you through. And I do think there's a time efficiency gain of doing the experience. It's like teaching. You did the$20 bill exercise. It's just so much more efficient than sitting there hearing about escalation of commitment or whatever it might be. So take a book that many people would know. We have one that I like, which we can try on your listeners and I can try on you as well, Steve.
35:39It's a memory experiment, okay? I'm going to list a bunch of words. I don't want you writing anything down. And then I want you to, after I list the words, write down whatever you remember. I'm going to list about 10 words. So it's pure memory. I'll say them out loud. Don't do anything. and then after I say go, write down as many as you can remember. Okay, here we go. Bed, rest, awake, nap, dream, wake, doze, snore, slumber, blanket, snooze, tired. Okay, go ahead. Just write down as many of these words as you can remember.
36:29Did you write them down so you know what you actually said? I did, yes. Okay, do you have it? All right, so I got seven written down. Seven, okay. So let's see. Do you have the word bed? Yes. Tired? Nope. Oh, yeah, I do. Yep. Dream? Nope. Slumber? Yep. Sleep? Nope. Ugh. So for your listeners, let's just say you did, Steve. Let's just pretend you had sleep. Okay. Okay. So this experiment, over 50 % of people remember the word dream and over 50 % of people remember the word sleep. But there's a big difference between those two words. Dream was on my list. Sleep was never on my list. You can reliably induce a false memory of the word sleep.
37:11And it happens very consistently. This is one of the things that we have in the app. And I'm sure in the audience, some people listening to this podcast will remember having heard the word sleep and they can go back and listen. I never said the word. And you can see what's happening here. Sleep is in the sort of network of these words. It's like that party where your friend says to you, hey, you remember that party you were at? And you're like, I wasn't at that party. They're like, no, you were there. And it's because every one of your other friends was there. They're like, well, you were there too.
37:38And sleep is like that. And so this is a false memory inducement. And you can give all sorts of lectures about people's memory is valuable, don't trust your memory. But you do an experiment like that and suddenly people are like, I really remember the word sleep. And in fact, you did not remember the word sleep. And it teaches you a lesson around the fallibility of memory. As a small business owner, sometimes it feels like no matter how much planning you do, there's always surprises, like an urgent, expensive repair. But here's a surprise you'll like. With Progressive, small business owners save 10 % or more on their commercial auto insurance when they pay in full.
38:13So enjoy a surprise for once. Get a quote in as little as eight minutes at ProgressiveCommercial.com. Progressive Casualty Insurance Company and Affiliates. Discounts not available in all states or situations. I'm Kiana, and I leveled up my business with Shopify. Once I figured out that Shopify was a thing, I never turned back. I can create a site with my eyes closed. Shopify thinks ahead of us, you know, and it thinks about the customer more than anything. Every day I'm thinking about some other new business, but Shopify is doing it to me because it's so easy to use. It's like I can't stop. I'm addicted.
38:50Start your free trial at Shopify.com. Everyone's talking about protein lately, but how do you actually get enough of it? Muscle milk. Muscle milk has a great tasting new formula with no artificial sweeteners, flavors, or added colors. It's high quality, complete protein designed to support healthy muscles with fewer ingredients than the previous formula and 26 to 42 grams of protein. For when you're stuck in meetings or need a post-workout recovery. Available in chocolate, vanilla cream, cookies and cream and strawberries and cream. Try the new great tasting muscle milk today. Available in stores nationwide.
39:21Muscle milk, protein for all.
39:34You live and breathe ideas like few people I've ever known and academics was made for you and vice versa. But the app won't be the first time you've stepped foot outside of academia. you spent some time as the research lead for the Consumer Finance Protection Bureau during the Obama administration. I mean, the federal government is notorious for red tape. Wasn't that a nightmare for you? Honestly, at first it was because the professional world is so complicated. You know what I mean? The toughest part is that the ratio of innovation to execution is so different than what we're used to. It's true.
40:13And so I've gained a lot of respect for people who get done because it is insanely hard. And we somehow put a lot of weight on ideas. But execution is a whole other thing. So in that sense, you're exactly right. There was a nightmare element to it. The part of it that was really interesting, though, was, huh, how would you actually meaningfully protect consumers against a lot of these products while also preserving innovation? These problems are complicated when you start really getting down into them. So I'm just imagining you with an idea, an hour. Each idea requires three years of execution.
40:50What happened next? That was not my finest moments. I learned the hard way there that if I want to get things done, I have to figure out how to become a manager, which I was not, or figure out how to get a structure in which I can play a role. It's one thing to not be good at something and to fail at something. But it's another thing to not even know why you're not good at something. Like the thing about school is someone gives you an exam, you do badly, they tell you what you got wrong, and they tell you the book you need to read to get better. Unfortunately, life does not have any of that. You don't even get a score, you just kind of know you're doing badly.
41:28If there's one thing that would be interesting to figure out is how do you improve learning through the rest of life? School is such an artificial way to think about learning. It's just too much very directed feedback. And then you turn it into the world where you get zero directed feedback. And somehow we're not preparing people. I know I was doing badly, but I didn't know what I was supposed to do to fix it. I think you're right. I'll give you an example where I stumbled in the same way you did. So after Freakonomics came out, all sorts of companies would call me up and say, could I do consulting?
42:00And I'd say, sure. And they'd say, how much you charge? I'd say, well, I'll do it for free. If you give me the data, I can write my academic papers. And so I would go to these companies and I had been very successful in academics. So I had a set of rules of thumb about what made for a good question, how you analyzed it. And it turned out that all those rules of thumb, which made a ton of sense in academics, which would take a very small problem because the reward in academics comes from answering a relatively boring question 100 % right. Over the time span of two or three years, you take your time, you finish it.
42:33But businesses needed me to answer interesting questions quickly with 80 % likelihood that I'm right. And I was not at all suited. And I gave the worst advice. And I always had made fun of other people because what I've seen too often is people just use whatever rules of thumb have worked on the last problem. And they apply that to the new one without thinking, hey, that's exactly me. That's exactly what I'm doing. I think it also takes to learn. You have to really be willing to admit your own flaws. And I think so much in society pushes us against that. So you think that school should be more like life or the point of school should be to teach people to be learners?
43:13That's the idea I'm throwing around my head these days. You said it perfectly, Steve. Could school teach us to be learners, but learners in environments, and in psychology, there's this notion of a wicked environment. A wicked learning environment is one where there's very little feedback. And how would you arm people to be learners in a wicked environment? I don't have an answer to it, but that's the kind of question that I'm throwing around my head, because that seems like it would have very high return. If we could even make a little bit of progress on that, given that everyone is about to be thrown out into this world.
43:43But the second thing we can do is we can ask the question, why are learning environments so wicked? Why is feedback so bad? Jens Ludwig, one of our friends, he's always pointing out to me that if you look at how much feedback judges get, it's basically zero. So you're a judge and you do pre-trial, which means you're just trying to decide whether the person should stay at home and wait for trial or whether they should wait for trial in jail. It's a simple decision. In Cook County, you might make it 100 times a day. Now, we have the data. We know what happens to those people you sent home and how many of them didn't come back.
44:20And how much feedback do judges get? Nothing, like nothing. They don't get a report that says, here's how your cases did after the people were sent home. And if you look at how many situations the decision maker doesn't get much feedback, it's a ton. Like, we teach, right? So what feedback do we get? Some stupid teaching evaluations, which are nothing more than at the end of the quarter, what did the person think? There's no, hey, we went and surveyed your students five years later, and here are the concepts they remember from your class. I would love to know what that is. Maybe they don't remember any of the concepts from my class.
44:55That would be worth knowing. Or which one's stuck? You just don't get that much feedback on any of the things that you do all the time, and it just makes for such a terrible learning environment. I agree 100%. And I also think, though, in many settings, the actors do their best to avoid feedback. Because in complex settings, like a business environment, I think it's better for most of the people in the firm that nobody has any idea whether their decision's paid off or not. When I've gone to try to run experiments in firms, and I know you've run experiments in firms, it's hard to get them to run.
45:32And I used to think the obstacle is that they're expensive and they take a lot of human capacity, a lot of resources. And I've realized over time that nobody actually wants to know whether the decision they made was a good one or a bad one. I don't know if it's because the payoff to good decisions is smaller than the cost to bad decisions. Maybe it's risk conversion. But the bigger obstacle isn't even that. The bigger obstacle is in order to run an experiment, you have to admit up front that you don't know the answer. and in business, I'm supposed to know whether this advertising works or not, but actually, even though we spend $100 million a year on advertising, I have no idea if it works.
46:10To admit that and to say, I'm going to learn from an experiment, that's the thing which is really interesting to me that so differentiates academics from business. As academics, we always start from the principle that we don't know anything, but I think any setting in which people have to pretend like they have expertise, that gets in the way of experimentation and feedback more than anything. And this is deeply related to the point you said earlier as well, which is like at an individual level, it's just very hard to admit that you're bad at something, that you're wrong, but not wanting to admit upfront and not wanting to learn afterwards.
46:45Even in academia, when we're exploring new ideas, we say we don't know. But if a PhD student comes to me and says, hey, do these slides make a good talk? A part of me always wants to say, I don't know. It's as hard for me as it is for you. I don't know. I'm just groping around here. But you can't, right? Imagine how disheartening it would be for the student to be like, hey, look, we're all throwing darts. If you want me to throw the darts for you, I can do it too. They don't want to hear that. And that's what's happening in organizations too. At least we imagine leadership involves putting this mantle of, I know exactly what I'm doing.
47:17To a degree, it's true. No one wants to follow the general who's like, we're going to go this way. I don't know if it's the right way, guys, but it's a good Yes, let's go. Society would be so different if we could just own up to the sheer level of ignorance that we as experts have about a huge number of things.
47:42So you were in Cambridge back and forth between Harvard and MIT for over two decades. Why did you decide to move to the University of Chicago after all these years? The honest answer is actually very related to your flipping a coin study, actually. One of the things that was most influential was when I was trying to decide what to do, somebody said to me, sometimes change is good just for change's sake. That really stuck with me because on my pro-con list, nowhere was there written change. It's like there are material aspects, but when you reflect on it, what's the biggest aspect of this decision?
48:19Change. I'm gonna be in a whole new city, whole new environment. And so once someone gave me that advice, I was like, oh, this seems like a relatively straightforward thing. Change by itself is just good. It's related to where we started. We ridiculously underweight the value of change. You know what I mean? Like you think you're the same person wherever you go. That is absolutely not true. You're exposed to new things, your mind changes. In many ways, I think people become stagnant as they get older. Because they're not doing enough to expose themselves to truly new situations. Do you have advice for young people who are trying to figure out their place in the world?
49:00I think the one piece of advice I would give comes from this awesome paper. I think it's Dan Gilbert. It's called The End of History Illusion. If you ask people, how much have they changed in the last five years? Most people say a lot, especially young people. Like take a 22-year-old. Oh my God, who was I when I was 17? My God, 17 to 22, I changed so much. Then you ask people, how much will you change in the next five years? They're like, a little bit. Pick any age. You always act as if history has ended. All the change you're going to do is done, which is absurd because from 17 to 22, you change a lot.
49:3522 to 27, you change a lot. So I think the biggest error people make is they think they are choosing for who they are right now. what they're actually choosing is for this person five years from now who's going to be very different from them. Very different from them. So if you say, I'm deciding whether to go work at company A or company B. If you think you're set, what you're choosing is between two companies. If you think that you're changing, what do you change towards? You change towards the people around you. So what you should ask yourself is, I am going to become like the people at company A or like the people at Company B?
50:15That's who I'm actually going to become. Which of these kinds of people do I want to be as a person? And so that puts a whole different perspective on it because now you no longer think of yourself. You're actually choosing versions of you. And you really have to accept that. Whenever I try to tell students this, it's amazing how much they resist it. People say this to me. I'm going into consulting, but I'm not going to be the stereotypical consultant. I'm like, my best guess is you are going to be the stereotypical. What do you want me to tell you? Yeah, I've never heard anyone say what you just said.
50:44It's so interesting to hear it. I want to hear your advice. It's actually evolved a lot. It's been affected by this podcast and hearing what other people say. But I have come to believe that the single most important thing to recognize when you're young is that life is long and it's not a race. And there's this sense of urgency of not getting off the track of having to do something tomorrow. So before I went back to get a PhD, I spent two years doing consulting. And I was panicked that I was behind the other people. Look, it made no sense to be panicked about it. So that's really, to me, not being in a hurry and the luxury of knowing that you can make mistakes, you can experiment, you can dabble and still have all the time in the world to be what you want to be.
51:34The most interesting people we know didn't know at 22 what they wanted to do. And some of the most interesting people don't know at 40 what they want to do. And that's good. If you're embracing life, that's what's going to happen. Yet somehow you feel like you ought to know there's this fixation on it. It's okay. There's a lot of other stuff coming down the road. And I think society's gotten much worse on that. As I look at my teenage kids, the amount of focus they have about what college will they go to, what activities am I doing when I'm 13 that will positively influence my chance of getting into college.
52:09And that is a kind of rat race that I think we've done such a disservice to our kids. I feel like kids get less and less play. I mean, I went to Cornell, it was a very good school. And I remember being stressed about it, but I also didn't think to myself, I needed to check off a bunch of boxes to try and get into the best school. Like, I just felt like I just had to be myself. Like, a ton of time to just explore and just play and acquire interesting ideas and things. It made you able to enjoy and really become intellectual in a way that I couldn't imagine doing if my only goal were to get good grades and check the right boxes.
52:43It goes back to your Oculus point. I really liked it when you said these guys were playing with it. Like play is ridiculously underrated. Every time I've licensed myself to mess around, great things have come because that's how you get into really good ideas is you mess around.
53:02What a great place to stop talking about play, because I really do believe that Sendel's willingness to play is a huge part of what makes him special. And I have to admit, I used to love play. But wow, do I find it hard to play these days with all my other obligations. But I'm making a promise to myself at least for one week, inspired by Sendel, I'm going to make play a priority. So this would have been a natural place to stop our conversation, but with Sendel, we always end up talking for hours and canceling whatever other meetings we had planned. And that's exactly what happened here. We just kept talking.
53:39So next week's episode will be the second half of our conversation, where we discuss the implications that artificial intelligence will have on society, his secrets for generating so many ideas, and the radical ideas in his book entitled Scarcity. I saw the title, and it's called Scarcity. And I thought to myself, this is so arrogant, because economics is the study of scarcity. So who does Sendell think he is that he's going to have something new to say? People I Mostly Admire is part of the Freakonomics Radio Network and is produced by Freakonomics Radio. Morgan Levy is our producer, and Jasmine Klinger is our engineer.
54:21All of the music you heard on this show was composed by Luis Guerra. Thanks for listening.
54:51The Freakonomics Radio Network. The hidden side of everything. Exterior Remodels. Inner Monologues. Brought to you by Power. The house looks good. Like, really good. That siding? Stunning. The roof? Elevated. Windows? I mean, wow. The process? Smooth. The neighbors? Jealous. Choose Power Home Remodeling and remodel how you think about remodeling. Schedule your free quote on windows, siding, roofing, and doors at powerhomeremodeling.com. Power. Our work shows. We've been the trusted experts since 1960 because nobody knows tires better than we do. And with over 90 tire brands, we have an abundance of options in stock for your vehicle.
55:38Buy and drive today at discounttire.com. Let's get you taken care of. For adults with Crohn's disease or ulcerative colitis symptoms, every choice matters. Tremphaya offers self-injection or intravenous infusion from the start. Tremphaya is administered as injections under the skin or infusions through a vein every four weeks, followed by injections under the skin every four or eight weeks. If your doctor decides that you can self-inject Tremphaya, proper training is required. Tremphaya is a prescription medicine used to treat adults with moderately to severely active Crohn's disease and adults with moderately to severely active ulcerative colitis.
56:16Serious allergic reactions, increased risk of infections or lower ability to fight them and liver problems may occur. Before treatment, get checked for infections and tuberculosis. Tell your doctor if you have an infection, flu-like symptoms or need a vaccine. Explore what's possible. Ask your doctor about TREMFIA today. Call 1-800-526-7736 to learn more or visit TREMFIAradio.com.
From the publisher
He’s a professor of computation and behavioral science at the University of Chicago, MacArthur “Genius Grant” recipient, and author. Steve and Sendhil laugh their way through a conversation about the importance of play, the benefits of change, and why we remember so little about the books we’ve read — and how Sendhil’s new app solves this problem. This episode originally aired on July 23rd, 2021.
Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.
