How to stop AI from killing your critical thinking | Advait Sarkar

0:06You're listening to TED Talks Daily, where we bring you new ideas to spark your curiosity every day. I'm your host, Elise Hu. What happens when we start to let AI think for us? It's a big question right now. And is it actually making us smarter and more efficient? Or is it hindering our ability to think critically? In this talk, Advet Sarkar, a researcher at Microsoft, examines the cognitive trade-offs of AI at work and sketches a different kind of tool, one that promotes critical thinking and nudges reflection to help you get smarter and not just faster.

0:48I'm here today to talk about thinking for yourself. And I must admit, I did use AI to help me think about it. The irony is not lost on me. But the way I did so is not by using AI as an assistant to help me prepare this talk faster. Rather, I use AI as a tool for thought. And by the end of this talk, I will have explained what I mean by that, why it's important, and given you a glimpse of how it might work. But first, I need to set the scene. Let's look at a day in the life of a 21st century knowledge worker. I arrive at my office and look at my inbox, full of emails.

1:32Let's summarize it. Okay, I'm struggling to figure out how to respond here. So let's get AI to write a response. Next, I need to write a report. But I'm struck by the blank page problem. I know, I'll drop in some resources and get an AI draft. Looks good to me. By the way, the writer's block used to be staring at a blank page. Now it's staring at a page that AI filled out for me and wondering if I agree with it. I've become a professional validator of a robot's opinions.

2:06I've got some data to analyze. Maybe AI can analyze this data for me? Probably correct. Okay, I've got to make a deck as well. You know the drill. All right. Oh, I was supposed to prototype something as well. Okay, let me vibe code something. All right. All this looks good. Let's go. This isn't a vision of the future. This is a completely plausible, if slightly exaggerated picture of the world of knowledge work today. Welcome to the age of outsourced reason, where the knowledge worker no longer engages with the materials of their craft. We've become intellectual tourists. In our own work, we visit ideas.

2:50We don't inhabit them. Our relationship to our work is entirely intermediated by AI. Some might say alienated. We've heard that story before. What I want to focus on today is that using AI in this way can have profound implications on human thought. Consider creativity. On an individual level, we might think that AI is a creativity boost, giving us rapid access to new ideas. but numerous studies have shown that on a collective level, knowledge workers using AI assistants produce a smaller range of ideas than a group working manually. We've created a hive mind, except the hive is really boring and keeps suggesting the same five ideas.

3:41Consider critical thinking. We surveyed knowledge workers about their use of AI. They reported that they put less effort into critical thinking when working with AI than when working manually. And this fact was greater when they had greater confidence in AI and less confidence in themselves. Consider memory. When people rely on AI to write for them, they remember less of what they wrote. And when they read AI-generated summaries, it's hardly surprising that they remember less than if they'd read the document. And finally, consider metacognition, which is the ability to think about your own thinking process.

4:23Working with AI requires significant matter-cognitive reasoning about your task goals, decomposing the task, the applicability of Gen AI, your ability to evaluate the output. These are things which are built into the process of working directly with a material and which become problematic when that material engagement becomes intermediated. Basically, we've become middle managers for our own thoughts. So what's the score? We have fewer ideas. We think about them less critically. We remember them less well. And we have a harder time doing it. Taken together, we can see that AI-assisted workflows can have profound effects on human thinking.

5:05And this extends even to seemingly trivial, mundane tasks, because these everyday opportunities for exercising our creativity, our critical thinking, and our memory are essential for protecting our cognitive musculature and allow us to rise to the occasion when an exceptionally complex task comes our way. Studies show that when we don't use our brains, they get worse at brain things. Nobel Prize Committee, please hold your applause.

5:34Is this the cost of progress? We've solved the problem of having to think. Unfortunately, thinking wasn't actually a problem. it's like we invented a cure for exercise and then wondered why we're out of breath all the time it doesn't have to be this way beyond AI as an assistant I believe that AI should be a tool for thought AI should challenge, not obey and I believe that right at this moment we are at a critical juncture where the world of work is poised to be transformed by generative AI and we must act now to shape and drive that transformation towards humanistic values. Of these two diverging roads, we must take the one less traveled.

6:22Beyond getting the job done, a tool for thought helps us better understand the job. Beyond getting it done faster, it helps us get it done better. Beyond getting us to the right answers, a tool for thought helps us ask the right questions. Beyond automating known processes, it helps us explore the unknown. What does this look like? What I'm about to show you is a prototype developed by my colleagues and me at the Tools for Thought team at Microsoft Research in Cambridge. Now, please bear in mind that this is a live research prototype. It's not a product. And it's just one of a series of explorations that our team is conducting to study how different modes of working with AI can enhance human thought.

7:07So let's look at a fictitious example. Clara and her colleagues run a company that sells bottled beverages. They've just had a meeting to discuss a new industry report that seems to have some pretty important findings about consumer preferences for sustainable packaging. Clara's colleagues have asked her to write a proposal arguing for how the company ought to respond. so she really needs to get to grips with this report, understand its findings and its data and how it fits into her business context. She starts by loading some documents into her workspace. There's the meeting transcript to remind her what was discussed.

7:51There's a recent internal report from her own business and, of course, there's the industry report which she opens. She sees an overview of the document along with section-by-section summaries except these aren't really just summaries. We think of them more as lenses. They're customizable micro-representations of the text that can emphasize what is most relevant to the task at hand. So in this case, Clara selects the consumer's lens. She can select a section for deeper reading. As she reads, she makes notes about her thoughts and highlights excerpts from the document. As she reads, she also sees AI-generated commentary and critiques.

8:35We call these provocations. Note how this process is a hybrid of completely manual reading and completely relying on AI to read for you. Clara still reads, but intentionally and strategically. Now, as Clara is working, she's building up an outline of her argument manually. this outline is lightly structured and allows her to sketch out the flow of her argument at a high level while still retaining deep connections and being grounded in the source documents, as a result of which we can already generate a draft of the proposal. And Clara can do things here like add a heading to the outline to generate a paragraph.

9:13But what I want to draw your attention to here is that while this text is AI generated, Clara has a completely different relationship to this text than if she just dropped in some documents and said, write me a report, because this text is deeply rooted in a cognitively effortful but interactionally effortless thought process. It reflects Clara's decisions, Clara's judgments, Clara's unique personal professional expertise. She sees another provocation, this time in the outline. In this case, she decides that while the provocation is useful, she does not need to address it. Unlike typical AI suggestions, provocations are not meant to be applicable all the time.

9:57They're instead meant to stimulate your thinking about your work. Because if you understand your work well enough, deeply enough, to make the confident decision not to accept a piece of feedback, then the feedback process is still working as intended. But we're not done yet. Clara has entirely new ways of interacting with this text because of generative AI. A really simple example is that she can just resize a paragraph to change its length. She can also rapidly test different versions of this text. And at select strategic points, indeed, she writes. As she writes, she sees provocations that, rather than auto-completing her ideas, they raise alternatives, they identify fallacies, they offer counter-arguments to help her strengthen and develop her own argument.

10:47There's something you won't find anywhere in this interface, and that's a chat box. Clara's not having to chat with anything to do her work, yet she is silently and appropriately assisted by her computer as a computer and not as an ersatz human. Throughout this process, Clara has been assisted and, yes, probably worked faster because of AI. But she's also maintained direct material engagement at strategic points. She read the relevant portions of the document herself. She constructed her decisions and her argument herself. And ultimately, it can be said, she has written this document herself. Moreover, she worked better because of AI.

11:27AI provocations at every stage of the process kept her metacognitively engaged, always looking for critiques, alternatives, and lateral moves. We have been studying the effects of tools like this. And the results are promising. You can demonstrably reintroduce critical thinking into AI-assisted workflows. You can reverse the loss of creativity and enhance it instead. You can build powerful tools for memory that enable knowledge workers to read and write at speed with greater intentionality and remember it too. It turns out, with the right principles of design, you can build tools that are the best of both worlds, applying the awesome speed and flexibility of this technology to protect and enhance human thought.

12:16These are simple, general principles, like ensuring that the tool preserves material engagement, offers productive resistance, and scaffolds metacognition. And while we've been primarily studying professional knowledge workers, we believe that these principles can extend to all aspects of AI use, including when we use it in our daily lives, our hobbies, and even in education. I repeat, efficiency is not the aim of tools for thought. Better thinking is. But sometimes you can't have both. I used to think there was no such thing as a free lunch in human thinking. This is so much better than a free lunch.

12:57This is a lunch that pays you to eat it.

13:03I want to close with some thoughts on the values that we have. in developing AI software. What if AI gets to the point where it can do a better job of thinking than humans? Why should we care so much about protecting and augmenting human thought? There's two reasons. First, there may always be ways of thinking that remain unique human strengths, of which we may not even be aware. Second, perhaps more importantly, we take the position that the ability to think well is essential for human agency and empowerment and flourishing this echoes an ancient question people once asked you know if writing if books of the internet can remember for us does it matter that we cannot people once asked if maps can navigate for us does it matter that we cannot now we ask if machines can think for us does it matter that we cannot?

13:59If machines can speak for us, grieve for us, pray for us, love for us, does it matter that we cannot? To me, the answer is pretty obvious. When I began studying human-AI interaction 13 years ago, it was inconceivable to me that we would be asking these questions in my lifetime. But we are, and we must. I leave you with this thought. What would you rather have? a tool that thinks for you or a tool that makes you think.

14:38That was Advait Sarkar at TED AI in Vienna, Austria in 2025. If you're curious about TED's curation, find out more at ted.com slash curation guidelines. And that's it for today. TED Talks Daily is part of the TED Audio Collective. This talk was fact-checked by the TED Research team and produced and edited by our team, Martha Estefanos, Oliver Friedman, Brian Green, Lucy Little, and Tonsika Sungmarnivong. This episode was mixed by Christopher Faze-Bogan. Additional support from Emma Taubner and Daniela Balarezo. I'm Elise Hu. I'll be back tomorrow with a fresh idea for your feed. Thanks for listening.