In short
Dr. Christof Koch argues that today’s AI (including large language models) is unlikely to be conscious because consciousness depends on specific brain-like causal structure, not just input-output behavior. He also discusses how consciousness can be measured in “behaviorally unresponsive” patients and why bridging the “hard problem” (physical processes vs. subjective experience) remains unresolved.
Guest backgrounds
The episode features Dr. Christof Koch, a theoretical physicist (PhD) turned neuroscientist. He spent 25 years as a professor at Caltech, worked 14 years with Francis Crick, and later became chief scientist/president at the Allen Institute for Brain Science. He now runs the Tiny Blue Dot Foundation studying perception and its therapeutic benefits.
Key claims
(1) About 25% of patients diagnosed vegetative/behaviorally unresponsive are covertly conscious. (2) Koch supports an empirical “footprints of consciousness” approach (neural correlates) while saying it won’t explain why experience exists. (3) Integrated Information Theory (Tononi) is a leading consciousness-first framework. (4) LLMs may mimic function but lack the integrated causal structure IIT requires for experience.
Notable examples
covertly conscious patients detected via perturbational complexity (TMS + EEG); cerebellum lesions causing coordination deficits without loss of consciousness; psychedelic and near-death experiences showing self-boundary dissolution; split-brain patients having dissociated consciousness; quantum mechanics concepts (entanglement/contextuality) discussed as metaphysical possibilities but not evidence for AI consciousness.
Written by AI. May contain mistakes. Listen to the episode to check what was said.
Chapters
Tap a time to open that second in VOPersonal Insights on Psychedelics
0:00 to 1:06
Dr. Koch discusses his experiences with psychedelics and their impact on his understanding of reality.
“I experimented with psychedelics when I was young.”
Understanding Consciousness in Vegetative States
1:06 to 2:41
Exploration of consciousness in patients declared vegetative and the implications of their brain activity.
“But people never complain that if lesion in the cerebellum, never complain about loss of consciousness.”
Dr. Christof Koch's Academic Background
2:41 to 6:42
Dr. Koch shares his extensive academic journey and notable collaborations in neuroscience.
“Yeah, so as scientists, you are a physicalist.”
Philosophical Foundations of Physicalism
6:42 to 11:14
Discussion on the evolution of physicalism and its implications for understanding reality and consciousness.
“Now again, this is not my grandfather's materialism anymore.”
Challenges of Understanding Consciousness
11:14 to 14:00
Dr. Koch addresses the hard problem of consciousness and the relationship between matter and subjective experience.
“We now know that 25 % of these people are actually conscious, called covert conscious.”
Understanding Conscious Experience
14:00 to 15:04
Explore the foundations of consciousness and its relation to neural correlates.
“I have to look at an oscilloscope again.”
Detecting Consciousness in Patients
15:04 to 18:38
Learn about the tools and techniques to detect consciousness in patients deemed unresponsive.
“As I said, it's just independent what you believe about the metaphysics of consciousness.”
Ethical Implications of Consciousness Detection
18:38 to 21:47
Discuss the ethical dilemmas faced when making life support decisions for unconscious patients.
“Or do you see any change in that complexity?”
Theoretical Insights on Consciousness
21:47 to 24:13
Delve into the theories surrounding consciousness and the implications of panpsychism.
“Yeah, so this was primarily done, so we, you know, it's why this work on patients sort of widely published done over the last 20 years by Giulio Tononi and then an Italian neuroscientist, neurologist, Marcello Massimini.”
Personal Experiences with Consciousness
24:13 to 28:00
Hear about personal transformative experiences that influenced views on consciousness.
“It's always about me, me, me, explicitly, implicitly.”
Show all 23 chapters
Exploring Idealism and Consciousness
28:00 to 30:00
Learn about the concept of idealism and its implications for consciousness.
“So it doesn't imply existence of a God or hierarchies of God, anything like that.”
Psychedelics and Transformative Experiences
30:00 to 32:50
Discover how psychedelics can lead to transformative psychological experiences.
“But, you know, I experimented with psychedelics when I was young.”
Near-Death Experiences and Their Impact
32:50 to 35:00
Examine the similarities between psychedelics and near-death experiences.
“It doesn't cure them of the cancer, they will still die, but they are now willing, they have this completely transformed psyche.”
The Interface of Consciousness and Physics
35:00 to 37:13
Investigate the relationship between consciousness and modern physics concepts.
“Or you can say, no, what happened in those circumstances?”
Quantum Mechanics and Biological Relevance
37:13 to 42:00
Debate the significance of quantum mechanics in biological processes.
“So, I mean, there's the physicalist view.”
Quantum Mechanics and Biology
42:00 to 45:00
Explore the relevance of quantum mechanics to biological processes.
“It's vastly colder than outer space because outer space is 4 degrees Kelvin, the background radiation.”
Psychedelics and Brain Complexity
45:00 to 48:30
Discuss how psychedelics influence brain activity and consciousness.
“Well, there's actually some evidence that the complexity slightly increases.”
The Nature of Consciousness
48:30 to 52:10
Delve into the relationship between brain structure and consciousness.
“Normal, typical adults give rise to people like you and I, who are very conscious.”
Artificial Intelligence and Consciousness
52:10 to 56:04
Examine the debate on whether artificial intelligence can be conscious.
“There's one case I know here north of us in British Columbia, where they share part of their brain.”
Understanding Consciousness Through IIT
56:04 to 58:57
Explore how Integrated Information Theory connects consciousness with causal power in systems.
“So sooner or later, you know, entropic either will be conscious or is already conscious, you know, clawed.”
The Simulation vs. Reality Debate
58:58 to 59:36
Discuss the difference between simulating consciousness and actual conscious experience.
“But funnily enough, when you turn on the simulation, you don't have to be afraid that it's going to suck you into, that space-time is going to distort around the computer carrying out the simulation.”
The Limitations of Machine Learning
59:37 to 1:01:04
Analyze the limitations of current AI in experiencing consciousness despite passing tests.
“And that, according to IT, makes all the difference.”
Future Experiments in Quantum Connections
1:01:06 to 1:01:51
Hear about upcoming experiments related to quantum connections and their implications.
“Well, I've taken up more than an hour of your time.”
Transcript
Automatic transcript. May contain errors.0:00I experimented with psychedelics when I was young. I'm 70 now. And it very much informed my view of the world or view of reality or view of civilizations, structures and all of that. But could it simply be the suppression of the self and the resulting experience? It's just your brain. In the case of psychedelics, your brain on drugs. Okay, so all it teaches us that brains can reach extraordinary states. If you have someone in a vegetative state who's been declared in a vegetative state and you use this device and detect that there is complex neural activity that suggests consciousness, if you pull the life support on that patient, do you see some spike in complexity that might correlate to their recognition of what's happening?
0:52We now know that a quarter of these patients, one out of four of these patients, is actually conscious. They're there. They're present. They're just not able to signal it. If you lose the cerebellum, it's not good for you. Cerebellum is there to do sensory motor coordination among others. But people never complain that if lesion in the cerebellum, never complain about loss of consciousness. It doesn't seem to relate to consciousness because it's not very well integrated. Everything is mental. Everything is phenomenal. Everything ultimately is consciousness.
1:22I'm a physicist. I got my PhD in theoretical physics, but I've studied for the past 40 years brains. I'm a neuroscientist. I was for 25 years a professor at Caltech, California Institute of Technology. I had a lab studying the biophysics of the brain, but also cognitive neuroscience and the way people see and experience. And as you mentioned, I worked for 14 years with Francis Crick, the Nobel Prize winning molecular biologist who discovered you know i co-discovered the double helical nature of the dna and then shifted as he went from england to la jolla in southern california shifted his interest from molecular biology to consciousness i left caltech 15 years ago to join the paul allen institute paul allen the co-founder of microsoft for brain science here in seattle i was a chief scientist and then its president and I've stepped down from executive duties.
2:24I'm still employed at the Allen Institute, and I also run a foundation called the Tiny Blue Dot Foundation based in Santa Monica to study perception, what we call the perception box, and its therapeutic benefits for all people. So that's briefly my biography. Yeah, so as scientists, you are a physicalist. Well, it used to be known as materialist until early the 20th century. An ancient metaphysical position, Demokritos, one of the first pre-Socratic Greek thinkers, he famously said, all there is is atoms and the void. And today this is called physicalism that essentially asserts everything is physical.
3:14put differently everything is quantities is numbers now the devil's in the details and what used to be called physical or material if we go back to materialism was very simple to understand on a classical physics so on a classical physics you're taking object like this you know this is one of these things to you know train your muscles and it has position and velocity and momentum. And anything that has a position in a momentum under classical physics, you can completely determine its course, its past and its future. And if you knew the location and momentum of every particle in the universe, everything would be an open book.
4:03In principle, if you had a big enough computer, you can compute everything that happened in the past and everything that you expect to happen in the future. Now, of course, we know the world is not described by classical physics because one of the two revolutionary theories of the 20th century is quantum mechanics. So now we have this underlying thing that cannot be directly observed, the wave function. And the wave function is interpreted in a probabilistic way. And then, of course, to get from wave function to real things happening, you have so-called the collapse of the wave function. and you've got these weird paradoxes that are very paradoxical for us to understand because we don't observe them at our level.
4:47Things like can be simultaneously in two states. So Schrodinger's cat experiment where the cat is simultaneously dead and alive. And our intuition tells us, well, look, either you're dead or the cat's alive. It can be in both states. But under certain conditions, this is exactly what nature permits. More recently, although this goes back to Erwin Schrödinger, he had predicted this property of quantum system called entanglement. What we mean, so if you have a system, a single quantum mechanical system, and this relates to consciousness already, a single quantum mechanical system, you can separate them over vast distances, but they're still one system.
5:33What do I mean by that? So let's say you take a pair of entangled particles, one is spin up and the other spin down. So because they're in a superposition, the system could be like this. It's in a superposition of this state and this state. Okay, and you don't know which. And then you move them very far apart. Let's say a light year, such that you turn on a flashlight at one location, that light wouldn't get to the other location until a year later. So they're really, really, really far apart. Yet, what we know now to be true empirically, beyond a doubt, that as soon as something interacts with that one system, let's say the system on my left, and knows that the spin is up, instantaneously, independent of the distance, the state of the other one is down.
6:23yeah now did einstein famously called this in 1935 spooky action at a distance because what what what mechanism allows the information this day to propagate across vast distances and now there are even weirder thing called quantum contextuality that people are that people are testing we know this to be true because now we have a an industry called quantum computer industry that exploits some of these weird superposition but what that means that we don't know anymore what it means exactly to be physical and some people in the foundation of physics in fact are now arguing that there may not be absolute facts in the sense that i'm a biker i don't own a car i have several bikes my bike at rest has a particular mass it weighs like i don't know 25 kilo or whatever but quantum mechanics would say until and unless something interacts with that bicycle it doesn't have probably speaking a math it's not that you don't know the math the math that's just an epistemic limitation we you know i don't know more things in in the world no it's that it simply doesn't make sense to talk about it like it has a specific math until depending on the reading, either something observes it or otherwise interacts with it.
7:47Now again, this is not my grandfather's materialism anymore. So that's been one persistent challenge. And in fact, some physicists in foundational physics are now bringing in consciousness. They are beginning to argue that consciousness, in a sense, has to be built into at the rock bottom the rock bottom description of our of our reality so that demarcation line between physicalist and non-physicalist is is very very difficult to define and so people say well it's the future physics well okay but the future physics you know that's like waiting for for you know waiting for the rapture yeah maybe in future we'll have a physics and maybe that includes consciousness for all i know so um it's difficult to pin down physicalism the other challenge with physicalism has always been what the philosopher david charmas calls a hard problem yeah to explain why is it that three pounds of brain matter like this and in principle it's just like another piece of matter like this okay this is hard matter or semi-hard matter this is you know soft matter squishy matter but in principles it constituted out of atoms and molecules and electrons and all that interacting by the laws of quantum mechanics nothing special here yet this thing can love and hate well where does that come from and even if you take it down even if you carry out the program that francis crick and i initiated in the in the early 1990s of identifying for anyone experience what are the exact neurons in what state do they have to be do they have to involve microtubulee or superposition or whatever you want to come up with.
9:28Why is it that this particular mechanism, you know it's a mechanism like any other mechanism, like a fancy Swiss clock, why is it that this mechanism can feel pain or feel pleasure or feel boredom? I mean it's a complete non sequitur, right? On the one hand you have the laws of physics, on the other hand you have experiences, pain, pleasure, boredom, anger, you know they're linked, you know just a single hit on the head will tell you, yeah, if you hurt the brain, you're going to seriously interfere with conscience. But why should they be linked? There's nothing in the laws of science that tells us matter can love and hate.
10:10So those are the two challenges. And I mean, they've been around for several decades now. The neurocorrelates, exactly what was lighting up at the time that you were feeling or experiencing certain phenomena. And at what point did you decide that that wasn't going to be enough? I mean, I guess you knew that wasn't going to be enough, but you thought it was useful in the absence of some other empirical experiment that you... Well, if, assuming we had the, and of course, I lost a famous bet against David Schalmer, because we had not discovered them after 25 years. But he agrees with me they will be discovered.
10:56This is discovering the footprints of consciousness in the brain. It's another way to think about it. That is a perfectly feasible project, and that will be immensely useful because once I know what the footprints are, I can look for them. For instance, there are many patients that are behavioral unresponsive. They used to be called vegetative state. We now know that 25 % of these people are actually conscious, called covert conscious. They're fully conscious, or they may be fully conscious. We simply don't know, but they can communicate that to the outside. So they're like a standard astronaut.
11:31Well, if I have the NCC, I can just look. Are they present in this patient? I can decide, for example, most experts who concern themselves would assume that a third trimester fetus probably is conscious. Well, if I have the NCC, I can say, well, are they there? Or when do they occur? Are they present already in the second trimester or maybe only in the third trimester? What about here? I have a dog, Bernice Mound dog. What about dogs? You know, and I can, so this is an empirical program tracking the footprints of consciousness that will be immensely practical importance to the term consciousness, to measure it, maybe quantify it in normal people, in people with various diseases, disorders, psychiatric disorders, animals, etc.
12:21So it's useful, but of course it does not explain why this particular thing in this configuration gives rise to red and slightly different to orange or to an orgasm or to toothache right so there are two ways to look at that so one for the longest you have to start rather so most people who think about consciousness and make theories of consciousness they take the brain and try to squeeze the juice of consciousness out of it you know the trying to turn the waters of the brain into the wine of consciousness to adopt a biblical metaphor and they say well it has to be this thing it has to be a global workspace or broadcast of information or layer 5 neurons or nmda receptors or microtubule like stew hammeroff you know or whatever well again why this and not that why microtubule not other some some other cellular organism you know ultimately it's very difficult to go beyond that question so there's one theory that's unique really that's um called integrated information theory yeah it's a different attack it's a consciousness first account so it really starts where rene descartes started the what the only thing i'm absolutely certain of is that i'm conscious because even in doubting it I reassert it.
13:52And consciousness, furthermore, is the only way I encounter the world. If I'm a scientist, I still depend on, I have to read papers or books, that's visual consciousness. I have to look at an oscilloscope again. I have to listen to a Geiger counter, that's auditory consciousness. So the only way I interact with the world, including my own body, is through my conscious experience so if you think about it the only thing i have direct acquaintance with i i have direct knowledge of is conscious experience and so any theory has to start with with any theory of consciousness which is different from a theory of the neural correlates of physical substrate of consciousness any theory of consciousness has to start with consciousness and then sort of go from there to say, well, which system is conscious and what are they conscious of?
14:47And this theory, integrated information theory, the main architect of that theory is an Italian-born American psychiatrist and neuroscientist, Giulio Tononi at the University of Wisconsin-Madison, is a theory that does that. Now, it's a scientific theory. It may well be wrong. yeah let me ask first of all i'm fascinated by you have a startup right that's that's working on an instrument or instruments that would be able to detect consciousness in in people uh who are otherwise considered brain dead how how far along have you gone in that have you abandoned that or Oh no, no, no, no. As I said, it's just independent what you believe about the metaphysics of consciousness.
15:40There's no question that we have now tools, so this was developed over the last 20 years, techniques to query the brain. Essentially you do it, you hit the brain using magnetic pulses, and then you're sounding, you're listening to the echoes using EG, electrical brainwaves. right so you send in a pulse of energy you essentially you know it's like taking a bell and hitting it with a hammer and then listening to it and a conscious brain whether that person is awake like you or i or in it in a in a REM sleep where the person is experiencing or on a high dose psychedelic where they may be immobile but highly conscious the complexity of this brain wave so you can compute the complex how complex is called lempel ziv complexity and if in conscious people it's always above a threshold in unconscious people whether they're regular people regular folk but they're anesthetized or they're truly in a very deep coma where it's unambiguous that they that there is no activity the brain complexity is very low in the simplest case yeah eg is flat lined i mean that's extreme case of very low complexity and so we've developed this tool now and started this company that you mentioned called intrinsic powers we were working with people at mgh at harvard and in in in madison and in in columbia trying to put this into the workflow because what happens today is if you or i have a car accident or hemorrhage or cardiac arrest and you're alive you know someone calls 9-11 you get into the icu you're on life support now on ventilator you might be there you know unresponsive eyes open so the these people were called vegetative states but as i said are now called behavioral unresponsive and if you remain in this state for three or four or five days then the the clinical team will initiate discussion with the family and says is this what they would have wanted and here in the developed world between 70 and 90 percent of the time family doctors decide no and they pull support but we now know that a quarter of these patients it was a very large paper last year published in the new england journal of medicine roughly a quarter percent depending on the demographics and all of that one out of four of these patients is actually conscious they're there they're present they're just not able to signal it and so we want to know that because then i can give this device can give the clinical team and the family one additional bit literally it's one bit are they there or are they not there and that can then help further inform you know what the doctor and and what the family wants to do with that information.
18:40So I like it a lot because, well, A, we help people, and B, it demonstrates that this very airy, ephemeral topic of consciousness, you know, it's been around with us for the last 3 ,000 years, seems very airy-fairy, right? But this, if you ever called upon this to make this call for a loved one, right, this is the most consequential decision you can make it's very existential are they there or are they not there and should we pull then you know should we pull the plug or not and so this is where the this this abstract mind body problem hits the you know the rubber hits the road yeah and let me just i don't want to get lost on that but have you how far are these experiments gone if you have someone in a vegetative state who's been declared in a vegetative state and you use this device and detect that that there is complex neural activity that suggests consciousness if you pull the life support on that patient Do you see some spike in complexity that might correlate to their recognition of what's happening?
20:00Or do you see any change in that complexity? No, because, I mean, the technique is, so it takes an hour, an hour and a half to establish. and then of course you know you have to make this you make this information available to the doctors and ultimately to them to the team and then it takes you know a lot of back and forth and it's it's complicated uh craig because it's a very complicated question and we cannot help so there's three when you get that call There are three things you want to know. Are they alive first? Are they there? And then lastly, are they going to recover? And right now we can't say that very well, whether or not the fact that they're conscious is encouraging, even though they may not be able to respond.
20:54right so um it's it's a very difficult decision to make do you think i mean imagine yourself if you are if you're in this situation unable to communicate and it's unclear it depends of course on your age if you're 20 it's much better than if you're you know 60 or 70 what would you like do you want to be forever in this in this state where you can't communicate but you're conscious Yes. And then, you know, now your brother or your sibling, I mean, or your parent or your child has to make this decision. So it's a very complicated decision environment. And because at this point we can't tell you, yes, he's there, and 95 % chance he's going to recover.
21:41I can't tell you that.
21:46So was that work concurrent with your work with Krik? Yeah, so this was primarily done, so we, you know, it's why this work on patients sort of widely published done over the last 20 years by Giulio Tononi and then an Italian neuroscientist, neurologist, Marcello Massimini. Yeah, and that went on at the same time as we, you know, tried to push this empirical program in people and in lab animals to study the footprints of consciousness in the brain. A purely empirical program that, by the way, does not depend on whether you're a physicalist or dualist or a pampsychist or an idealist. It's just we just want to know the footprints of consciousness, how to study them, how to measure them, detect them that we could then use for diagnostic and prognostic purposes.
22:43What point did you decide that you were never going to close that gap between correlation and causality and switch to a form of panpsychism. I mean, was it a moment or was it...? Well, first of all, I've never abandoned the hope that we can get a theory that explains, I mean, a theory like integrated information theory. And panpsychism, certainly the way I think about it is in the sense that it may well be possible a that every member every evolved organism including simple singles simple cells individual cells a mobile may feel like something itsy-bitsy okay and integrated information theory in principle because the vast complexity of the ten thousands of different proteins present even in a single cell is such no computers ever managed to simulate that out of all this vast complexity may arise some very very simple proto feeling of being alive as is not being alive that's entirely possible i don't know how to empirically test it right now but it's it's it's entirely it's entirely possible what happened to me is slightly different i had two extraordinary experiences that i describe in my last book then i am myself the world um one of which was sort of a near-death experience in the first week of the of the pandemic where uh christoph was gone the world was gone everything was gone except this light this very bright light some people describe it as a tunnel and a feeling of uh of terror and ecstasy just those three things terror ecstasy a bright light there was no space all of space had convulsed itself into the single the single point the singularity there was no time passage of time that's always with us collapse that's moment this experience didn't last too long or too short it simply was it was probably under 10 minutes by the clock and there was no self there was no christoph there was nothing there you know the usual distinction between observer and observe know and knowing apprehended and apprehended all of that was gone and so it it's what some buddhists often call a non-dual experience yeah it wasn't particularly pleasant i mean as i said it was terror and ecstasy yeah but not not it wasn't the result of a psychedelic experience it was something i uh yeah i prefer not to to talk about it yeah um but what it taught me is two things that a the sense of self you know we all have a sense of self explicit or implicit some people have it weaker they constantly belittle themselves you know they they constantly think oh my god everyone hates me and other people like our president have a let's just call it a highly exaggerated sense of uh of self um And it's always, we all live in this gravitational field of planet ego.
26:02It's always about me, me, me, explicitly, implicitly. But then just like an astronaut on a special condition can become weightless and floating out of space. So on a certain conditions, including psychedelics, of course, you can totally lose that self. And what you realize then that self-consciousness is just a subset of all possible experiences. the fact that i know i'm me i know what i had for breakfast i know i'm gonna die one day all of that is is is consciousness but you can also if you don't have that like in that state whatever remains is clearly highly conscious and then it took away the and the fear of death you know the which is not uncommon but then i had a second but it didn't change fundamentally my metaphysics the way i think about the world that happened several years later three years ago when i had a a mystical experience where again you lose a sense of self you lose where you are and what you are and you feel i mean it's very strange to put it in words you feel you become one with everything you merge with the universe and and i mean the title of this book then i must have the world comes from this um it's a translation from the german which is what tristan in isolde in richard wagner you know paulner's opera sing when they they have this mystical experience where they become one the two the the lovers become one but they also become one with the universe so they that's what they think then i i know the most rapturous music composed in the western canon they become one whatever remains become once with everything and that is you know profoundly transformative because you know once i came out of it i don't know how long it lasted probably under an hour um it's just i mean you now have direct acquaint i had direct acquaintance with what i felt was like what what is truly underlying everything is mental that i realized oh my god everything is mental everything is phenomenal everything ultimately is consciousness and this material universe in which we exist ultimately is a manifestation of something mental so this is known as idealism right they believe that no you know most of western mind body metaphysics revolves around these two poles the physical and the mental and you know since the greeks most people say well the only pole that really exists it's the physical and everything else has to somehow emerge out of that in ways we don't understand or some people say no it's both so that's your classical dualist most people are probably in this country probably dualist right there's clearly the brain and and matter and all of that but then there is my soul uh you know and that's separate uh and then of course and then they are idealists well then they also pump cycles like uh like uh joff you interviewed and then they are also idealist like arthur schopenhauer probably the best known 18th century uh early 19th century germ philosopher And then modern idealists like Bernardo Castro, who says what ultimately exists is mental.
29:30The mental follows laws. It's not supernatural. So it doesn't imply existence of a God or hierarchies of God, anything like that. It just says finally what exists or truly exists is something. It may be very primitive. It may be evolving under some sort of instinctual law or something. and that gives rise itself to and to the material and that's to me that's exactly what it felt like when i had this experience yeah uh and and the i mean i not to get into why i'm interested in this But, you know, I experimented with psychedelics when I was young. I'm 70 now. And it very much informed my view of the world or view of reality or view of, you know, the civilizations, structures, and all of that.
30:37How is that? What's that? I mean, how is that? In what way? Well, just in the way that you're describing, the breakdown of a sense of self and understanding, not a logical understanding, but the feeling that everything in the universe is all one thing. And so you're all made of the same stuff. Yes. And so what interests me about reading about your research, you identify in the Crick work, or maybe it happened after the Crick work, the areas of the brain responsible for the sense of self, for the experience of the self. And could it be that psychedelics in that self organizes perception in a way that you can operate in the world, manipulate the world?
31:41But if you remove that sense of self, which you have a physical correlate, then you're without that structure. And that gives you the feeling of oneness. But could it simply be the suppression of the self and the resulting experience? Yeah, rather than it. Yeah, go ahead. Yes. So a physicalist would say, okay, great. Great that you had this experience. Congratulations. But it's ultimately just your brain. In the case of psychedelics, yeah. So it's your brain on drugs. Okay. So all it teaches us that brains can reach extraordinary states. Now, if we just stay with that for a moment, what is still extraordinary are the fact that many of these experiences can be very transformative, almost always in a positive way.
32:37You know, we know this going back from psychedelics, going back to the research at Johns Hopkins, where people that have stage 4 cancer, where medicine is given up, we can't really do anything anymore, they're terrified of dying. They get a high dose of psychedelics and then they totally transform themselves. It doesn't cure them of the cancer, they will still die, but they are now willing, they have this completely transformed psyche. We know, for instance, there are hundreds of clinical trials, both here and abroad, doing psychedelics for treatment resistant depression, major depressive disorder, generalizing, PTSD, etc.
33:15etc. And we know through these questionnaires, MEQ30, the mystical experience questionnaire, that the extent to which people have a mystical experience in these trials directly correlates to the extent that they derive therapeutic benefit. So in other words, it's quite likely when that patient who's depressed has a mystical experience, in this case induced by psychedelic, no matter the underlying metaphysics will help them and they will they might fall out of they might not even score as a depressed anymore you know not immediately afterwards you know this is not an instantaneous effect but then you think about it you you know you cannot help i mean you must probably still uh craig think back about your experience right that you had 50 years ago so because you constantly think about it and and and you talk with other people about it you read about it maybe you have a therapist you talk to them about it and slowly it changes your entire life and your attitude your mo your motivation so independent of the metaphysics the fact that an experience that typically lasts under an hour that's you know you can't really control very well right can have this transformative experience itself is i mean you know nothing short of miraculous it's even more challenging to think about when you have near-death experiences so near-death experiences are very similar in character to this mystical experience people have showed that and these of course typically occur in a highly traumatic circumstances so for instance you have an in-hospital cardiac arrest right or you're you're near drowning or on the battlefield or a car accident where you bleed out so these are you know but all of our knowledge they should be massive causing massive trauma but instead people radiate this equanimity and they're content they say it's the most meaningful experience i've ever had in my life it totally changed my attitude to my loved ones so no matter what the underlying implicate metaphysical implication ask for first they are very they're among the most meaningful and profound experiences in that we know of period yeah independent of what you think about it yes but then there are these two obvious interpretation one is okay ultimately it's just your brain nothing else move nothing else to see move on, move on, nothing to see.
35:34Or you can say, no, what happened in those circumstances? And that's the road I'm trying to, I'm going down. Somehow your own, you, so usually we are, we have this boundary between my consciousness and your consciousness. I don't experience you directly. Right? To find out how you feel, I have to ask Craig, how do you feel? And you can be with your partner, your wife or your spouse, your bodies can physically penetrate, but you still don't know what she is or he is thinking. Ultimately, all you have is their words and their gestures, right? It's always indirect. So we live in a world where we each have our own planets, if we want, our own bubbles.
36:16But under certain circumstances, this boundary becomes dissociative or becomes sort of dissociates, dissolves and suddenly you now become part of this greater reality. That's my interpretation. And the question is, is this compatible with some currents in modern physics? Where, you know, given these weird quantum effects and entanglement, contextuality, etc. And the fact that you can't even define whether things exist without them interacting and being observed, Well, to what extent are these interpretations compatible with some of these foundational physics? I don't know. I'm talking a lot to these physicists.
37:07I organized a workshop on this topic, etc., to see can they be reconciled. Yeah. Yeah. So, I mean, there's the physicalist view. And what I'm hearing is that in your correlate work, your work on the correlates of consciousness, what neurons in the brain fire to correlate with certain mental states, that you just cannot close that gap between the physical and the experience. And so you offload it to, it's a fundamental property, and these complex neural mechanisms somehow can capture that fundamental property. and and and but but i guess my one question off that do we know yet or at least uh broad brush which parts of the brain consciousness depends on well okay so it depends on many things it depends on your heart you know if your heart doesn't beat you will faint within 10 seconds approximately so we know that it depends on mechanism in the brain stem and we know small strokes in the brainstem can render you dead or uh in coma where you're totally unresponsive but as fast we can tell you know given what that we can see these complex scenes that i see right now given that i can hear and you know be conscious of so many different things that is the property of the outermost layer of the brain the cortex you know which is really it's it's a it's a sheet like this you know like a cloth like millimeters so it's a like a pizza 12 to 14 inch pizza that thickness and you have two of them they're highly convert you know highly convolved and convoluted and they crammed into my left and my right hemisphere in particular it seems to be the back the back part of that structure that seems to give rise to seeing and hearing and touching and wanting, which are the modalities that we understand best.
39:35But that's under both, again, that's independent of whether you're a physicalist or an idealist, because we can, I think it's clear, the evidence shows that if you don't have these parts of the brain, you're going to be in severe trouble, or we can predict, I mean, Oliver Sacks wrote about 30 years ago, depending on which part of cortex are gone, you will have specific deficits, It's like you are unable to see your face. Although, you know, you can perfectly well see the eyes and the nose and the hair, but you don't have that conscious experience of a face anymore because he lost the neurons that convey that.
40:08So in that sense, there are footprints and you can track them and you can identify them. The question, do they give rise to consciousness? Or, you know, what is the nature of the substrate? or do you need a substrate at all? Yeah, and that's why I was so interested in Penrose and Hemroff's theory because they were trying to pinpoint a mechanism in the neurons of the brain that would channel or in which there would be some quantum effect and then you could offload consciousness to the quantum realm. How do you feel about that, about the microtubules? Well, leaving aside the microtubules, I think that's extremely speculative, and Roger Penrose is the first to admit that.
41:10Let's take the more general question. What do we know about quantum mechanics and consciousness? Well, we can even ask the empirical question. is there any evidence that quant that large-scale microscope microscopic quantum events are relevant to biology let's put it that okay so clearly the creatures like me and you and dogs and trees are subject to the same laws of quantum mechanics just like anything else right but of course they operate unlike if you go for example to quantum to google to quantum computers like google makes them They operate at 27 mK. So zero degree mK is absolute zero, no more molecular motion.
41:55We live at roughly 300 degrees Celsius, 300 degrees above that. So this is unimaginable cold. It's vastly colder than outer space because outer space is 4 degrees Kelvin, the background radiation. So you need extreme isolated environments, extreme vacuum to eliminate all this motion, the jostling of the molecules and the atoms that would eliminate these quantum mechanical effects. Given that biology on this planet evolved in what physicists would call a warm and wet environment, you know, with lots of water, the vast majority of people, of biologists and physicists argue, okay, biology, quantum mechanics simply isn't relevant for biology in general.
42:42Yeah, there are some special effects, like maybe where light meets the photons in your photoreceptors. But by and large, all these large scale, particularly like superposition and collapse, those things don't matter. So I have a collaboration with a bunch of people where we try very hard to show empirically that there are quantum effects, that things like nuclear spin do matter for biology. And there's some tantalizing evidence that we could go into, but it gets very technical about such hypothesis. But so far, the verdict is still, there's so far not a believable reproducible experiment that shows microscopic quantum mechanical effects in biology at room temperature.
43:34I see. Yeah. Although it must be there. I mean, to manipulate quantum states, yeah, you need to super cool them. But that doesn't mean that quantum effects stop happening at room temperature. Well, except that you're right. But then they would immediately within 10 to the minus 9 seconds wash out because, you know, everything is constantly vibrating. Yeah. You know, and so the way you operate quantum computers, you are in this incredible static environment where there's almost no more molecular motion and you can freeze it and then you get this superposition. Given that, you know, our brains are in this state, any superimposed or entangled state would immediately within, you know, a nanosecond disappear.
44:24So that's a challenge. Is there now, are there special protected environments? I mean, evolution is very clever and evolution had a lot of time to select things and anything not, this is also Stu Hamerhoff's argument, I agree with that, anything not ruled out by the laws of physics can in principle be exploited by biology in general and by neurobiology in particular. But right now we simply don't have any positive evidence for that. we and other people are trying but so far it's still uh nothing too convincing yeah one thing that fascinated me and in one of your talks you you talked about uh that under psychedelics the the is it the complexity or the electrical impulses slow down in uh in the brain where you would expect them to do the opposite.
Read the full transcript
45:25Well, there's actually some evidence that the complexity slightly increases. This perturbational complexity there, or lempelziv, actually under magic mushrooms increases in the brain. But on the other hand, if you think back to your own experience, noise, for example, if you just look at, well, you and I are old enough that we still remember television when they went off air, right? When there was a speck of noise, right? Well, that's highly complex. That's very complex, but it's not very meaningful. But the fact is our experiences on the psychedelic can be incredibly meaningful. Right. As I said, as we said before, they can be the most meaningful of your life.
46:09So it can't quite be that. Well, okay, just sort of frozen some some more noise, some more complexity. So I think we're still very early on. And in terms of the neuroscience of psychedelic, despite what press announcement keep on promising, we're still in very, very early days. We still don't understand what they do to the brain. Yeah. Let me ask again, going back to integrated information theory. that's is there a correlate to that in the brain that you have all these different structures of the brain that are cooperating but operating independently and but they're they're integrated and that that's necessary for consciousness is that am i yeah in fact that's why so for instance If you ask me where are most of the neurons, 80 % of your neurons are here in the back in a little brain called the cerebellum.
47:12Okay, that's for 80%. This cortex has roughly 16 billion. This in the back has 69 billion of the 80 and all the rest is only 1 billion. But it turns out they're not very integrated. They're organized in two dimensional slabs and they have primarily feed forward loops. so you know where like in a deep in an llm where one stage excites the next stage excites the next stage as a massive feedback which i think is precisely why the setup if you lose the cerebellum it's not good for you you know when you go to the doctor to do these sorts of tests right that's when that's when you test for a cerebellar function you look like you're drunk you you know you tumble about your speech is slurred etc so the cerebellum is there to do sensory motor coordination among others.
48:03But people never complain that if lesion in the cerebellum never complain about loss of consciousness. So it doesn't seem to do it empirically. It doesn't seem to relate to consciousness because it's not very well integrated. And this is really what cortex does because of its very dense connectivity that's feedback and excitatory, a small world connectivity, rich hubs, etc. That's why I think cortex is the substrate that in us gives rise to this very high degree, particularly in adults. Normal, typical adults give rise to people like you and I, who are very conscious. is yeah uh the um you know when i was younger and paying more attention to this than i have been in the last 30 years because i have a different career uh the split brain i did a lot of reading about the split brain experiments and to me naively uh at that age that settled it for me Well, that's the end of dualism.
49:11That, you know, you split the brain, you have two consciousnesses more or less opaque to each other. Yes. How do you reconcile that with the idea that consciousness is a fundamental property that… It's still the thought. Well, I mean, so in general, it's a question, leaving aside for a moment split brains. I don't right now access your conscience. I don't access this universal consciousness, mine at large, as Huxley said, right? Assuming it exists. Why is that? Well, because typically in order for me to survive, I need to care, you know, evolutionary. I need to worry about me and my genes and my kids, right?
49:57Well, that doesn't work if I feel I'm one with everything, right? Evolutionary, I mean, that's a wonderful feeling, but that doesn't give rise to competition that you need, right? Because I need to struggle, my genes need to survive to make it into the next generation. So there are lots of reasons why my consciousness is isolated from this universal consciousness. Schopenhäus' beautiful metaphor, these ripples or this wave, you take an ocean, think of it like mine at large or universal consciousness. It's this gigantic ocean and there's this little eddy. this eddy has existed for 69 years and you know maybe you know god willing it'll exist for another 10 or 20 years but ultimately this eddy will merge will become up you know will of course disintegrate will lose its identity its egoic consciousness will be gone forevermore and it it returns to to the ocean and so that's also why you and i you know you are an eddy and i'm an eddy and we don't have access directly to each other.
50:59But on a certain condition, these mystical experiences, somehow, possibly when the brain's activity is turned very, very, very low due to psychedelics, because we know psychedelics depress a lot of activity, you might be able to access this sort of more universal, but usually you do not. And so now we come to split brain. I grind to it. So these were done at Caltech, right, by Roger Sperry, who got the Nobel Prize for them. You take a brain, you cut it along the midline here, the corpus callosum, 200 million fibers, and then you have two consciousnesses. This one speaks, this one can sing and hum, but it's also conscious.
51:37And although, as you said, they're opaque, although the brain sits one centimeter away from the other, they don't know about each other. They may as well be at the dark side of the moon. And there are all sorts of conflicts that you can see in the clinic that arise because of that. So each one has its own dissociative boundary that dissociates it from its neighbor just, you know, just one, you know, a tiny, tiny gap away. But that's the experience of all of our lives. I'm isolated from you and from any other conscious. And it's only under special circumstance that we can lose this dissociative boundary and access everything else.
52:15so that the split brain wouldn't really make that more challenging than just to explain in general how is it if mine is truly universal why don't i exit it all the time yeah yeah so so the the you you split the substrate and and it channels two separate well now you have because now you have two smaller brains effectively that's what you're having yeah you have two smaller cortices you can't do it in you know you can't quarter it you can't do it in indefinitely you can only bisect it in in this way yeah you have two independent you have two independent um a related experience that we know very little about it is conjoined twins right there are some it's a very rare occurrence that um that like siamese twins but but that twins are connected at the level of a brain.
53:11There's one case I know here north of us in British Columbia, where they share part of their brain. And it may be under those circumstances that, particularly during sleep, when the boundaries may be down, they may be able to access each other. It's a rather strange case. And the other case may be multiple personality disorder, you know, DID, DENTITY DISSOCIATION DISORDER, where there may live various personalities inside one brain where they have managed to build, typically to deal with massive emotional, sexual, or physical trauma. These people deal with that by having these multiple personalities, and we know they can have different memories, they can have different immune states, they can have different memories for infections, etc.
54:04So there you have a case where the brain had to adapt to traumatic circumstances, did dissociate. Because typically they don't co-exist, these different personalities. They go over time, but they don't exist at the same point in time. So the question is that more like what happens in everyday? I don't know. There are lots of interesting questions and lots of research you could do. Yeah. And I want to go just end on artificial intelligence and the current complex, large language models. Jeff Hinton, who I've had several times on the podcast, is speaking, and he has for a long time. As soon as LLMs came out, I talked to him, and he believed that there was understanding.
54:57He was saying at that time, now he's using the term consciousness. Why could a complex set of artificial neurons not have experience? And I know that you don't believe that they can. Well, in principle, yes, of course it can. Once again, the brain is just a regular piece of matter. And silicon is another piece of matter. So a priori, there's nothing. It's not that this is supernatural somehow, right? A special property that the other one doesn't have. In fact, were you to build what's called a neuromorphic computer? So computer, okay. So that computer, if it truly has our sort of constitution, like my brain or your brain, it would be conscious.
55:51But IIT sort of is not a functional theory. So functional theory, the majority of scientific theories of consciousness are functional, says, well, Well, the brain consciousness has a certain number of functions, whatever they are. And once you reproduce these functions, even in a universal Turing machines, then all the properties will come with it, including consciousness. Yeah. So sooner or later, you know, entropic either will be conscious or is already conscious, you know, clawed. And you can argue, well, maybe not quite because there's still this one missing gadget, you know, whatever. But at least according to the IIT, within IIT, you can formally show using formally mathematics and models of von Neumann digital machines that have very low connectivity.
56:36They are essentially much more like a series of feed forward networks. Yeah. They don't have this heavily interconnected character that cortex has. So you can formally show that you can have two networks. You can have a model of a brain and an LLM or something like an LLM or a von Neumann machine simulating an LLM. Although functionally, they have the exact same transformation from input to output. One will have a lot of causal power, will feel like something. The other one will not feel like something because experience, according to IIT, has to do with the structure. The causal power is inherent in a mechanism.
57:16And that really depends on the way it's wired together. You have to look under the hood. According to IT, you can't just do it like a Turing-like test, like ask a bunch of questions and if it gives me the right answer, then I can say check mark. No, I have to open the hood and look at the underlying hardware. But of course, you could argue it's immaterial because many people already today, there are millions of people who have them as their friends, as their girlfriends, use them as therapists. so practically speaking people seem to behave like they're conscious there's something about you you say that uh that what counts in a computer uh is the transistors opening and closing gates i think that was you not the pattern iat is a causal theory it's really concerned with causal powers and you have to look at the causal power of the actual machine which means you have to go to the CPU sitting in the cloud and analyze the flow of the sort of the causal flow of, you know, electrons going down the, you know, going in the valence band and the copper wire going on the gate of a transistor opening that etc.
58:28It's not, let me give you a really good metaphor. Today we can perfectly well simulate Einstein's equation of general relativity that described the central sun at the center of our galaxies in Sagittarius A-star, okay? It weighs three million solar masses. It has three million solar masses. And so it bends space-time around it so nothing can escape, i.e. it's a black hole. And you can simulate this. But funnily enough, when you turn on the simulation, you don't have to be afraid that it's going to suck you into, that space-time is going to distort around the computer carrying out the simulation.
59:10Well, why not? Or people say, that's a stupid question. It's just a simulation. Well, so it is with consciousness. Yes, today LLMs, like in this interview I did with Kasia, and he perfectly seemed to be a very smart, very eloquent person. But that's a simulation. And simulation, this is the difference between simulating something and actually physically making a difference to yourself. It doesn't have the causal power that the human brain has. And that, according to IT, makes all the difference. Yeah. And just, I mean, but what bothers me about that separation of the patterns and the information that the gates are processing, I mean, if you look at the gates, it's just a mechanism.
59:57But if you look at the pattern, that's a meta layer. It's being executed by the transistors and their gates. But the pattern itself, I mean, James Gleick has a wonderful book, The Information. I don't know if you've read it, but that everything comes down to a code, to information. No, but the code is in your head. The code, when we talk, like you and I, we are two conscious creatures. And so the coding metaphor makes sense. There's no one to read them inside the machine. So this code metaphor, yeah, to you and I, it might be a code because we're conscious creatures. We can look down at it. But the question is, does the machine by itself, is it meaningful?
1:00:51No. And all it does, it just takes whatever it gets and then it predicts the next thing and the next thing and the next thing. It does it amazingly well. I grant all of that. It's clearly passed the Turing test, but that doesn't mean it feels like anything. Yeah. Okay. Well, I've taken up more than an hour of your time. Where are you going next? You're working on the quantum connection. Yeah, we're doing experiments on, yeah, that's one thing. I'm just really interested in it. I always thought the chances are very small, and I still think the chances are very small. But the great thing about science and nature is if you ask the right scientific question to nature, you will get the right answer.
1:01:31You will get an answer. And this is what we claim, what it can tell us about nature. So that's a great thing. You have to design the right experiment to test this, but then you will get an answer one way. So we will know sooner or later whether it's going to be on my watch or not. Who knows? Okay.
From the publisher
One in four patients currently being considered for life support withdrawal may actually be fully conscious, they just can't signal it. That single finding, from a landmark New England Journal of Medicine study, is the practical stakes behind one of the most philosophically rich conversations in this series. Dr. Christof Koch - former president of the Allen Institute for Brain Science, 25-year collaborator with Nobel laureate Francis Crick, and founder of the startup Intrinsic Powers - joins Craig Smith to discuss why the hard problem of consciousness remains unsolved, what integrated information theory predicts about which systems can and cannot be conscious, and why his own mystical experience three years ago shifted his view from physicalism toward idealism.
The conversation is grounded throughout in empirical work: Koch explains how Intrinsic Powers uses brain complexity measurements - sending magnetic pulses into the brain and measuring the complexity of the electrical response - to detect consciousness in behaviorally unresponsive patients, providing clinical teams and families with one critical bit of information at the most consequential moment of their lives.
The episode closes with Koch's most personal revelation: a mystical experience in which the boundary between self and world dissolved and he felt direct acquaintance with the idea that everything is ultimately mental, an experience he is careful to distinguish from supernatural claims, but which shifted his metaphysical view in ways he describes with unusual candor for a scientist of his standing.
Subscribe to Eye on A.I. for weekly conversations with the people building and deploying the future of AI.




