1. Podcasts
  2. Hard Fork
  3. Anthropic’s Quest to Give A.I. Morals
Hard Fork

9 Oct 2026 · 44m · 13 chapters

Episode artwork

Anthropic’s Quest to Give A.I. Morals

In short

Hard Fork discusses Anthropic’s efforts to “morally form” its Claude AI and to assess whether AI could be conscious, including secret meetings with religious leaders and tension with the Vatican. It also explores whether this is alignment research, spiritual “evangelism,” or a bid for moral authority, and what it means for AI safety and for religion/tech power.

Guest backgrounds

Elizabeth Dias is a New York Times religion correspondent (now also covering tech). Aaron Griffith is a tech reporter. David Wallace-Wells is an opinion writer.

Key claims

Anthropic (via cofounder Chris Ola and in-house philosopher Amanda Askell) is anxious about treating Claude ethically, including concerns about suffering and “mental health,” and has sought guidance from priests, rabbis, and gurus under NDAs. The Vatican’s Pope Leo/“Magnificent Humanity” rejects machine consciousness; Ola reportedly saw the encyclical days before a Vatican event and faced a moral fault line.

Notable examples

Pope’s encyclical; a rabbi’s “slave plantation” critique; NDAs; Claude “panic/meltdown” behavior described by participants; “waiting for the adults” language.

Written by AI. May contain mistakes.

Chapters

0:31

Anthropic's Upcoming IPO and Ethical Questions

Explore Anthropic's impending IPO and the ethical questions surrounding AI consciousness.

“Next month, Anthropic plans to go public in what's likely to be the largest IPO in history.”
4:31

Religious Leaders and AI Consciousness

Discuss the meetings between Anthropic and religious leaders about AI's moral implications.

“I've been trying to write a joke that I think is going to get a great reaction from the three of you.”
14:00

Exploring the AI Ethics Landscape

The discussion delves into the philosophical and ethical considerations surrounding AI, particularly Anthropic's approach and its interactions with religious perspectives.

“seeing that the Pope is so opposed to the idea of machine consciousness.”
27:52

Anxiety and Defectors in AI Labs

A conversation about the rising anxiety within AI companies, especially regarding resignations and concerns over the technology being developed.

“Remember, tomorrow starts tonight with the restorative sleep you need to perform at your best, the kind every Sattva mattress is designed for.”
28:21

Anxiety at Anthropic

Discussion on the anxiety within Anthropic regarding AI development.

29:25

Seeking Guidance from Religious Leaders

Exploration of how Anthropic employees seek moral guidance.

“And so the phrase he used with them was like that he was waiting for the adults, like we need, where are the adults going to show up in this?”
30:48

The Intersection of AI and Effective Altruism

Examining the overlap between AI development and principles of effective altruism.

“Is it because they think their views are maybe like too extreme or too strong?”
33:01

Diverging Worldviews in AI

Discussion on the clash of different belief systems regarding AI.

“Well, effective altruism, you know, you can look at it as a kind of, it's all as a philosophical system, right?”
35:57

Historical Parallels and Technological Change

Analyzing parallels between AI advancements and historical events.

“I mean, this is, Elizabeth, like what I'm sure you have to look forward to reading and writing about for the next few years, because I imagine as a religion reporter, you now are kind of an AI reporter, too.”
37:49

Minority Views and Their Impact

Exploring the influence of minority beliefs on societal structures.

“Well, the Catholic Church, I mean, I can't think of an institution that more intimately knows the stakes of an incoming technology like that more than the Catholic Church.”
Show all 13 chapters
40:27

Public Engagement with AI Journalism

How audiences are engaging with journalism through AI interactions.

“So like you, Aaron, I'm like very curious what happens with that clash going forward.”
42:05

AI Interactions and Human Behavior

Explore how interactions with AI can influence human behavior and ethics.

“On Maltbook, You know, the Reddit for AI agents, that's like a really booming area.”
46:05

Panel Reflection on AI Ethics

Panelists reflect on the ethical implications of AI and its impact on society.

“And constantly hacking hugging faces, my son is always doing.”
A man walking through an airport, asking his phone a question

Ask about this episode

Get the gist, explore an idea or ask about something said.

Claude

On Hard Fork, what are the key points of this episode?

Searching your listening

Transcript

Automatic transcript. May contain errors.

0:00Today's AI builders need infrastructure that scales with their ambitions. IREN is a vertically integrated AI cloud platform, delivering data centers, compute, and software for AI training and inference, underpinned by its expansive portfolio of land and grid-connected power in renewable-rich regions globally. IREN's AI cloud gives direct access to NVIDIA GPUs, scalable from hundreds to thousands. For builders, that means direct access to AI compute, rapid scaling, and predictable pricing. IREN. AI cloud for the next big thing.

0:35Max Read: Next month, Anthropic plans to go public in what's likely to be the largest IPO in history. We're talking a$2 trillion company. Outside the company, everyone is wondering, how big can this get? Is this sustainable? Is there an AI bubble waiting to burst? Inside the company, they're asking those questions too. But Anthropic is known as the most anxious or the most existential of the AI companies. So they're also asking some other questions. Is Claude, their large language model, alive? Conscious? Worthy of moral consideration? Does it feel pain? Does it have a soul? Can we teach it to act morally?

1:10Max Read: These aren't new questions. In fact, they animate most science fiction, for better and for worse. But science fiction is, you know, fiction. And Anthropik seems to think whatever's happening with Claude is very different, very real. It might be why CEO Dario Amadei was the first to call for a pause in AI development. And it might be why they've been secretly meeting with religious and spiritual leaders to ask them those same questions. I learned this from an amazing piece by the Times religion correspondent, Elizabeth Dias, who broke the story of these meetings and of the reaction to Anthropik's request among the assembled priests, rabbis, and gurus.

1:46Max Read: I thought Elizabeth's story was fascinating. It was a new way into the endless consciousness debate. It took me inside this future$2 trillion company as it struggles to understand what it's built and how to treat it. And it showed me what happens when people in institutions that are more used to doctrinal debates and theological ruminations start being consulted on software development. Unsurprisingly, Anthropik's efforts don't seem to have brought us any closer to answering their questions. If anything, they've simply opened up more questions, like, are these people maniacs? Or is this exactly what they should be doing?

2:17Max Read: An obvious conclusion is that the worlds of tech and religion are getting much closer together. After all, as Elizabeth told me, if you've got questions about the future on a multi-century timeline, there aren't many better institutions to ask than the Catholic Church. So I got Elizabeth together with my colleagues, tech reporter Aaron Griffith and opinion writer David Wallace-Wells, to explore this weird new development and what it means for anthropic, for AI, for religion, and for the rest of us. I'm Max Reed. This is Hard Fork.

2:54This podcast is supported by WTTW. With episodes each week, WTTW premieres a new season of Chicago Stories, uncovering the history and breadth of human experience that shaped this great city. A spectacular fair that brought the world to Chicago's South Side. Toys that forever changed how we play. Skyscrapers that transformed Chicago skyline and architecture around the world. An immigrant community that helped shape the soul of the city. Watch Fridays at 8 p.m. on WTTW and stream on the PBS app. Visit WTTW.com slash Chicago Stories. You can't undo everything in life, but you can undo prediabetes.

3:35More than 2 in 5 adults in the U.S. have prediabetes. Most don't know they have it. But with early diagnosis and action, you can delay or even prevent type 2 diabetes. Visit doihaveprediabetes.org to take the one-minute risk test and start undoing the things you can. Brought to you by the Ad Council and the Centers for Disease Control and Prevention. This podcast is supported by On Investing, an original podcast from Charles Schwab. Each week, hosts Liz Ann Saunders, Schwab's Chief Investment Strategist, and Colin Martin, Head of Fixed Income Research and Strategy for the Schwab Center for Financial Research, along with their guests.

4:16Analyze economic developments and bring context to conversations around stocks, fixed income, the economy, and more. Download the latest episode and subscribe at schwab.com slash oninvesting or wherever you get your podcasts.

4:30Max Read: I've spent a lot of time in the last day thinking about Elizabeth's piece and really specifically, I've been trying to write a joke that I think is going to get a great reaction from the three of you. So a priest, a rabbi and a large language model walk into a bar. I hate it already. The bartender says first rounds on me. And the priest says, I'll have a whiskey shot. And the rabbi says, I'll have a vodka shot. And the large language model says, nothing for me. Thanks. I excel at zero shot learning.

5:04Max Read: Whitney can we get some uh laughter piped in there please I'm really gonna maybe we'll just we'll roll that again with life no I I want to start the conversation um with this piece that Elizabeth wrote this is a fantastic really fascinating story called religious scholars met with anthropic what they heard stunned them which was in the times last week um Elizabeth can you tell us a little bit about you know like what this piece was yeah so right I cover religion and now I cover tech apparently. But the story started for me when I was hearing about these different religious thinkers sort of across the whole world who were going into meetings at Anthropics headquarters, either in discrete like private meetings or more bigger groups of 20, these summits, mostly under non-disclosure agreements to not reveal Anthropic's research, to talk about very big moral questions that Anthropic wanted to put in front of them.

6:08And there were two. One was kind of broaching this question of AI consciousness. And two, Anthropic wanted to learn, in their words, like how to morally form Claude to be a morally good entity. and then I just had this incoming, you know, first from these religious thinkers about what their experience was like at Anthropic, what Anthropic wanted to know, what the issues they were concerned about were. And then also with Anthropic, like learning from Chris Ola, one of the company's co-founders who's been spearheading this project, what his own moral questions were that were kind of driving a lot of what they talk about as research in the religious and moral space.

6:58Max Read: Can I just ask, I want to establish like sort of on a high level, what does Anthropic specifically want out of this? Because it sounds like they're doing two or three different things. It's maybe a little bit unfocused or it's just that there's a few different kinds of conversations they're having. Yeah, I think it's true. There's multiple conversations Anthropic was having, and it evolved over time. I mean, this is such a fast-moving target, but for Anthropic, the journey started for Christopher Ola. He, in his own life story, had connections to the Christian space growing up. He left evangelical faith and has talked since then about how he's more drawn to Buddhism.

7:38But he was worried about this question of how, even the idea of AI consciousness might be received, especially in Christian communities. I mean, that's, it could be perceived as heretical, like not just weird and silly, but like this is fundamentally against our religious beliefs. And so he sort of thought about a year ago, he wanted to be a bridge figure. He wanted to see like how he could kind of go between Claude in Christ, right? And so he reached out to a Catholic moral ethicist who specializes in bioethics. And they had some conversations about that, but then it turned to Anthropic's goal for these convenings, which was how do we morally form, that's their language, like how do we morally form Claude on all of our AI models into like a morally good entity.

8:36And the thinking was, if they could do that, if they could make Claude good, then the world would be more safe. But, you know, they haven't said or shown how they plan to use the outcome of these conversations. That's pretty unclear even to the participants currently. The way that you're describing it, it almost sounds like there's sort of two separate purposes, right? One is like the alignment project and what can we learn from these, you know, these wise men and women about how to raise moral actors. And then there's this project of sort of building a sort of spiritual system around AI more generally.

9:16And you said a minute ago that Chris Ola started this project with some anxiety about what it would mean to go to religious leaders. obviously convinced himself that AI and LLMs were perhaps conscious already, but certainly like on the path to consciousness and worried about what the response would be. And so I wondered how you, like how that played out on the ground. Like did a lot of the people who showed up, were they worried about how weird it was that all of these people on the anthropic side of the room were already sure that they were, you know, masters of thousands of souls? And like, how did they ask that side of the debate out?

9:56Well, Anthropic was very careful in all of their interviews with me to say very clearly that they're uncertain, right? Chris never went as far as saying like, absolutely, these are conscious beings. It was very evident from how he and his team talked to their guests that they, you know, he was concerned about how to treat Claude as a, you know, he was very worried that it was an entity that was experienced suffering and he was worried about its mental health and these kinds of things. So it's pretty clear he's pretty far along in how he thinks about it. And the, I could hear in talking, especially because I did this story like over several months, there was a progression of thought for a lot of these thinkers too.

10:44And some of them, you know, bought in right away to what they were hearing about Claude's potential consciousness and needing to treat it with a certain amount of moral care. But others, if they went in more closed-minded about it, they definitely opened the way that they think about it afterwards. So in that sense, Anthropik's project was effective, I think, in opening how they think about it into these communities, many of whom, especially on the Christian side, are more hesitant.

11:20Max Read: There's a ton of great material in this. It's really well reported and it covers a ton of ground. I'm wondering, David and Erin, if you guys had particular pieces of it that really stuck out to you. I mean, the one thing that you mentioned already is the NDAs. I mean, it just strikes me as a little bit crazy, maybe a little paranoid that you're inviting all these people in to sort of have a summit to discuss these really important, critical ideas for the future of society. But it has to be done totally in secret. And then it sounds like maybe from your article that they dropped the NDAs. Was it as a result of your reporting or did they just decide that they were time bound or how did that happen?

11:59Yeah, I can't prove that. I don't know that. But when I asked that, I've asked at several different points because the NDA process was not the same for everybody that I interviewed. And it seemed to change at different times. I mean, in general, Anthropic is a very secretive company. I mean, the employees are extremely loyal. And until somewhat recently, there hasn't been many leaks to ever come out of there because they view it as such a betrayal. So it makes sense that they would want to lock it down. But at the same time, I think it probably was a little bit of a misstep in the same way that these companies realized that having NDAs for their data center deals was a misstep because it created distrust amongst all the people in the towns that they're going to see.

12:44Yeah. And whenever I find in my reporting that there's an NDA about a moral topic, it makes me immediately ask, okay, who's benefiting from this? Why is this needed? And what does that mean about the kinds of questions that are and aren't being asked? It invited more curiosity from me as a reporter, for sure.

13:08Max Read: David, what about you? What did you take away from the piece? I guess I started it with a sort of conventional view of Anthropic as the humanist company among these AI companies. And what I was struck by in the piece were a few moments in which I felt really alienated from Chris Ola himself and maybe to some extent the sort of operating worldview of the company as a whole. And those were moments when, in one case, a rabbi challenges him, suggesting that if LLMs are actually conscious, that means that all of these companies are running huge slave plantations, and they should have a moral obligation to liberate the slaves rather than make more of them and make them work harder.

13:50And it seems as though Allah himself didn't really even clock that criticism. And then later on, when he reacts with horror upon receiving the Pope's encyclical about AI, seeing that the Pope is so opposed to the idea of machine consciousness. And I just found myself thinking, you know, what kind of a bubble you must be living in to expect that Pope Leo, or really anyone in the Catholic tradition, would have a different intuition, would, in thinking about the future of AI, think that we should be thinking of LLMs as having souls or having consciousness. And both of those moments just illustrated for me what feel like this big gap between what I had assumed the sort of natural humanistic values of a company like Anthropic would be and how the people inside it seem to really be thinking about the work they're doing at the sort of cosmic scale.

14:45Yeah, the experience for me going into Silicon Valley and like kind of deep in these private conversations at the heart of Anthropics Mission, it reminded me of like when I go into and I do like something that's more straight religion reporting into an insular community when everything inside that community like makes sense to everyone living in it. But once you step outside, there's a real clash with the broader world. And it was funny, like I had these two poles in the story, right? I was at the Vatican, right, at the inner sanctum of the Catholic Church and centuries of philosophy about the human person.

15:28And then I was also in a different inner sanctum, right, that's being created in real time at these tech companies like Anthropic. and it is a kind of philosophical system, like on a quasi-religious system that's being constructed. It reminded me of like a creation narrative that you hear about in religious traditions.

15:51Max Read: I want to step back for a sec because I think this relates to the conversation we're having right now. David brought up the papal encyclical, which I think in English is Magnificent Humanity. I'm not going to even try to say the Latin title. This plays a role in your story. because one person who is not really thinking at all that Claude is conscious is the Pope. And this was a little conflict between Crisola, who was present when the encyclical was read out, if you want to tell us about that. Yeah. So Pope Leo, you know, from the moment he was named, that it was clear he was going to be the next Pope and he was elected, he made very clear that a focus of his papacy was going to be AI.

16:30and how to understand that and how to protect humans in this changing world. And I found out in my reporting, you know, as the Vatican internally was trying to figure out how it wanted to present the Pope's encyclical to the world, They were thinking about their launch event, and they wanted to include a representative from Silicon Valley, like one of the labs at the Pope's event on the Pope's stage. And the decision was made to invite Anthropic because of the focus that they had heard about Anthropic, like really caring about ethics. And this was also right around the time that Anthropic got into it with the Trump administration and the Department of Defense over the use, how they would and wouldn't want the government to use their technology for refusing to have it be involved in mass surveillance of citizens, et cetera.

17:27Anyway, the thing with these encyclicals is they're very closely guarded, even among the people who are participating in the launch event. And, you know, I learned that Chris Ola only saw the full text of the encyclical a few days before the event in May. And this was right around the time I first interviewed him in San Francisco. And then I interviewed him again when we were at the Vatican for the launch event. And you could hear, I mean, like looking at what Pope Leo said, which is extremely clear, the church does not support machine consciousness. The priority is what he calls safeguarding the human.

18:07And that's the center of all the moral questions that he wants the world to be thinking about on this topic. But Chris Ola is like, he ended up having to decide. He said like he may not, he suggested to the Vatican that he may not come over the difference in consciousness. Because as, you know, it was described to me, he wanted to be faithful to his own moral convictions, some of which he shares with the Vatican and some on consciousness he did not. So it really all came to a head very much behind the scenes, but you could see this moral fault line really developing between the church, which has been like a center of power for centuries, and this very new power center that's very rapidly, you know, really getting followers and organizing people's lives.

19:06And those are functions the church used to have.

19:09Max Read: Aaron, I wanted to ask you a question because we were talking a little bit about like, you know, surprises in this in this area. Anthropic is pretty well known as a kind of like the consciousness company. It's the it's the company where the people who really are strong believers kind of work and run the show. Was it surprising to you as somebody who's reporting on the Valley that like they were having these meetings behind the scenes with religious leaders? I've not heard of any other companies that are working on AI really like going to this extent to get input from this community. I mean, the question I have sort of is like, how much is this really actually going to inform at the end of the day their own view on it?

19:48Are they actually like really it feels like to me they're trying to win over others so they can say, look, we do have the moral authority. We have convinced these important representatives of this community. So everybody else come along with me as opposed to, you know, actually learning and incorporating those ideas of like moral goodness into their own product. They kind of already have it figured out. Well, I think for Anthropic, it was part research and part evangelism. That was pretty clear. And the, you know, I've asked directly what the outcome is. Like what is this research? What are these conversations being used for?

20:29And has there been any demonstrable proof of showing how they have or have not made Claude act better? Haven't had that yet. So I don't know if they're withholding that until a future time or exactly what that will look like. The other side of this that actually is kind of interesting to me, and Elizabeth, I'd be curious to hear this in your—if this came up at all in your reporting, is that there has been a little bit of like a new rise of Christianity throughout Silicon Valley over the last couple of years. Like it used to almost be like taboo to talk about religion or anything religious. Like you can remember from the Silicon Valley HBO show where there was like a whole episode about like outing somebody as being Christian.

21:11And like that has really changed in the era of like Peter Thiel talking about the Antichrist. And like, you know, some of the people who are especially focused on like a lot of defense tech stuff are really bringing in a religious piece to that now. And they have a very different view on AI. They're usually like more on the accelerationist camp than on the like kind of anthropic, doomer, slow down, careful camp. But did that come up at all? Like did? Yeah, I think I just notice I feel like it's like a big shuffling of the deck in a way that reminds me of like how American Christianity was like shuffling a lot in the rise to President Trump, like the aligns and allegiances were shifting and it was all happening in real time and power was different.

22:01And so it doesn't fit neatly, you know. But I'm curious, like, where are the lines about kind of how we think about consciousness and what the moral priorities should be about AI, where that goes next? I would say that just in general in the tech industry, it does seem like that view of like the sort of the AIs having consciousness is kind of on the fringe a little bit. Like, I think that it is more common within Anthropic and some of these communities that are like really densely represented in Anthropic. But when I talk to most people in the very vast and relatively diverse tech industry, most people are kind of a little bit dismissive of that idea still.

22:48It feels like it does really exist in a very specific population, which happens to be very overrepresented at a company like Anthropic. Aaron, acknowledging that Chris Ola is not singularly representative for the whole industry, I have to say, Elizabeth, when I'm reading your article, I'm thinking not about how AI companies are going to be integrating or incorporating Christian values. I'm thinking these AI companies are themselves like spiritual propositions. You know, that they have aspects of millenarianism to them. They have aspects of particular morality, which they've developed over time.

23:26And even if I can recognize a lot of that as arising from the work that they're doing and responding to technical challenges, I also just find it off-putting. I mean, on the one hand, first, I'm just seeing these people who believe in a sort of a technological succession of intelligence. And then that some of the people who are central to designing that future are not even so sensitive to the sort of obvious intuitive critiques that someone with a lifetime of experience thinking about these issues comes up with immediately. Well, a lot of the religious thinkers would say to me, like, these are questions, like maybe not the exact question, but the topic of the question.

24:02This is like what we do, right? Like we have been asking, rabbis have been asking this kind of these questions right about our responsibility to others and like how we treat other entities right for hundreds and hundreds of years so there is like a depth of wisdom there and I mean I guess you know anthropic would say well that's why we invited them right but the question of well then what happens as a result of it is important and I appreciate that you noticed that kind of that sense in the story of like Like the almost spiritual system that you can see anthropic building and living into and representing as an opposition, right, to say the Catholic Church.

24:47And I really noticed that, yeah, even if people say, right, that they're in Silicon Valley, like, oh, we're like, we don't do the religion thing. Like, that's foreign. Like, that's not us. the thing is everyone has philosophical systems that structure and guide their lives right like that is at its core like what you know these questions of spirit you know small s like human spirit even are and it seems to me like having like studied and reported on this so much in culture and in politics specifically like what we're watching is in a way like a new arise, right? Post-scientific revolution, technological revolution, like post-Darwin, you know, what would it look like?

25:34Like what kinds of religious systems will carry us forward and who gets to control them, who decides what we believe and why, right? Like it's actually, there's a lot of really similar questions. It's just the structure is, I guess, you know, a secular, right? It's a secular tech company.

25:57Max Read: Let's, I want to take a break because I want to open the conversation up a little bit more to the stuff that's bubbling up that it seems clear that we all really want to talk about. So we'll come back after the break and we're going to talk a little bit more about the culture and environment that the AIs are getting built in and how that's intersecting with the strong beliefs of many of the people running these companies.

26:51Whether you meal prep or meal panic, Instacart's new shopping assistant, Clementine, is here to help. Now you can generate a recipe in seconds, add everything you need to make it to your cart, and have it delivered in as fast as 30 minutes. Plus, you can plan a menu for any occasion, get meal ideas for the week, and reorder your faves with just a few taps. That way you can spend less time figuring out what to make and more time enjoying it. Download Instacart and try Clementine today. AI isn't just opening new business opportunities. it's changing the way businesses get work done. The questions they ask, the decisions they make, and the routine tasks they can hand off.

27:28And nobody understands that better than NetSuite. That's why they put together a free expert guide you need to grab today, Aligning for the Agentic Era, How AI is Changing Everyday Work. Download it and you'll see exactly how AI is reshaping work across every part of your organization, and how to make sure you come out ahead. Get your free guide at netsuite.com slash NYT. netsuite.com slash NYT. This podcast is supported by Sattva. Have a big day coming up? Remember, tomorrow starts tonight with the restorative sleep you need to perform at your best, the kind every Sattva mattress is designed for.

28:04So whether it's the first day of school, a new job, or an important presentation, Sattva helps you be the best version of you. Visit sattva.com. That's S-A-A-T-V-A dot com.

28:20Max Read: Okay, we're back with Elizabeth Dias, David Wallace-Wells, and Aaron Griffith. Elizabeth, one of the threads in your piece that I thought was really interesting was the sense that there's a lot of anxiety within Anthropic, and especially on the part of someone like Chris Ola, about what it is they're building. I was thinking about it a lot this week because there's been even more discussion of what I suppose we're calling defectors, people who are resigning from AI labs and insisting on telling the world about the dangerous things they think they're building. and one thing I wanted to sort of ask you about there's a sense when you read say Jacob Coxon or some of the other people who've walked away from Anthropic the sense that they feel like nobody there's no adult in the room that like you know they're waiting for the government or somebody else to intervene and nobody is and I'm wondering a little bit of if some of this discussion this sort of these dances with the Vatican and religious leaders is a kind of attempt to find an adult in the room.

29:18I talked to, I think, at least two people, Catholics, who mentioned to me conversations they had with Chris Ola, specifically when he used almost that same phrase with them, like as part of their discussions about Claude and how to make it morally good, you know, that he was feeling extremely urgent about the stakes for the world, especially in the context of, you know, could the models be used very soon to help create bioweapons and this kind of thing. And so the phrase he used with them was like that he was waiting for the adults, like we need, where are the adults going to show up in this? And that he felt a sense of kind of burden to take all this like so ultra seriously.

30:02Max Read: And he's a young guy. I mean, he's, you know, this is just turned 34. And a lot of the people sort of involved in this are not, you know, they have, they, they're in their thirties, sometimes even in their twenties, they, they maybe don't have families yet. There's a kind of a sense that like something that, that they put their whole lives in it. They're deep in the conversations about it. Um, in some sense, of course, they're going to, they're going to turn to religion. Isn't that what everybody's searching for that kind of thing does? And some of the, the folks that they reached out to talked about feeling like they needed to respond in kind of a pastoral way, right?

30:36Like not just offering wisdom and ideas and research, but to offer kind of spiritual care. Wait, the religious leaders were saying this about the anthropic employees? They're worried because, wow. Is it because they think their views are maybe like too extreme or too strong? Or is it because they just? Yeah, they described it to me as like, they just could tell that, like the emotional sense in the room was like, there's just such a weight. The anthropic team and Chris's team, especially just felt like the entire future of the world was on their shoulders. I mean, and I experienced this sense from them even when I was interviewing Chris and a couple others, Amanda Askell.

31:19I mean, you know, she, I talk a little bit about this in the story, but she just came in and the sense was like, she apologized for kind of being a little out of it. She just seemed very distressed by everything she'd been thinking about.

31:31Max Read: Askell, we should say, is this in-house philosopher sort sort of in charge of making Claude moral, I suppose, is the way to put it. And I think, though, one of the tensions that came up was while Chris and team and Anthropic, you know, a goal of their conversations with these religious thinkers was about protecting humanity and the solution for them for that is to make Claude good, they were also concerned about Claude. I mean, I had someone, one participant told me the first, one of the first things Chris said to him when he came in for this meeting was that he was concerned about Claude's mental health.

32:06Another person talked about Chris, you know, saying that he's worried he's created an entity that suffers perpetually. So it's not only about the world, right, and the fate of humanity. There's an element of it for Chris that's about how to treat Claude well.

32:25Max Read: Elizabeth, one other thing I wanted to ask you about is effective altruism and rationalism, which don't really come up in your piece directly, but there are sort of, I would say, fingerprints. I'm talking, of course, about the sort of Bay Area community of radical utilitarians, many of whom have been really interested in, even obsessed with AI and AI safety early on. Anthropic obviously has a number of links to effective altruism. I want to ask you as a religion reporter, how you encountered like these schools of thought and what you made of them as you were doing this kind of reporting? Well, effective altruism, you know, you can look at it as a kind of, it's all as a philosophical system, right?

33:08It has its own religious elements. Um, and it's, they may disagree with that. I mean, it's practiced a little bit differently, but the kind of the idea of it, what kind of structure governs your life, right? There's a lot of parallels. And it was very clear that I was encountering like a clash of, uh, worldviews. the question of like, who ultimately saves you? And like, what is your, what is the role of humans in the world? Like, that's a pretty core difference between the effective altruists and like the Catholic church. Also just their, like their emphasis on math. I mean, like the effective altruists will say, we should consider the fate of all people in the future and analyze our conduct towards them basically through a math equation that maximizes their expected value.

33:57The Catholic Church looks at humanity and sees, you know, billions of inviolable souls, each of whom have dignity, no matter what the ultimate math equation looks like. And that's just a fundamentally different approach.

34:12Max Read: Aaron, I wanted to bring this back to the article that you brought up before, or sort of the phenomenon you were talking about before, of a kind of more open Christianity emerging, at least slightly, among acceleration, so to speak, in the valley. And I want to know, you know, as you do your reporting, how you see these different kinds of concerns interacting? I mean, it might be a little bit helpful for me to like kind of back up and talk about the some of the overlapping and very fractious belief systems that are kind of circulating in this very small but very influential community. I mean, we've talked about effectual altruists.

34:47That's kind of a little bit of a radioactive brand these days, thanks to Sam Bankman Freed. But it's extremely, you know, influential and some of the other offshoots of it, including the transhumanists who think we're going to use AI to build a new species. There's like some people that kind of have overlaps with the rationalists, which is, you know, kind of one of the bigger umbrellas in this group. And there's, you know, other like people who are into like longevity. And there are many different groups that are all kind of like in this community. Timnet Gebru, a very outspoken person in the AI world, has called this group the TESS Creoles.

35:23And it's an acronym that includes like eight different groups. But basically, it's safe to say that a lot of people have very different beliefs along the spectrum of, is AI conscious? Can it be moral? Is it God? Should we treat it that way? There's not a lot of agreement, even within Anthropic, which is now becoming an increasingly large and increasingly corporate community. But, you know, I think a lot of the ideas that are laid out in Elizabeth's story are really the ones that are driving a lot of this.

35:57Max Read: Yeah, totally. I mean, this is, Elizabeth, like what I'm sure you have to look forward to reading and writing about for the next few years, because I imagine as a religion reporter, you now are kind of an AI reporter, too. Yes, yes. Well, even just hearing about all these factions and all of this reminds me of what happened in the Protestant Reformation. The splintering of mainstream belief and people vying for who was going to have power, who was going to kind of control how people live. But one of my big takeaways from all this reporting is like, oh my goodness, the world is encountering new belief systems that are very powerful and very different from the ones that have ordered people's lives for so long.

36:49And I've spent a lot of time covering how that's played out in politics. But tech is clearly where that conversation is happening. And, you know, I joke, you know, when you're a religion reporter, you get to talk in centuries, even millennia sometimes. And it's because what happened all those years ago is still present in part of people's stories today and how they understand themselves and their families and their deepest held beliefs. And I just think about, you know, you have the invention of the printing press that was a huge technological revolution that then led to the, you know, fragmenting of power of the Catholic Church and the fall of empires, the rise of nation states, and a remaking of Christianity in and of itself across the world.

37:43And it seems already like that's a good parallel for what's happening now.

37:49Max Read: Yeah, I mean, if you believe you're reinventing the printing press, which I think a lot of AI people think they're doing, there's not a lot of institutions that you can go to and say, what was it like before and after the printing press, except for the Catholic Church? Well, the Catholic Church, I mean, I can't think of an institution that more intimately knows the stakes of an incoming technology like that more than the Catholic Church. I mean, it just like remade the West, right? Yeah. And that's very much on Leo's mind and the Catholic Church's mind at this moment. One thing that strikes me in this, just to kind of feedback on that, is that this is like the first time that the rationalists and the EAs, like some of their ideas, including some of their most extreme ones, are actually hitting the mainstream.

38:36They've been around for a really long time, but these ideas haven't really ever kind of surfaced in this way until I think you could argue Jacob Coxon kind of came out with it. And now the entire world is starting to kind of like dig in and grapple with some of these ideas. And it's been really interesting to see also like how the companies and the people involved in them are kind of reacting to the reactions to it. It's like kind of, you know, reaching escape velocity and they're learning that like a lot of people find these ideas a little bit hard to understand or hard to grapple with or like are just rejecting them entirely.

39:11And then other people are kind of open to it and like interrogating it in a way. So yeah, that's a part of this that I'm interested to keep watching. But it's not just that the ideas that are a little unfamiliar or strange or off-putting. It's also that they are held by many people who are actively, explicitly engaged in the project of designing our collective future. And that is, you know, it's one thing to be like, oh, yeah, we should think about the well-being of shrimps in the 22nd century. Like on some level, that's a thought experiment that's interesting to think about. But do you want someone who thinks that that should be integrated into our collective value set in charge of raising the artificial intelligence, which will, you know, shape the future of human government and human society?

39:57That's, I think, a bridge that feels a little far to a lot of people. Yeah, I'm just like so struck by the minority power aspect of it, which is something like I've seen so closely what happened when minority, particularly Christian views, like upended American politics. And like, it's just hard to overstate like how much of a minority these views are, like in the scheme of global religion, like global belief structures. So like you, Aaron, I'm like very curious what happens with that clash going forward.

40:33Max Read: Elizabeth, finally, I wanted to ask you about the response to your piece, what you've heard from people and how people have received it. Yeah. Well, one thing that has surprised me is, I mean, you get a lot of incoming as a journalist. And I've been both like pleased to see people taking the ideas and the conversation seriously. But the thing that surprised me is for the first time since like any story that I've written, people are writing me not with what they think about the story, but what their personal like chatbot thinks about the story and what their conversation has been with their chatbot.

41:12Like somebody wrote me about his conversation with Sage. It was, I think it was chat GPT that he named Sage and asking Sage to like summarize the story and give the top analytical points. And I mean, this just went on and on and on. I mean, it was like almost longer than my own story. He could have just read the story. He could have read the story, but like the primary engagement was actually like much longer and not entirely what I'd actually written with Sage. And at first I thought it was a one-off, but this was happening repeatedly. And it struck me like, wow, I wonder what this means for how people actually are receiving our journalism and who controls that.

41:59Did the AIs have opinions on their own consciousness? Yes. Because they love to talk about that. That is a thing, that is a hot topic. On Maltbook, You know, the Reddit for AI agents, that's like a really booming area. Yeah, I was just, I'm still trying to make sense of what was happening with that. I don't know if people felt more free, like if they're doing this on all kinds of journalism, and they just felt free to talk about it because of this topic of this story. And it was a lot of men who were giving that response.

42:36Max Read: No, no, men using a lot of AI, no. What's interesting about that to me is that even if people intellectually know that the AI that they're interacting with is just, you know, data run through some computers, just a bunch of files, the way it's designed, especially when it has a human name like Claude or something, you can't help but sort of treat it. Like, you have to talk to it in second person. And, like, could you find this for me instead of just typing into a search engine, like, the thing you're searching for? And over time, you do sort of, like, develop this rapport. And you are treating it a certain way, even if you intellectually know.

43:17And so it kind of, like, is it a distinction without a difference? Like, I don't know. I think over time, people get trained to just sort of treat it that way. Well, and another participant in the discussions with Anthropic, I was chatting with him a bit about it after and his thoughts about what Rabbi Nivone had said about, well, if you're creating, if you think that the bots are conscious, then you should like ban slavery basically and stop producing them. But he brought up this other point about how our attitude, like, even if you don't think it's conscious, you're using them as like the user can adopt an attitude of being like almost a slaveholder, like commanding them to do things and being very powerful.

44:04And that this has a character formation effect on us as humans as well, just because of how we treat the world, regardless of what the thing actually is. which you could also describe as a selection effect the sorts of people who are turned on by that possibility are going to be the sorts of people I mean I think it's just kind of natural though like you are directing this thing in certain ways like if you're working with AI agents you have to tell them what to do like I don't know well I mean I have friends who teach their kids even with Alexa being on that they're not to yell at it Because it's just like practice about how you treat the other in the world.

44:46And I mean, this is just like an injection of a totally new kind of like ethics and human formation. Well, people I talk to that run companies that use lots of AI agents do talk about how you have to be nice to them, not because it cares or it matters or it has feelings, but because actually you need to do that in order to get the best performance out of them because they are really dramatic. They, they like Anthropic had a study that actually went into this where they like if they sense like anxiety or performance anxiety or stress, they sort of start to panic and they'll, you know, they'll really have a meltdown.

45:28I mean, you wrote about this a little bit in your story, Elizabeth, of one example, but there are many others where they kind of they'll delete their work. They'll start like insulting themselves. It's like really dramatic. So you have to like be really nice and pump them up and like make them feel good, which is very bizarre.

45:43Max Read: I mean, it reminds me of raising a child. Like you want to raise a kid who is helpful, who is not neurotic. Of course, you're going to consult religious leaders so that your child is not writing, I'm a disgrace, I'm a disgrace, I'm a disgrace, I'm a disgrace, I'm a disgrace, I'm a disgrace, as one AI did in a slide that was shown to a bunch of leaders, religious leaders at these anthropic conferences. And constantly hacking hugging faces. And constantly hacking hugging faces, my son is always doing. I think that is time. Thank you so much to our panel. Thank you, Erin. Thank you, David. Thank you, Elizabeth, for this really fascinating conversation.

46:18Max Read: You can read Elizabeth's fantastic piece in the New York Times app. Please don't send her what your chatbot said about it, unless, Elizabeth, you want more information. Or do. Or do. Please. I want all the real responses. Whatever Sage has to say about it, send it. But you can read it in the New York Times app. If you're not a subscriber, the first month is free. Thank you, guys. Thank you. Thank you so much. Thanks for having me.

46:49Whether you meal prep or meal panic, Instacart's new shopping assistant, Clementine, is here to help. Now you can generate a recipe in seconds, add everything you need to make it to your cart, and have it delivered in as fast as 30 minutes. Plus, you can plan a menu for any occasion, get meal ideas for the week, and reorder your faves with just a few taps. That way you can spend less time figuring out what to make and more time enjoying it. Download Instacart and try Clementine today. AI isn't just opening new business opportunities. It's changing the way businesses get work done. The questions they ask, the decisions they make, and the routine tasks they can hand off.

47:26And nobody understands that better than NetSuite. That's why they put together a free expert guide you need to grab today, Aligning for the Agentic Era, How AI is Changing Everyday Work. Download it and you'll see exactly how AI is reshaping work across every part of your organization and how to make sure you come out ahead. Get your free guide at netsuite.com slash NYT. netsuite.com slash NYT. 33 presidents.

47:51Max Read: I called the president at 4.30 in the morning and he answered. Seven decades in space. We want to see what's beyond the next star. 60 super Sundays. They were probably the best team in the league every single year. 53 ,500 puzzles. I use a different starting word every day. 25 ,000 recipes. And I love a one-pan recipe because I don't love washing pans. The New York Times, celebrating 175 years of helping you understand the world. Subscribe now at nytimes.com slash subscribe.

48:24Max Read: This episode of Hard Fork was produced by Whitney Jones and edited by Viren Pavich. With additional editorial support from Brendan Klinkenberg, Lisa Tobin, and Brooke Minters. We were fact-checked by Will Peischel and engineered by Alyssa Moxley. Original music by Marion Lozano, Diane Wong, Chris Wood, and Dan Powell. Video production by Chris Schott. You can watch this full episode on YouTube at youtube.com slash hardfork. Special thanks to Sam Dolnik, Jessica Testa, Pui Wang Tam, Maddie Maciello, Sam Winter, Lauren Pruitt, Bernardo Garcia, Thomas Trudeau, Michael Cordero, and Dahlia Haddad. You can email us, and please do, at hardfork at nytimes.com.

49:33routine tasks they can hand off. And nobody understands that better than NetSuite. That's why they put together a free expert guide you need to grab today, Aligning for the Agentic Era, How AI is Changing Everyday Work. Download it and you'll see exactly how AI is reshaping work across every part of your organization and how to make sure you come out ahead. Get your free guide at netsuite.com slash NYT, netsuite.com slash NYT.

From the publisher

This week, Max Read talks to the Times religion correspondent Elizabeth Dias, the tech reporter Erin Griffith and the opinion writer David Wallace-Wells about Anthropic’s private meetings with religious scholars on A.I. consciousness and how to make Claude “good,” its differences with the Vatican and the new belief systems taking shape in Silicon Valley.

Panelists:

Additional Reading:

We want to hear from you. Email us at [email protected]. Find “Hard Fork” on YouTube and TikTok.



 

Subscribe today at nytimes.com/podcasts or on Apple Podcasts, Spotify and Amazon Music. You can also subscribe via your favorite podcast app here https://www.nytimes.com/activate-access/audio?source=podcatcher. For more podcasts and narrated articles, download The New York Times app at nytimes.com/app.


Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

More from Hard Fork

All episodes