Aza Raskin on interspecies communication, empathy, and AI’s next frontier

0:00Hi, so the conversation you're about to hear is a conversation Arian had on stage at the Master of the scale summit with Aza Raskin, who is the CEO and co-founder of the Earth Species Project. If the Earth Species Project was successful, we might have this intro in, you know, beluga whale or dolphin or something else. But we'll show you part of the reason why this conversation was so magical and why we want to share it with you. Reid and I have known Aza for a long time, and I think you can hear it in the podcast episode that we are just so delighted to hear everything from crows to beluga whales, to elephants, to dolphins.

0:33So I'm excited for everyone to listen. So here is our episode with Aza Raskin. Welcome. It's awesome to be doing this at the Master's Scale Summit of having our possible podcast. And I can't think of literally a better guest and subject than Aza and the Earth Species Project. We won't need an AI to understand this conversation. Tell us about the Earth Species Project. What is it? The Earth Species Project, we are sort of the frontier of interspecies understanding. The question is, can we use frontier AI to understand the other languages and cultures of Earth? And what most people don't know, for instance, is that whales and dolphins, they have cultures, they have languages, they have distinct dialects, they've been passing down their culture for 34 million years.

1:27So as we can tell, so that's 85 times longer than the human species has existed. And in the last 20 years, science has progressed a lot into understanding these incredible other beings that they have cultures is now like fully documented. But almost no progress has been made. In fact, no progress has been made on, say, the communication of orcas. And just one, I think, really interesting side tidbit is orcas have fashion fads. I don't know if you know this. A couple, I think it was in the 90s, first documented that an orca killed a salmon and started wearing it as a hat. Other orcas started following suit.

2:04And then for like a season or two, there was a whole salmon thing that was going on. I feel like salmon's in this season. Yeah, exactly. And like next month, it's going to be aqua. Get ready. And we will have salmon hats on March. Reach underneath your chairs. Yeah. So that's what we're up about. And it's sort of like there are two portions of this project. There's the science portion. And this is like build the tools. Right now, there's a scientific revolution obviously happening in every human domain. But that hasn't been brought to the non-human domain yet. And so there's a power of scientific revolution.

2:37And that's what we're building these large scale foundation models, nature and things like that to do that. But then the even bigger goal is sort of create a Copernican revolution, which is to say that, that when we learn the language or the culture of another human group, it takes that group from being something that's out there, and it brings them into your heart a little bit, and it changes how you act. And I think the same thing for animals. As we learn that animals actually have rich language and deep culture, it takes them from nature out there, and it pulls them into our heart, and it changes who we are.

3:15So when I hear a dog bark, I hear a dog bark, And when I hear, you know, you go to the zoo, you hear a lion roar, but you guys are decoding animal communication. Can you just give us some examples of that animal communication and what you are seeing with these animals? Yeah. All right. So let's play a guessing game. Does anyone know which animal makes these sounds?

3:42Not bat. It is a kind of whale. Not an orca. Good guess, though. Beluga. Yes. Nice work. So these are a couple beluga communicating while hunting. And what I love about this is that most people, like, we sort of know humpback whale song, but this sounds to me like an alien modem. And in fact, all that digital high-pitched noise, that wasn't digital stuff. That was them communicating. And so it seems like they may actually communicate in modem-like packets. They include their name. Have you done a baud rate? That's a great question. I'm sure you've played a lot with dial-up. Oh yeah, of course.

4:32Back in bulletin board days. We left our walkers outside. I feel like if I ever have to do an untalent show, it's the ability to do like which is how I'm going to communicate with AI, really. Exactly. Or how it might communicate with you. That's right. But what's interesting about this, right? So here's an interesting puzzle. Orcas can communicate up to 150 kilohertz. Okay, we can hear up to 20 kilohertz, but in water, high frequencies don't go very far. So why are they communicating at such high pitch? And the answer is we don't know yet. But the theory is that because they are often communicating in close call, like intimate calls, and they're moving around each other, they're often touching each other.

5:23This is a thing you and I were talking about backstage, but we're doing work with University of Lyon on these incredible crows. And they have their own unique culture where they do collective child rearing. So they sort of like form a little commune or kibbutz or something. Yes, it's not a murder of crows. It's a commune of crows. That's going to go over great these days. They have their own dialect. They'll take outside adults in, teach them their new dialect language, and their crows will start participating in the communal child-rearing thing. And so we work with the university. They have little backpacks on the crows.

6:02And that means we get to record what they're saying all the time. And one of the things that we have been finding is around 70 % of the calls that they make are actually quiet, intimate calls. Calls they make to each other. And when we brought these to the scientists and biologists that we're working with, they were like, we haven't seen these calls before. it appears that something like, and again, this is all preliminary, so, you know, science, but 70 % of the calls that crows make, science hasn't really touched or been aware of. And so we've been trying to understand the language of another species by only listening to its shouts.

6:45That'd be like trying to understand humans by only listening to Twitter. Uh-oh. You're only listening to Jim Cramer being really loud. Right. And the same thing, like the same tools that we're now building for crows, to your point about scale, these methods can scale. Most people would say like, well, you're starting with just a couple species, right? And like, actually, no, the way AI works is learning one about one species teaches you about all species. If I learn in human language, I teach an AI German and French and Japanese, it actually can learn very quickly Esperanto and Aramaic because each language has a kind of pattern that matches.

7:21And the same thing is true of the animal kingdom. And so we're building these tools that work across the entire tree of life. And we're heading into these, what we think are going to be sort of alpha fold moments. We're going to be able to show that many species have names or many species have compositional language or many species have like abstract thinking going from abstract to general, abstract to specific. And that's sort of like where we are. Yeah. And one of the things that I learned from early days when when you kicked off the Earth Species Project, and it's like, oh, a year in, is you had discovered these trainers who had trained these two dolphins to do an original aerobatic trick.

8:03Yes. So describe this a little bit, because by the way, this begins to give you a lens of that there are definite communication and thought that we very much undercount as human beings. because we are not yet in dialogue with them. And part of what you were just saying is, if we can get in dialogue, there is all kinds of other things that come. So talk a little bit about the dolphins. Yeah. So this was a 1994 University of Hawaii study. And in this study, they were teaching dolphins gestures. And the first gesture they taught the dolphin was, do something you've never done before, which is to say, innovate.

8:46I think it's a gesture Reid is trying to do in here. It was Jeff's yoga pose.

8:56And interestingly enough, the dolphins can understand the concept of innovate, of do something new. And already that requires an immense amount of cognitive capacity because that requires remembering everything you've done before, understanding the concept of negation, not one of those things, and then invent whole cloth some new behavior, some new trick. That's already cool. But then the researchers had this brilliant idea, which is we'll teach them a second gesture, which is do something together. And then they would say to the dolphins, do something you've never done before together, innovate together.

9:29And the dolphins would go down, exchange sonic information, come up and do the same thing they had never done before at the same time. I mean, I couldn't even do that with a human. I went underwater and was like, you and me, it would be a disaster. So... We should try this. Yeah, this is actually going to be like the ice-breaking game for the Master of the Scale next year. Yes, exactly. So I think it's so interesting that you can, again, these species are so different. You're learning from crows, which are tiny, to dolphins that are in the water, to I feel like we've all seen that beautiful, heartbreaking meme of the elephant who every year returns to the spot that their mother died.

10:11And that teaches us that there's so much more going on than we think. So when it comes to elephants, what have you learned about both communication, but then also social group dynamics within the elephant, within the crew? Yeah. So I don't know how many people know this, but elephants, they can communicate infrasonically. So sub our ability to hear, they will shake the ground and actually transmit sound through the ground and get picked up by other elephants through their feet. So there's a lot going on with elephants. One of our partners, Joyce Poole, who runs the Elephant Listening Project, pointed out that when elephants communicate, they communicate on top of each other.

10:57They overlap. So, you know, with humans, like, we do turn-taking. I speak, you speak, I speak. Well, except if you're a New Yorker, I guess. I did not bribe him. Constantly in New York, San Francisco battle. Yes, sir. But elephants do the opposite. It seems like roughly 90 % of the time when one communicates, the other starts to communicate. And so Joyce has this hypothesis, which is that maybe there's a kind of communal grammar that is in order to say a sentence actually requires all of us. And we don't know if this is true yet, but I love it as a thought experiment. Because if it is true, that means there is a kind of harmonization happening, not in music but in meaning and that's a way that the more of them that speak maybe the greater coherence they have and that's a lesson humanity needs to learn well actually speaking of kind of humanity lessons one of the things when we opened yesterday with feifei she was like okay there's there's more to the world than language and language models and so spatial intelligence But here's another thing of what do you think we might imagine about how we're learning about language and human language by also exploring the languages of all these other species?

12:20I've never asked you this question before, but I know you're philosophical. So what are some glimmers of possibility there? Well, I think this one with elephants is one, is that maybe you don't need to do sequential turn-taking to come up with meaning. maybe there's a way it's a little bit like music right when human beings play music there's a emergence that happens something and a way of creating meaning that is more communal um i think i think that is one um i think the real answer is we just don't know this podcast is supported by google hey everyone david here one of the product leads for google gemini if you dream it and describe it, VO3 and Gemini can help you bring it to life as a video, now with incredible sound effects, background noise, and even dialogue.

13:11Try it with a Google AI Pro plan or get the highest access with the Ultra plan. Sign up at Gemini.Google to get started and show us what you create. Often people ask us, like, what is the first thing you want to say to an animal? And like, actually, that's already the wrong way to think about it, right? We're very careful. We don't say break the interspecies communication barrier. We say break the interspecies understanding barrier because I think it's when we listen that we change. It's not when we speak. And so that's the real goal. And just to give you a couple examples, these are dolphins looking in mirrors.

13:48Do people know about the mirror test? Mirror test. How do you tell whether something is self-aware, like a being. Well, one way of doing it is you take an animal, you paint a dot on them in a place that they can't see, you show them a mirror, and if they start trying to get the dot off, well, that means they've done something very important. They've associated that thing in that mirror, that image, that is me. And a number of different animals pass. Elephants, for instance, do, but researchers thought for the longest time they didn't, and that's because they were using small mirrors. It's like so human.

14:27And so these are, you can see what happens when dolphins look at themselves in a mirror and they have what is maybe the most universal mammalian experience, which you look in a mirror and you check out your abs. And so the realization here is like, what might animals communicate about? Well, they're clearly having the experience of self-awareness. So that's one of the most profound things. And actually dolphins have names they call each other nearby. Even in the third person, elephants have names. That was discovered by Joyce for one of her partners in the last two years. Belugas do. They also include clan identity.

15:02So like identity is just... Parents actually spend the first couple of weeks of the chick's life leaned over, whispering a unique name into each of their chick's ears, which they will then use again for the rest of their life. Like what's more core to identity than a name? So they may be, if they're communicating, they may be communicating out one of the most profound things that we have. And just to give one other example, these are lemurs taking hits off of centipedes. So they bite down on centipedes, they enter these trance-like states, they get very cuddly. This is perhaps where Burning Man originally came from.

15:39And it turns out a lot of animals do this. Dolphins will intentionally inflate puffer fish and pass them around in a circle to get high off of their venom, which is the original puff puff pass.

16:01Recently it's discovered that chimps, so chimps will communicate by banging on tree trunks and strangler fig trees, and they'll use this to communicate for kilometers. And actually, human beings have drum languages. Speaking of, like, what might we learn, they have drum languages where they can communicate over many kilometers just by drumming and say something very specific. But it recently discovered that, the name of the research just escapes me, but that chimpanzees will go inside of hollowed out baobab trees, like the males will, and they'll start drumming. And this was confusing. Like, why are they doing that?

16:38Well, it's confusing because, well, they go in and they, it seems that they're doing some kind of like trance ritual. They're like, they're hooting, they're panting. We obviously don't know really what's going on, but it's this very fascinating behavior. Yeah. So what, one of the things actually also that I remember from an early one, and I think I'll get this right, we also had an ability to have a kind of almost like the mathematical proof that we were having a conversation with corvids. Say a little bit about what that discovery was. I know we didn't know what was being said, but that there was a conversation happening.

17:16Yeah. So this was not with corvids. This is with another songbird called the zebra finch. Got it. And we're just at the place now where we can start investigating conversation, where we can model how a bird responds to another bird, replace the bird with an AI and start to see how do those conversations shift and you know the the interesting thing and this is sort of like the plot twist of the whole project is that we are able to communicate fluently have a fluent conversation before we're able to understand what we're saying yes um it's sort of like the ability there's a certain amount of human beings that also yes it's true I don't know if you feel this way but sometimes I feel like human beings I'm like I think you're sort of like an LLM with your temperature turned up too high.

18:02Yes, exactly. It's like, well, the temperature switch doesn't work. Yeah, yeah. But the thing that we're really discovering, this goes back to the crows and also the belugas, right, is like 70 % of crow communication, just science has never heard. Beluga communication is sort of the same thing. That is, when we're working with some of the best researchers, like Dr. Valera Vergara, who did the work to discover that belugas seem to have names, she has tags on whales or whale-ables if you will that's good I've totally never used that one before but she can't use a lot of her data because there are multiple whales that are overlapping at the same time and she can't figure out who's saying what and so she has to throw away 97 % of her data and this is where your ears should really perk up because this is the most vocal underwater species with what appears to be the largest vocabulary, and we're only able to look at 3 % of the data as science.

19:02Like the ocean is 5 % explored. Luca is 3 % explored. That's why we think animal language processing is the next frontier. And we view this moment philosophically sort of like the invention of the Hubble telescope, where, you know, in 1995, astronomers pointed the Hubble telescope at an empty patch in sky. And it was a big scientific gamble. And of course, what they discovered was not nothing. What they discovered was the most number of galaxies that we had ever seen in one spot before. And I think this is the general principle. When we have a scientific revolution, we get a new tool that can see at greater depths and greater perceptive abilities than ever before.

19:38Science then points it at a space we thought was empty, and what we discover is not nothing. What we discover is everything. So I can imagine two criticisms coming sort of from opposite ends of the spectrum. And one could be, like, why are you messing with animals? Why are you trying to understand them? or are you communicating? Maybe you're introducing some negative thing by sort of being there. And on the other end, I can imagine someone saying sort of like, so what? Like, why? Like, okay, who cares? We know about animal communication. Like, we have so many problems. Like, why are we even worried about that?

20:08So what do you do when people say those two things? How do you respond? Before Aza responds, I think my response to the first one is woof. Yes. Yes, exactly. Come back to this a little bit. So like encryption, and we'll tell you what it is later. If I'm not going to go a little provocative for just one second. The way we treat animals is the way AI will treat us.

20:33So we need to increase our sphere of care as fast as we possibly can. And I do think there are these moments in history where we get a shift in perspective. And that changes more than just policy. it changes deeply our identity as a species, right? So Jane Goodall was like a hero, I think, of mine. I know you spent time with her. Yeah, we had her on Possible. Awesome. And she just passed away, right? And she was able to show that chimpanzees use tools. And that really changed who we thought we were as a species. We were always man, humans, the tool makers. And now we're really, like, what really feels like uniquely identifies us, It's where we're humans, the language users, like we're, we're building our digital gods in our, in our image coming out of language.

21:26And when in the history we've like really encountered and like taken a species from out there and into our hearts, I think of it as when songs of the humpback whale came out and this is Roger and Katie Payne. It's this album where we got to hear as a Western society for the first time, the culture of another species. And it goes on Voyager One on the golden record. It gets played in front of the UN General Assembly, becomes a multi-platinum album, I think, like three times platinum. Became the anchor for Star Trek One. Exactly. Go back in time, save the whales. Yes. So it changes culture. And it's the reason why we have minke whales and humpbacks today.

22:08We go to the moon, get those incredible images, Earthrise, Blue Marble. and that doses all of humanity with the overview effect. And we get the EPA, modern environmental movement, NOAA. That was in the Nixon era. So there are these moments where a shift in perspective changes us. And I think that's what we're really after. And I just want to get back to the, are we messing with animals? We have to be really careful. We have to think about the responsibility of what making new technology does. So, you know, whenever we invent a new technology, we invent a new class of responsibility or uncover it, right?

22:45We didn't need the right to be forgotten until the internet could remember us forever. We didn't have privacy written into U.S. law, didn't exist until... That need wasn't there until Kodak started to produce the mass-produced camera. And then Brandeis, one of our most brilliant legal minds, sort of created this idea of, like, the right to privacy. So same thing for communicating with animals. To give one example is Katie Payne, one of the people that discovered actually that elephants communicated masonically, did songs on the humpback whale. At some point, she played back the call of a matriarch for an elephant tribe that had already passed away.

23:26And all of the elephants came running over to find her. And they spent the next couple of days in distress. because they're like, where is she? Where is she? Humpback whales, for whatever reason, the Australian humpback whales are the K-pop singers. Are they demon hunters as well? I see a franchise for them, yeah, a new whale business model. And their song will go viral. And sometimes if it's a particularly good song, much of the world population will start singing within a couple generations. And if we're not careful and we just take a synthetic whale and put it in the ocean and have it sing, we might create viral memes, whale QAnon.

24:09We don't want to be like the Sora 2 of the underwater world. And so there is real responsibility that comes with the new power. And that's why we really focus less on communication and much more on understanding. Amazing. Well, we got to two of the 30 questions that we had. Right. But as you can all see, what A's in Earth Species Project doing is magical. Thank you. Thank you.

24:39Also, a round of applause. It's just a deep thank you to you, Reed, because Reed, we've known each other since I was at Mozilla. You were the first person I came to talk to about Earth Species. Most people at that point, this was before Transformers anything else, would have just sort of been like, that's nice, pat me on the head. and Reid has supported from the very beginning. It's the reason why we're able to do what we do. So I just want to say thank you. Thank you for giving him a round of applause.

25:07Big thanks to Dan Nealon, Eve Trell, Brian Pugh, Aaron Bostinelli, Jeff Berman, and the frickin' awesome teams at Wait What and Earth Species Project. This podcast is supported by Google. Hi, folks. Paige Bailey here from the Google DeepMind DevRel team. For our developers out there, we know there's a constant trade-off between model intelligence, speed, and cost. Gemini 2.5 Flash aims right at that challenge. It's got the speed you expect from Flash, but with upgraded reasoning power. And crucially, we've added controls, like setting thinking budgets, so you can decide how much reasoning to apply, optimizing for latency and costs.

25:43So try out Gemini 2.5 Flash at aistudio.google.com and let us know what you built.