Digital Dolittles: Talking to the animals?

19 Sep 2025 · 50 min · 27 chapters

Ask about this episode

Ask anything about it. ChatGPT or Claude reads this page and answers with the times it was said.

Connect VO and ask about every podcast you hear, including the moments you saved. Add to ChatGPT · Add to Claude

In short

The episode “Digital Doolittles: Talking to the animals?” explores how new bioacoustics tools and AI are expanding what humans can hear and interpret in animal communication, while questioning hype about “talking” to animals. It follows Maria Margaronis from bat echolocation in London (using a phone ultrasonic detector) to elephant infrasound at London Zoo and in Central African rainforests (Elephant Listening Project), then into the deep ocean for whale communication and AI translation efforts (CETI/“Project SETI”).

Key claims

bats’ calls can be species-identified via AI spectrograms; elephants use very low-frequency rumbles that travel far and can be monitored to census forest elephants and detect poaching gunshots; blue whale song pitch appears to be decreasing over time; sperm whale “coders” vary by social group and may reflect learned “dialects” (culture debate); dolphin signature whistles function like learned individual “names.” Notable examples include Bracken Cave’s 20 million bats, elephant protest calls (“damn it, I want to nurse”), and WhaleSafe’s sonar/ship-strike mitigation.

Guests

Professor Kate Jones (UCL bat bioacoustics), Keeper Jamie (London Zoo Whipsnade elephants), Katie Payne (elephant infrasound; Elephant Listening Project origin), Bobby Esterbrook (Cornell/ELP), Alistair Pickering (AI specialist), Dr Anna Shirovich (marine bioacoustics), Dr Luke Rendell (St Andrews; sperm whale coders/culture skepticism), David Gruber (CETI founder), Shane Gero (sperm whale recordings), Professor Vincent Yannick (dolphin communication; Collodoolittle Challenge), Ben Williams and Tim Lamont (coral reef sound/AI restoration).

Written by AI. May contain mistakes. Listen to the episode to check what was said.

Chapters

Tap a time to open that second in VO

The Mission of Digital Dolittles

0:32 to 1:05

Exploration of efforts to understand and communicate with whales.

The Mission of Digital Dolittles

1:38 to 2:16

Exploration of efforts to understand and communicate with whales.

“Technological progress has opened our ears in new ways to the voices of other animals.”

History of Animal Voice Recording

2:18 to 2:56

Overview of the history of recording animal sounds and its evolution.

“A century ago, Hugh Lofting wrote a book about Dr.”

Exploring Bioacoustics with Bats

2:56 to 4:00

Engaging with bats and understanding bioacoustics in nature.

“It's dusk on a summer evening and we're stepping out into London's largest wilderness, Hampstead Heath.”

Understanding Bat Communication

4:00 to 6:06

Insights into how bats communicate and use sound for echolocation.

“And because there's a little bit of moonlight now, it's almost easier to see their reflection in the bat itself.”

The Social Behavior of Bats

6:06 to 9:00

Discussion on social calls and the behavior of bats in their colonies.

“I don't know whether you heard that, but it was like a tick, tick, and then a...”

Discovering Elephant Communication

9:00 to 10:00

Exploration of how elephants communicate using infrasound.

“If you imagine translating Chinese to English, you've got a really good set of data to try and understand that and track one word from another but we don't have that for bats.”

Research on Elephants' Infrasound

10:00 to 14:00

Insights from research on elephant communication and social behavior.

“And I think the thing that really gets me is your reaction.”

Understanding Elephants' Communication

14:00 to 14:50

Learn how elephants use infrasound to communicate over long distances.

“And there were all kinds of mysteries about elephants.”

Researching Elephants in Africa

14:50 to 16:05

Discover the Elephant Listening Project and its role in protecting elephants.

“Their work has led to the elephant Ethogram, an online database of field recordings where you can look up every roar and stamp and ear flap and the behaviors that go with them.”
Show all 27 chapters

Advancements in Acoustic Monitoring

16:05 to 17:55

Explore the use of passive acoustic recording for studying elephants.

“Really one of the best ways to understand where they are and when they're there is through using the passive acoustic recording devices.”

AI and Elephant Behavior Analysis

17:55 to 21:09

Learn how AI is used to analyze elephant sounds and behaviors.

“I have to say I do have a real soft spot for elephants, but I also think it's the complex social behaviours they display, empathy, grief, things like that.”

Challenges Facing Elephants Today

21:09 to 23:09

Understand the threats to elephants from habitat loss and human conflict.

“So these units would have to be solar powered.”

Katie Payne and Bioacoustics

23:09 to 23:58

Discover Katie Payne's contributions to the field of bioacoustics and conservation.

“And suddenly you may discover that the entire herd is holding perfectly still, listening.”

Katie Payne and Bioacoustics

24:52 to 25:19

Discover Katie Payne's contributions to the field of bioacoustics and conservation.

“planning, thematic investing, retirement planning.”

Katie Payne and Bioacoustics

25:23 to 25:53

Discover Katie Payne's contributions to the field of bioacoustics and conservation.

“Fed up with losing out to hidden fees when you send money abroad with your everyday bank?”

Exploring Oceanic Bioacoustics

25:53 to 28:00

Dive into the world of marine bioacoustics and animal communication.

“You're listening to the documentary from the BBC World Service.”

The Soundscape of the Deep Ocean

28:00 to 30:26

Explore how marine animals rely on sound for communication and the advancements in bioacoustics.

“Unless you're in those surface waters, vision is just not going to help you.”

Human Impact on Ocean Sounds

30:26 to 33:17

Learn about how human activities affect marine life through sound pollution.

“We are now a palpable presence in that deep, dark blue.”

Decoding Sperm Whale Communication

33:17 to 36:12

Discover the complexities of sperm whale sounds and their social structures.

“Here he is explaining in a 2018 BBC programme.”

The Journey of CETI: Translating Whale Language

36:12 to 38:03

Understand how AI and bioacoustics are being used to translate sperm whale sounds.

“What do humans have to gain from a conversation with a sperm whale?”

The Broader Implications of Whale Communication

38:03 to 41:57

Discuss the philosophical implications of understanding whale communication and its parallels to human language.

“That journey began in 2018 when David's curiosity about the undersea world swam head-on into AI.”

The Connection Between Humans and Whales

42:05 to 43:38

Explore the deep psychological connection humans feel towards whales and the implications of this relationship.

“Well, whales are already charismatic animals, right?”

Cognition and Communication in Dolphins

43:38 to 46:39

Delve into the cognitive abilities and communication methods of dolphins, particularly their signature whistles.

“privileging new algorithms over genuine insight into living things.”

The Philosophical Nature of Animal Communication

46:39 to 49:04

Discuss the complexities of understanding animal minds and the limitations of human interpretation of their communication.

“So do we think that dolphins can do that?”

Rebuilding Coral Reefs Through Sound

49:04 to 51:04

Learn how bioacoustics is being used to attract marine life back to degraded coral reefs.

“Over a third of all marine life is actually living on coral reefs.”

The Dream of Interspecies Communication

51:04 to 52:18

Reflect on the advancements in bioacoustics and AI in bridging communication gaps between species.

“He says you can move faster and hear more that way as you swim through an underwater garden coming back to vibrant life.”
Hear the part that matters, and keep it.Open this episode in VO. Double tap your headphones to save a moment as you listen.
Get VO free

Transcript

Automatic transcript. May contain errors.

0:00This BBC podcast is supported by ads outside the UK. Decisions made in Washington can affect your portfolio every day. But what policy changes should investors be watching? Washington Wise is an original podcast from Charles Schwab that unpacks the stories making news in Washington right now and how they may affect your finances and portfolio. Listen at schwab.com slash Washington Wise. That's schwab.com slash Washington Wise.

1:01and serious money. Stop paying for missing pieces. Go to odoo.com. That's O-D-O-O dot com to learn more. Welcome to the documentary from the BBC World Service with me, Maria Margaronis. Now we have the ability to listen to everything in the ocean. What's going on in that animal's head? Is there a kind of kindred spirit out there that can maybe understand what I understand? The mission is quite simple. The mission is to listen to and to translate the voices of sperm whales. This is Digital Doolittles talking to the animals. I'm not necessarily putting them into human language so that we can understand them.

1:41Technological progress has opened our ears in new ways to the voices of other animals. So we can understand their world deeper. and some people believe that the growing power of AI could help us to communicate with them directly but there are doubters if you read what's going on in the press everything right now is being filtered through this lens of whales are going to have language and we're going to use chat GPT to talk to them but we're just not I'm sorry I mean you can come back to me in 10 years when they've done it and say haha look at you you fool and I'll take that risk because I actually don't think it's a very good one.

2:18A century ago, Hugh Lofting wrote a book about Dr. Doolittle, a vet who could speak animal languages. I loved it as a kid, and I started this project half seduced by the fantasy that this old fable might come true with new technology. Our fascination with recording animal voices began back in 1889, when Ludwig Koch captured birdsong on crude rack cylinders.

2:45Now we can pick up sounds we didn't even know were there. My first guide to the sonic universe beyond our human hearing was Professor Kate Jones from University College London, our very own Batwoman. It's dusk on a summer evening and we're stepping out into London's largest wilderness, Hampstead Heath. It feels like the human world is just ebbing away, It seemed to disappear.

3:10It's just that. Oh! Was that a pipistrelle? Yes. It's quite big. I know, well, they're quite close to you. Yes, they are. Pipistrels, noctules and daubentons, bats everywhere. We're by a darkening pond, my phone transformed by Kate's matchbook-sized bat detector into a sound portal to another world. This is a device which turns the microphone of your phone into an ultrasonic microphone. So ultrasonic just means higher than we can hear, basically, so above 20 kilohertz. So this microphone can go from zero to 120 kilohertz. Most bats are echolocating around 60, although some can go as low as 9 kilohertz and some as high as 212 kilohertz, which is crazy.

4:00Look at that. They kind of vanish when they bank. And because there's a little bit of moonlight now, it's almost easier to see their reflection in the bat itself. Kate, what is bioacoustics? Bioacoustics is biological sound, sounds which nature makes. Sounds which you can listen to and interpret. So you can have whole soundscapes of biological sound. Ultrasound detectors have existed at least since the 1940s, when Harvard zoology students Donald Griffin and Bob Galambos detected and named bat echolocation. The noises which you will hear when I increase the gain are bat supersonic cries, converted by this device into audible sound.

4:54They used a clumsy device involving vacuum tubes, a telephone, a parabolic horn, and some cardboard. A crystal microphone receives the supersonics and a tuning control. Kate's little gizmo is much more convenient and the sound is more lifelike, but it's still processed. We can't actually hear what the bats are hearing. We are usually held in our human bubble, the bubble of what our own senses can perceive. But new technology like this expands that for us. It changes how you think about nature and about perception because I know that there's so much more to it than just us looking at this lovely scene with the lake and the trees and the twilight and the birds.

5:42It's full of sound and it's full of species which are adapted to interpret those sounds and also hunt with sound. You know, there's a huge arms race going on all the time above our heads. Some moths have adapted anti-bat cloaking devices on their scales, on their wings.

6:07I don't know whether you heard that, but it was like a tick, tick, and then a... What was that? I just heard a... The bat is trying to figure out where the insect is.

6:24their calls get closer and closer together and then they end with this kind of terminal buzz where they catch the insect so it's kind of a tick-tock tick-tock

6:38so they kind of see with sound we don't know what it's like to be in the mind of a bat but But I guess we use a shorthand of see. They can see perfectly well, but they also have this other sense which turns their world into this three-, four-, five-dimensional thing. There it is. Oh, yeah. Not sure. We can never know what it's like to be a bat, and that's important to remember as we think about communicating with other species. Bats use sound to echolocate, to understand their surroundings and to catch their prey, do they also use it to communicate with each other? Absolutely. So they use sound like any mammal would use sound to tell each other they're upset or they're frightened or a mating call.

7:27And there are some AI projects which have tried to turn those types of calls into making sense for us. We hardly know anything about social calls of bats. There's one amazing study which always blows my mind, which is about the Bracken Cave in Texas, which has got about 20 million bats. 20 million bats. It's like a spiral of smoke when they leave their roost for the evening.

8:12the mums go off and leave the babies in this big eternity roost and so the babies all huddle together because they don't have any fur when they're born so they all come into a big group so it's a kind of a crash but nobody could work out how the bats found the baby in this writhing pink mass we thought for ages they were just suckling anyone that came but actually we found that through smell and the particular isolation call that the baby bat makes, the mum can find it. And they make mating calls? They sound very mysterious and lyrical. They sing to each other, basically, with these beautiful songs.

8:53What do we know about that communicative language? I think it's a whole new world, really. It's quite mysterious and unknown because we don't have a huge lexicon. If you imagine translating Chinese to English, you've got a really good set of data to try and understand that and track one word from another but we don't have that for bats. The track I've been going on is interpreting the echolocation calls to species so that is slightly tricky. You need a really good library of calls in order to make sure that you can tell the difference between one species and another and you train the machine the AI to tell the difference.

9:36It's like training Siri to recognise your own voice. So we train these algorithms to recognise bat species. Kate's detector doesn't just make bat calls audible. It also puts a spectrogram, a visual image of each one on my phone screen, and tells me what kind of bat I'm hearing. That's done by an AI algorithm. Oh, there's one. Oh my God. It was just here. Is this always magical for you? Yeah, always. And I think the thing that really gets me is your reaction. You've realised something that you'd never knew and now you'll not forget.

10:21It's crazy now, look.

10:26From winged mammals to earthbound pachyderms, from ultrasound to infrasound, not in the African savannah or jungle, but off Junction 9 on the UK's M1 motorway.

10:44That is one big gate. Yeah. Oh, hello, ladies. We're at London Zoo's Whipsnade Campus with Keeper Jamie, who looks after a small herd of Asian elephants. Giant, fleshy noisemakers who squeak and parp and roar with every part of their grey anatomy. And they have a unique vibrating space behind their foreheads, the top of their muscular trunks. Have you felt the elephant rumble? Yes, absolutely. All I'll say is that they make a variety of sounds, the loudest of which is a large roar, most of which can be heard across the zoo, probably down in Dunstable when they're really, really going. Which one's this going?

11:22This is Kayleigh. And Paya's following her. Paya, age three, is the size of my old Fiat Cinquecento and about as loud. And this is Geeta. Correct. And then Luca will just follow behind. So grandma goes first. Elephants are matriarchal. The females stick together and share childcare. Young rambunctious males are sent away to forage on their own when they reach adolescence. What happens in the family when an elephant is born? It was actually really interesting. Kayleigh, who's grandma to the little one, She took a massive role. We call her our matriarch in captivity. That's kind of subjective, but she was the most experienced elephant.

11:58She actually kept the whole herd back behind her until Paya actually got to her feet, which was after about four minutes. Once she was on her feet, there was some form of communication. Mum stepped forward and bonded with the calf. And then after quite a few minutes then, another signal was given and the rest of the herd then followed.

12:16Some form of communication, says Jamie. Forty years ago, biologist Katie Payne, the grandmother of elephant bioacoustics, visited another zoo in Portland, Oregon. Here she is in a BBC program from 2013. I saw all kinds of wonderful social behavior and gradually realized that I was also feeling something rather strange, a throbbing in the air. I related it to years earlier when I used to sing in a choir next to a pipe organ. and when the lowest notes were going, I could feel them better than hear them. So I thought maybe the elephants are making sounds that are just too low for my limited human ears to hear.

13:01So if you want to get closer, that's absolutely fine. All I just say, if the elephants do come over, just take a step back. Here comes Paya again. I borrowed some equipment from friends at Cornell University. I spent a month with two colleagues recording continuously, and it turned out we had discovered a whole other range of animal communication infrasound. I'm standing right behind Gita the elephant's rear end, which is considerable and round, and I can see the double dome of her head ahead and she's reaching up with this unbelievably prehensile and sinuous trunk reaching into a hay net hanging down from a tree and very, very dexterously pulling out little bundles of hay.

13:52And then, courtesy of Kayleigh, the elephant matriarch, it happened. Listen.

14:03elephants can sense it with their ears and through their toes we edged closer to feel it in our bones

14:16it was exciting especially to biologists because infrasound or very low frequency sound travels much farther than do the higher frequency sounds that we're used to listening to. And there were all kinds of mysteries about elephants. Elephants who would coordinate their behavior over long distances. Males that were able to find females even though they were miles away. Katie took her insights and equipment to Kenya to study the social context of those long distance rumbles in the elephants of the savannah with two more remarkable women, Cynthia Moss and Joyce Poole. Their work has led to the elephant Ethogram, an online database of field recordings where you can look up every roar and stamp and ear flap and the behaviors that go with them.

15:03But Katie went deeper into the second largest rainforest on earth in the Central African Republic to learn about the smaller more elusive elephants who live there. Working with Andrea Tocalo who'd camped there alone for 20 years, Katie founded the Elephant Listening Project to document the elephant's social life and help protect them from poachers. We set up on an observation tower video cameras and we surrounded the clearing with listening devices. That clearing was Dzanga Bai, an expanse of muddy ground with pools and rivulets the size of a football field made by the elephants themselves. It is loud.

15:41It's a very lively place. There's a lot of insects and amphibians and a lot of bird signals. The storms that go through there are intense. Bobby Esterbrook is one of the next generation of scientists at the Elephant Listening Project, still based at Cornell University, and now focused mainly on conservation. African forest elephants are very, very difficult to see in the densely vegetated rainforests that they inhabit. Really one of the best ways to understand where they are and when they're there is through using the passive acoustic recording devices. We can set them up at multiple locations and they can continuously record for several months at a time.

16:24Modern passive acoustic monitors are much smaller and more durable than the ones Katie started out with, but the task is basically the same, using the sounds recorded where the elephants are visible to understand what they're doing when they're hidden in the trees. You can distinguish large elephants from small elephants. For instance, the protest call that a young calf will make, going, which means, damn it, I want to nurse. African forest elephants are critically endangered. The latest estimate is that there are about 100 ,000 of them. But even with sound monitoring, we don't really know their true number.

17:00Before sound was used to census elephants, what was used was counting piles of dung on trails. that scouts would walk. And of course, that means that you're just sampling a tiny, tiny bit of the forest. But these sounds are filling one or two square kilometers. Elephants produce pretty low-frequency vocalizations. Now, thunder certainly is very low frequency, so it can, and we've seen this, it can mask the sound of an elephant vocalization in our recordings, where we wouldn't hear the elephant. A lot of our work entails looking at spectrograms and we can look for these very unique signatures and that allows us to identify elephant vocalizations among a lot of other sounds.

17:50Remember the spectrograms on the bat detector? Same thing. It's a way of turning sound into visual images which are easier for computers to analyze. I mean, I try to be species agnostic. I moonlight with gibbons. I also really like tree bioacoustics. I have to say I do have a real soft spot for elephants, but I also think it's the complex social behaviours they display, empathy, grief, things like that. Those things, it's hard not to be moved by them. That's Alistair Pickering, AI specialist, who's using the project's vast database of recordings, all carefully labelled with the elephant's age, sex, behaviour and emotional state, to train an AI algorithm that will compare the sounds recorded in the forest with the ones from the clearing.

18:37We pair these spectrograms with labels. We go through the audio and say, in this portion of the image, there is a male elephant in distress. And the AI then learns to associate patterns in those images with those particular labels. Then the sounds recorded by those passive acoustic monitoring devices deep in the forest can be used to learn about the invisible elephants themselves. The current workhorse in bioacoustics is the convolutional neural network. What is a convolutional neural network? If you've ever had to fill out those little capture tests on websites... Yes, how many bicycles. Yes, how many buses or fire hydrants.

19:15That was originally used to train a convolutional neural network to be able to identify buses or fire hydrants, even when there are overlapping items or objects or blurred images. And that's what makes it a deep learning model rather than a machine learning model. There's also something called the cocktail party problem, how to pick out specific sounds from the general hubbub. If you imagine, you know, if you've set up one of these acoustic recording devices, it's recording everything. The toucans in the background, it's recording the raindrops. The actual network that you use is completely unaware as to which of these things is pertinent.

19:55So it may be that the same toucan is vocalising every time the elephants do. And so quite reasonably, the classifier learns that, you know, the toucan sound is associated with the elephant sound. So you have to try and help the network get to the right result.

20:18Forest elephants are still being hunted for their sought-after pink ivory. The Listening Project is hoping to stop poachers in real time. We're also capturing gunshots within a certain range of the recording device, which then allows us to understand where the poachers are. Currently, our devices will record in the field for about four months at a time, but then we have to wait for them to be processed and analyzed. If we use AI models deployed on the edge, the classifier is deployed within the recording unit. We can process the audio in real time. A signal would be sent to somebody who's monitoring for that activity, and they could be alerted to exactly where that gunshot was detected to investigate.

21:04Now, the challenge is there is that there's very dense vegetation. The canopy cover's pretty thick. So these units would have to be solar powered. Also, satellite transmission from near the forest floor is really challenging, but the technology is changing so rapidly that we might be able to overcome that challenge in the not-too-distant future. But the greatest challenge to the elephants is always us. As elephants are losing more and more habitat, they're entering villages and towns. They're crop rating in people's gardens. Even one elephant can devastate an entire season's worth of income by destroying a crop in one night.

21:42It's a huge problem for farmers. People are more scared of elephants than they want them gone in some places. Alistair's working on that too. A well-trained AI model can process these data in minutes and as I'm showing in some of my research can increasingly extract richer information such as emotional state. So you mean you can tell by the sound of an elephant's voice if it's feeling good or not? Right, exactly. It could, and it doesn't do this yet, but it could identify vocal patterns that signal stress or high emotional arousal, which we might anticipate as being precursors to an invasion of elephants.

22:26But sitting in an office staring at spectrograms on a screen can alienate you from the very world you're trying to understand. You also have to do plain old-fashioned listening. I might see an elephant rumble, but if I listen back to that sound, I can hear that it's drinking water. I can hear it exhale and blow bubbles. and I can hear it stepping on a branch and cracking that with a primate in the background rustling up some leaves and then a bird takes off and you can hear the wings flapping and it's just, the context is, just there's nothing like it. You may be surrounded by elephants. They may be elephants in all directions doing different things, not looking at each other.

23:09And suddenly you may discover that the entire herd is holding perfectly still, listening. They spread their ears, they raise them, they tighten them, and then they hold still, even the babies. And then sometimes this will persist for as much as a whole minute, which is a long time, before they gradually start to move again. I suppose if there's one thing I could wish for in human behavior, it's that we would become as good listeners as elephants are.

23:58Katie Payne began her work in bioacoustics with her then-husband, Roger. He made the legendary album Songs of the Humpback Whale, which helped to kickstart an environmental movement. Stay with us as we too dive into the ocean depths and the thorny questions of animal consciousness and language.

Read the full transcript

24:36of application. That means quicker results, saving you both time and money. Our knowledgeable team is ready to help bring your dreams to life one gallon at a time. Stop by your local Menards today.

24:51Self-directed investing, trading, full-service wealth management, automated investing, financial planning, thematic investing, retirement planning. Phew. And to think, that's just a small taste of what Schwab offers. Because Schwab knows that when it comes to your finances, choice matters. No matter your goals, investing style, life stage or experience, Schwab has everything you need, all in one place, so you can invest your way. Visit schwab.com to learn more. Support comes from WISE, the smart way to manage the currencies you need around the globe. Fed up with losing out to hidden fees when you send money abroad with your everyday bank?

25:32Choose the smart way. Wise. You can count on the exchange rate you'd usually find on Google. No unwelcome surprises. Plus, ditch that where's my money feeling. Most transfers arrive in under 20 seconds. Join millions saving billions on hidden fees. Be smart. Get wise. Download the Wise app today. T's and C's apply.

25:57You're listening to the documentary from the BBC World Service. I'm Maria Margaronis. We've been on the wing with bats and in the African rainforest with elephants. Now we're diving deep into the ocean where the biggest creatures on the planet are to be found and possibly the biggest breakthroughs in understanding animal communication. Bet you didn't know they're using AI to talk to whales. We're not yet at the point where we can parlay with pachyarderms or discuss Eastern art and dramas with intellectual llamas. There's still so much we don't understand here on Earth. And that's what's inspired me to create this challenge.

26:362025 was the inaugural year of the$100 ,000 Collar Doolittle Prize, given for establishing two-way communication with another species. There's big money and hope and hype buzzing around the idea of decoding animal communication through AI. But is that actually possible? And how did we get here? The idea that other animals have consciousness, let alone language, was controversial well into the 20th century. But in 1970, bioacoustics, public empathy and conservation came together with the unlikeliest of hit records, Songs of the Humpback Whales.

27:19Those otherworldly sounds were collected by biologist Roger Payne and his then wife Katie, the same Katie who went on to study elephants. Though some scientists balked at the term songs, the whales' expressive voices startled and moved their listeners and helped to launch the Save the Whales movement. Even now, that recording is heading out beyond our galaxy on the Voyager space probe to tell the universe about life on Earth. Now, powerful hydrophones and digital recorders are opening our ears to more noises from the deep sea and aiding conservation in practical ways in a realm where sound reigns supreme.

27:56There are vast parts of the ocean that are completely dark. Unless you're in those surface waters, vision is just not going to help you. Any kind of animal that lives in the deep is going to be relying on sound. Dr. Anna Shirovich, a marine bioacoustician at the Norwegian University of Science and Technology. Now we have the ability to listen to everything in the ocean. When I told my sister I was going to study fish sounds, she looked at me like I was crazy. It's like, fish make sounds? Yeah, that's the cool thing about fish. You can actually hear just about all the fish sounds. Some of them do it when they gather for spawning, where they'll all come together and basically sing.

28:39Anna's working life's been transformed by advances in bioacoustics. These days, she says, she doesn't get out of bed for less than a terabyte of data collected by her deep-sea recording devices. Practically, we are throwing tens, maybe hundreds of thousands of euros over the side of the ship. And you leave it on the ocean floor for a year. And then the next big question is, did it record? When you see that there is data there, and then sometimes maybe you'll see even calls from whales or fish or whatever, that's a good day. She's still surprised by some of the bloops and croaks and squeaks she pulls up from the seabed.

29:17After all, we've only explored about 5 % of the ocean. The thing that gets me really excited is when I'm going through recordings and I hear and find things that we have not heard before. There's so much that we don't know. One of my interests and passions is trying to get long-term records so that we can see how are things changing over time. We have been able to document some really strange things that we don't fully understand, and I'm hoping that we will. The pitch of the song of blue whales has been gradually decreasing over time. So they're basically calling deeper and deeper and deeper.

29:54The explanation that I'm thinking about currently came from talking to people, studying music. They told me that what humans do when you're singing in a choir is that you tend to get flat. And I think that this is what's happening to the whales. they're all super highly tuned. One population of blue whales is going to be singing at the exact same pitch. So they're listening to each other and somehow able to match each other. And I think it's through that process that they are maybe inadvertently just lowering their pitch over time. I don't really have proof for this yet.

30:30We are now a palpable presence in that deep, dark blue. These songs are from a submarine's propeller.

30:41Intrusive human sounds now vibrate through the oceans too, disturbing and disorienting marine life. Shipping is constant lower intensity but continuous noise. Like, you know, living next to a highway maybe. We're constantly exposed to these lower levels. But then there's other types of sounds in the ocean, like pile driving or seismic surveys that produce what are called impulsive sounds, which are really high intensity but much shorter duration, comparable to if you're walking down the street and there's a jackhammer, right? Animals have different responses. The best, most notorious examples are of whales that have ended up stranded as a result of exposure to naval sonar that some species of whales are very sensitive to.

31:28Anna is now collaborating with WhaleSafe, which successfully reduces ship strikes on large whales off the California coast through a combination of bioacoustics, observation and data analysis.

31:43The voices of sea animals have always resonated through the paddles of indigenous hunters, the hulls of wooden ships and the taut ropes of harpoons sunk into stricken whales. Some sailors thought that they heard mermaids singing. But the big breakthroughs in underwater acoustics came with the Cold War, when a multi-billion dollar undersea arms race seeded the ocean floor with listening devices.

32:10The oceans cover seven-tenths of the world's surface and in places reach a depth of six miles. A huge world of water, over and through which moves every kind of creature and thing. Some of the things are the Navy's own, and some belong to foreign powers. There's been a long and ongoing interaction between military and naval research and our research field. Dr Luke Rendell of the University of St Andrews has been listening to whales for decades. A massive part of all underwater warfare is trying to figure out where your adversary is. Check your ability to recognise underwater sound. Write down the sound or sounds that you hear.

32:53Be as specific as possible. The first time a fin whale was recorded by the US Navy, I am told, they freaked out. You know, it was so regular that they were utterly convinced it was some kind of machine. And they had these amazing flights of paranoia about what kind of thing the Russians could have built that would make this noise on the seabed. And were we about to lose the Cold War and that kind of thing? And then scientists listened to it and said, actually, that's a fin whale. It's not the Russians. My first job after my undergraduate was actually a research assistant to produce a database of cetacean vocalizations specifically to train submarine sonar operators so that they would be able to say, pretty sure that's a blue whale I'm not going to need to torpedo that Luke went on to do a PhD on sperm whale communication Sperm whales don't sing like humpbacks they click in sequences biologists call coders.

33:53Here he is explaining in a 2018 BBC programme. In the Mediterranean, sperm whales make coders that sound like this.

34:08In the Caribbean, they make coders that sound like this.

34:16And just those differences in the patterning of the clicks actually signal which group the whales belong to.

34:32I actually think if there's a meaning to the sperm whale, it means home. It means this is where I belong. I am with the group into which I was born and I am safe here. Luke understood that sperm whales learn their coders from the group they're born into, which changed the way he thought about their social life. I quickly realised that different social groups of sperm whales had different vocal dialects. And of course, that's very hard to explain by anything other than they learn the dialects of their groups that they grow up in. And so once I had sort of documented that system, the question of, well, why is it there, leads you directly to the idea of cultural transmission and learning of dialects as you develop, as you grow up in a particular sperm whale social unit.

35:16When Luke and his PhD supervisor Hal Whitehead published their paper claiming that sperm whales have culture back in 2001, they were dismissed as radical outliers, both by some biologists and by anthropologists who argued that the word culture can only apply to humans.

35:38As evolutionary biologists, we consider culture to be behaviour or information that is learned socially from others and becomes typical of a particular group or a community over time. You know, we think that there's stuff going on in cetaceans, in whales and dolphins that also fits into this debate and should be considered. Because it was crossing a line, the notion that a non-human or an animal could have something that deserved the same name was at that time controversial. I think that's changed in the last 20 years. It certainly has. What do humans have to gain from a conversation with a sperm whale?

36:17In cutting-edge AI, they're decoding the complex language of sperm whale. Sounds like sci-fi, right? At 230 decibels, they're the loudest animal, and some researchers have even said their most potent clicks could vibrate a person to death. The hope is that one day, for the first time, we'll be able to have full conversations. And with AI, we're just getting started on unlocking the mysteries of non-human languages. It has the capacity to bring us closer to the natural world. It's like a whole new frontier. It is a whole new frontier. The mission is quite simple, to listen to and to translate the voices of sperm whales so we can understand their world deeper.

36:55That's David Gruber, founder and director of CETI, the Cetacean Translation Initiative, a non-profit scientific and conservation project. If we could just spend the time and energy just appreciating a sperm whale, an animal that was vilified that now we're seeing has much more complicated of a system than we ever imagined and kind of just bringing everyone on this journey. David's an evolutionary biologist. His research has run the gamut from bacteria to corals to jellyfish to sharks to sperm whales. You could say he swims in the same waters as Roger Payne, whom he counts as one of his mentors.

37:33In one sense, we've already been talking to the whales with our sounds of our boats. we've been making a lot of noise and I don't feel that we have anything particular of you know wisdom that we need to tell the whales so that's why it's mostly about listening to them we're not trying to have the whales speak English we're not having them try to play a keyboard or you know have some kind of human interface like this is about translating their voices and as anonymous as we can be. That journey began in 2018 when David's curiosity about the undersea world swam head-on into AI. I was listening in my office to sperm whale sounds and across the hall was Shafi Goldwasser, cryptographer from MIT.

38:21But she came in and she got really interested in these sounds, you know, because there were clicks. She was leading a machine learning working group and many of the folks were involved in Google Translate at the time. She was talking about these new techniques of translation and especially some of these techniques that are at the forefront now of like ChatGP3, looking for patterns in multi-dimensional space and trying to predict the next word. We did a study. Can we predict the next click? They could. So we knew that the tools that had just opened up could be interesting in studying sperm whale vocalizations.

38:59The data for SETI's algorithms come from biologist Shane Gero, who's been studying and recording sperm whale families in the deep clear waters of Dominica in the Caribbean for more than 20 years. Here he is explaining how machine learning is changing our understanding of sperm whale clicks at the not-for-profit Bioneers Conference in 2024. What the machines have done quite rapidly is open up multiple new dimensions within an individual call, within a click for sperm whales, where there is the potential for variation. So what we used to say was a 1 plus 1 plus 3, there's now four different types of 1 plus 1 plus 3, and they seem to be used in different contexts.

39:41It's not going to be Google Translate next week, and there's all sorts of reasons for that. But what it will do is give the whales a bit more credit in terms of literally defining the complexity of the information that they're sharing with each other, simply because we weren't paying attention. So, as with elephants, as with bats, the capacity to collect and analyze more data is deepening our sense of whales' communication and social lives. But SETI is going further and deeper. There's just so many questions that we're interested in learning. There's so many new technologies that we're beginning to use.

40:16We're beginning to use a glider system that can follow from a distance, a mother and calf, because the linguists are very interested in looking at language acquisition. And baby whales go through a sense of babbling before they click into their natal coda dialect. Bioacoustics and AI offer a deeper understanding of life than we've had before. And I think we're in for a really exciting time, learning more and more elements of their communication system. And we like to think that we're like baby whales at this point. We're now just picking up our first words. Hmm. First words is obviously a metaphor.

40:53But Project SETI often uses terms from human language like alphabet and vowels, as if they literally apply to whales, which gets the media very excited. So next time you think of the ocean, remember, it's not just water. It's a world of conversation waiting for us to tune in. SETI's multidisciplinary team includes roboticists, cryptographers, underwater acousticians, and many varieties of machine learning engineers. The ultimate goal is to build a universal translator that can crack any communication system. David is definitely aiming for the stars. There will need to be new tools and new ways of looking at this, and they could also be applied across species, and they could also be applied if we were to meet life in another galaxy.

41:39So So it's kind of nice in a way because even this thinking process of journey is something that goes way beyond whales and even possibly beyond our galaxy.

41:56It's a thrilling, tantalizing idea. But Luke Rendell, who made the once controversial argument that sperm whales have culture, remains skeptical about the claim that their communication is comparable to human language. Why does it attract people? Well, whales are already charismatic animals, right? I understand that myself. I've spent a lot of time with them in the field and I would not be doing the job I do if I didn't think they were incredible creatures and I wanted to know more about them. So I totally get that. There's a weird mystery of them being so related to us as mammals that you can see when you look in their eyes.

42:30And then we've always been quite lonely as a species. So we have this language and we think we're great, but we'd really like someone else to talk to for some reason and that's a deep question about human psychology that I describe as a kind of cosmic loneliness, right? Not only do we look out to the stars, we're enchanted by the idea that maybe there's some really clever stuff going on and we just haven't figured out how to access it. And the reason SETI exists is actually that notion is particularly catnip to people who've made money out of technology and would really love for that technology to do something good in the world.

43:07And I just think that notion is irresistible. In a way, the old relationship between bioacoustics and the military has morphed into a symbiosis with Silicon Valley. AI developers like Google DeepMind and Microsoft are putting serious money into biological projects, hoping to reap the benefits in ever more powerful AI. The potential upsides for research and conservation are enormous, But there is a risk that the AI tail might start to wag the biological dog, privileging new algorithms over genuine insight into living things. One of the things that really lit the fire for me when it came to arguing for use of the word culture was the evidence.

43:48We had a lot of evidence gathered together over the years that all pointed in the same direction. We have virtually zero of that kind of evidence for the notion that sperm whales have a complex language. A lot of claims are being made on a very flimsy, evidentiary basis. What do you mean by communication? If you think communication is just an exchange of information or signals, then I think we've long ago established that. The AI industry is built on language models, but we don't have to look at other species' communication through that possibly anthropocentric lens. Luke has his own theory about the function of sperm whale coders, which brings us back to the songs of the sea.

44:26I actually think that there may be deep commonalities between the synchronous performance of coders with members of your social group and similar phenomena in human societies, whether it's song, dance, clapping, everything from Morris dancing to whatever you want to call it, and just clapping rhythms and drumming together. And when we do that with a group of people, we generally feel a bit more connected to them afterwards. Maybe music is a better metaphor than language. I'm really interested in animal minds, not just in cognition, not just in communication. I'm interested in the experience they have.

45:03What is it like to be that entity? Of course, if we follow these philosophers, we'll never be able to really understand that. But we can try. And so that's kind of what motivates me here. Professor Vincent Yannick, also at St. Andrews, is part of the team that won this year's inaugural Collodoolittle Challenge to Prove Interspecies Communication with a study of bottlenose dolphins. One of the reasons why people focus on dolphins is because there is this idea that dolphins are these special creatures in the sea that have skills that other animals don't have. That combination of cognitive skills and the ability to learn sounds from others.

45:35They basically rival the great apes in their cognitive skills. Bottle-noves dolphins have preferred other individuals that they spend time with. And that's similar to our social structure. And quite a complex social structure because you've got to remember everyone and you've got to remember your history with them and what your relationship is with them. Dolphin's complex social lives suggest the need for complex communication. When I started out studying Boronov's dolphin communication, the so-called signature whistle has already been discovered and described. That's where each individual develops its own specific sound that it then uses throughout its life to broadcast its identity to others.

46:15It's often been compared to a name because it's learned and it's different between all animals. And that can be used by the owner of that signal, but it's also used by others to address the individual. These name-like calls pose a philosophical question about what's going on in dolphins' minds. Can they connect the whistle with the dolphin belongs to? You're sort of asking, can I imagine my friend? Can I think about my friend? Even perhaps when they're not there. Even if there's no input, exactly. So do we think that dolphins can do that? They do have that independent representation, yes. So dolphins connect the thought of a friend or family member with a learned sound that has a shared meaning.

46:56That's one of the prerequisites for language. But even if we can keep decoding dolphin communication, Vincent doesn't think we'll necessarily be able to talk to them or any other species. If you talk about talking to animals, then I always kind of got to ask you back is what you want to ask them. Do you want to ask them what's their favorite color? and you will see that you very quickly come to this question of their mind and how do they represent their environment. What a layperson perhaps thinks is that I just have to learn dolphin in the same way as I have to learn French. Animals will not have anything that's like that because they don't have our sensory makeup, they don't have our biology and so therefore whatever communication they have, it is different.

47:37We have no ultrasonic ears, no fins, no blowhole. We don't know what it feels like to live in water. Remember Kate Jones' bat detective? That opened up a world to which I'm usually oblivious, sharing the air with me. But I'll never know what it's like to be a bat. I think there's no doubt that there is interspecies communication. Of course, everyone's communicating with their pet. Hey, you puss, I love you. The real question is, like, how complex can that get? You need two minds that can actually relate to each other. You know, we can't see ultraviolet, for example. Other animals can. So to them, two things that look identical to us, to them have different colors.

48:17Our cognition isn't something that is detached from our bodies and is just kind of floating there and we're with these kind of genius minds. It's very closely linked to the makeup of our bodies and our sensory system.

48:34Once, the philosopher Ludwig Wittgenstein wrote, If a lion could speak, we could not understand him. Our minds are fleshly things, embodied, shaped by our senses and our biological needs, which are different from other species. AI has no body at all, and while some say that frees it from our animal limitations, I wonder if it can truly translate what living, breathing creatures are communicating. What it is doing is transforming bioacoustic research and conservation for elephants, bats, whales, and some of the smallest living things in the sea. Over a third of all marine life is actually living on coral reefs.

49:14They're very threatened. We've lost over 50 % of the world's reefs in the last 70 years, and of course, the outlook going forward is even worse. So urgent action is needed to try and turn that around. Ben Williams is finishing a PhD using bioacoustics and AI to understand coral reef habitats. We know that reef organisms are attracted to the reef by the sound. So in the first few days of life, they drift out into the open ocean, they develop here, and then a couple of weeks later, they return to the reef. And the first cue that they use to return to the reef is that they actually listen out for it.

49:49And when we say they hear, would it be more accurate to say they feel the sound? They're certainly sensing these vibrations in the water that tell them if this is a reef that sounds worth visiting or if one over here is not a good direction to go. A few of them make it through and settle onto that reef and begin growing. Ben's colleague Tim Lamont has shown that sound can help to attract fish and coral polyps back to dying reefs in Indonesia. Tim had recordings from the Great Barrier Reef prior to all these degradation events that took hold and then also had recordings post the degradation. And these are quite different sound signatures.

50:27And what he did was around many areas surrounding this island, he brought together bits of coral rubble and rock and built a small mound a few dozen centimetres high and wide. And on all of these, he put an underwater speaker. So these are actually the ones that are used by synchronised swimmers in swimming pools. And then these were blasting out the sound of healthy reefs, degraded reefs. And then there was a set just playing silence. They were controls in the experiment. And what the team found was that on those where the sound of healthy reefs was being played, They got double the amount of fish return and a 50 % increase in the diversity of fish that were coming here.

51:03The reef sound mattered in where these fish were choosing to settle down. Ben freedives without oxygen tanks. He says you can move faster and hear more that way as you swim through an underwater garden coming back to vibrant life. Swimming over this rubble, all these dead pieces of coral lying everywhere that form this mat like a moonscape, pretty devoid of life and then as you get closer you hear this sound so this crackle in the distance you start to see all these jagged shapes of a different coral sticking out from the ocean floor and then you see the coral and you see what's come back and the beauty and the color of it begins to hit you and then you see small fish darting in and out of these of course you get close some of them swim away some of them come to see what you're doing there seeing that come from nothing.

51:52It almost brings tears to your eyes.

52:11I began this project dreaming that we might one day be able to talk to other species, like Dr Doolittle. But even if we humans are the only language animal, that doesn't mean we're alone. The revolutions in bioacoustics and AI are bringing us closer to other animals. They might even help to knock us off our anthropocentric perch and repair some of the damage we've done to the rest of the living world. You've been listening to the documentary from the BBC World Service. I'm Maria Margaronis, the producer was Mark Berman, and this was a Storiescape production.

52:50you

From the publisher

Digital technology has transformed the science of bioacoustics - the ways we hear and record animal life in the deep oceans, through the earth and in the skies. Vast leaps in computing power allow us to analyse hundreds of thousands of hours of chirps, whistles, clicks and rumbles. Some researchers say AI can help us understand how elephants communicate in the jungle, what whales are clicking to one another across the watery abyss, and what bats squeal when swooping through the sky. Can we, should we, become digital Dolittles? Maria Margaronis listens in to these ever-expanding realms and wonders what they tell us about our own place on the planet.

More from The Documentary Podcast

All 508 episodes
Digital Dolittles: Talking to the animals?The Documentary Podcast · 50 min
Listen in VO