Can AI help us better predict the weather?

9 Sep 2026 · 44 min · 19 chapters

Ask about this episode

Ask anything about it. ChatGPT or Claude reads this page and answers with the times it was said.

Connect VO and ask about every podcast you hear, including the moments you saved. Add to ChatGPT · Add to Claude

In short

How Google DeepMind’s AI improves weather forecasting—especially tropical cyclones—by learning from past weather data and using raw satellite/station inputs to produce higher-resolution, more frequent, and probabilistic forecasts.

Guest

Peter Battaglia, Senior Director of Research at Google DeepMind. Background: leads DeepMind research; previously worked on machine learning for simulation and on ML methods for fluids; part of teams applying AI to weather and probabilistic modeling.

Key claims

  • Traditional numerical weather prediction solves fluid dynamics equations on supercomputers; AI instead learns statistical patterns from historical weather.
  • AI can improve lead time (e.g., “about an extra day” for cyclone accuracy) and provide probabilistic scenario ranges for decision-making.
  • WeatherNext 3 is end-to-end: it takes raw satellite imagery and predicts raw high-quality station observations, updating hourly.

Notable examples

  • Hurricane Melissa (Oct 2025): DeepMind model showed high confidence it would rapidly intensify to Category 5; National Hurricane Center used it to inform its Category 5 warning. Reported impacts include ~95 deaths and ~190 mph winds.

Written by AI. May contain mistakes. Listen to the episode to check what was said.

Chapters

Tap a time to open that second in VO

The Challenge of Weather Prediction

0:45 to 1:11

Exploration of the difficulties in predicting weather accurately.

“But now there is another way that is doing something completely different.”

Introduction to Peter Battaglia

1:11 to 1:23

Introduction of the guest, Peter Battaglia, and his role at DeepMind.

Case Study: Hurricane Melissa

1:23 to 7:00

Discussion on Hurricane Melissa and how AI models predicted its intensity.

“I want to start with a really concrete example of how AI has made a difference.”

Advancements in Cyclone Forecasting

7:00 to 9:48

Overview of Google DeepMind's advancements in predicting tropical cyclones.

“predicting hurricanes that far out in the future?”

The Urgency of Weather Prediction

9:48 to 11:41

Discussing the increasing urgency for accurate weather predictions due to climate change.

“Do people have access to these forecasts?”

Understanding the Butterfly Effect

11:41 to 13:19

Explanation of the butterfly effect and its implications for weather forecasting.

“I can imagine there's some people listening to this who are like, look, why is it so hot?”

DeepMind's Motivation in Weather Science

13:19 to 14:00

Exploring DeepMind's rationale for engaging in weather forecasting.

“And a fluid has a particular type of physical characteristics that mean that little things can make big, you know, impact.”

DeepMind's Motivation for Weather Forecasting

14:00 to 16:04

Learn why DeepMind engaged in weather forecasting and the significance of the challenge.

“And then what happens is you get a big ring of, you know, little waves that hit the other shore of the pond.”

Traditional Numerical Weather Prediction Explained

16:04 to 18:02

Understand the traditional methods of weather forecasting and their scientific basis.

“Yeah, so one of the dominant methods of forecasting the weather is called numerical weather prediction.”

AI vs. Traditional Weather Forecasting

18:02 to 21:54

Discover how AI models differ from traditional forecasting methods and their advantages.

“So in the same way that you might fit a line to a trend of numbers that are increasing, here we fit a very complicated line to a very complicated set of weather from the past and then extrapolate it out into the future.”
Show all 19 chapters

Probabilistic Weather Modeling Techniques

21:54 to 25:03

Explore how AI models incorporate probabilistic approaches to improve forecasting.

“At what point did these models become probabilistic?”

Weather Next 3: A New Era in Forecasting

25:03 to 28:00

Learn about the innovative Weather Next 3 model and its end-to-end data processing.

“And then when you've done it hundreds, maybe thousands of times, you sort of get a sense of what the future is most likely to look like.”

Introduction to Weather Next 3

28:00 to 30:00

Learn about the innovative features of the Weather Next 3 model for weather prediction.

“and we're also predicting raw station observations on the other side, all in a single model.”

Impact on Renewable Energy and Agriculture

30:00 to 31:40

Discover how advanced weather forecasting can aid in renewable energy and agricultural decision-making.

“So I think a lot of the decisions that went into Weather Next 3 were made on the basis of what people have been telling us they would like to see from the next generation of weather models.”

Innovation in Weather Prediction Architecture

31:40 to 33:50

Explore the innovations in the architecture of weather prediction models and their implications.

“So if you could start to forecast even like weekly rainfall or, you know, average temperature over a month, things like this, that can inform agricultural decision-making.”

AI vs Traditional Weather Models

33:50 to 36:50

Understand how AI weather models compare to traditional numerical methods in accuracy and efficiency.

“So you can't always say one model is uniformly better, even in tropical cyclones.”

Challenges with Extreme Weather Forecasting

36:50 to 39:50

Examine the challenges and opportunities in predicting extreme weather events with AI.

“It's a strange phenomena that these statistical learning methods can also predict the strongest hurricanes that have ever been recorded.”

Future of Weather Forecasting

39:50 to 42:05

Learn about the future potential and transformative applications of AI in weather forecasting.

“the existing supercomputers and so on that they've got running.”

Innovations in Weather Prediction

42:05 to 43:30

Explore how weather prediction techniques can influence other fields and incorporate language insights.

“Yeah, I mean, our weather forecasts are much bigger than the videos that we generate.”
Hear the part that matters, and keep it.Open this episode in VO. Double tap your headphones to save a moment as you listen.
Get VO free

Transcript

Automatic transcript. May contain errors.

0:00Hannah Fry:Welcome to Google Deep Mind the podcast, I'm Hannah Fry. When a hurricane is heading towards land, time becomes absolutely critical. An extra day of warning can clear the roads, empty the hospitals, open up shelters and get people to safety. Even a few hours can be the difference between a crisis and a catastrophe. But while we can calculate the exact second the sun will rise a thousand years from now, predicting the weather in the future with certainty remains one of the trickiest physics problems on the planet. How do you handle something that is so sensitive to tiny fluctuations, where a small change in today's air pressure can turn into a major storm a week later?

0:40Hannah Fry:The famous butterfly effect. Well, the traditional way is solving fluid dynamics equations with supercomputers. But now there is another way that is doing something completely different. The team at Google DeepMind have been thinking about the challenge of AI weather prediction for years. They started back in 2020 with models that use satellite images to predict short-term rainfall. Today, the latest system, WeatherNext, provides detailed hour-by-hour predictions for the entire planet. Joining me to discuss how AI models the weather is Peter Battaglia, Senior Director of Research at Google DeepMind.

1:22Hannah Fry:Welcome to the podcast, Peter. Thank you. I want to start with a really concrete example of how AI has made a difference. Tell me the story about Hurricane Melissa. Yeah, so Hurricane Melissa was a very powerful hurricane that struck Jamaica and several Caribbean islands in October 2025. And we had been working on specific models for hurricane forecasting for several years. and earlier in 2025, about a year ago, we released our best weather model and we created a website called Weather Lab that had live hurricane forecasts. We had also established these partnerships with a number of agencies, including the National Hurricane Center, which is in the U.S.

2:10under NOAA. So throughout the season, we had been seeing that the model was fairly accurate at predicting hurricanes. And when what became Hurricane Melissa started to form in the Atlantic about a week before it eventually made landfall, our forecast started showing that it was going to become a very intense hurricane.

2:30Hannah Fry:Because unusually, it started really small, didn't it? And stayed small for a while. Yeah. And this is how they work. They start as a disturbance. It's just some pattern that could eventually, given the warm sea temperature, draw up enough energy to then become a very intense and ferocious storm. So about a week before, a little less than a week before, we started to see the model becoming quite confident that it was going to turn into a Category 5 hurricane, which is the strongest category of hurricane. And what was it at this point? I don't think it was even a tropical storm yet. It might have been a tropical depression at that point.

3:06So actually, we watch the folks on Twitter or X. There's actually a pretty active meteorological community, and they follow a lot of the models. So they started to notice and say, this is, you know, the Google model is forecasting a very intense storm. And, you know, they're saying it's going to be category five and people started to notice and we were really watching intently.

3:26Hannah Fry:Were the other models, I mean, because there's numerous other simulations that are running looking at exactly that area at the same time, were they also predicting at this point that it was going to be catching fire? Some were predicting that it was going to rise in intensity, but none, to my knowledge, had the confidence and of the confidence around that it was going to become that intense and the specific trajectory and the specific level of intensity. The National Hurricane Center, their forecasters are making, they're constantly observing and making guesses and determinations and trying to refine their own official projection about what's going to happen.

4:02They're drawing on all sorts of different information, like traditional models that are well understood, newer models, and they're designed as a center. they're sort of set up to take lots of different pieces of information and then sort of stitch that all together to form their forecast. And so on Saturday, they made an official determination that it would become a Category 5 storm and hit Jamaica. It still wasn't even, I don't think it was even a Category 1 storm yet. So they had predicted that it was going to undergo rapid intensification in like a two-day, two-and-a-half-day period.

4:35Hannah Fry:So this is Saturday, and it was predicted to hit land on what day? I think it was going to reach Category 5, I think, on Monday and maybe make landfall on Tuesday, if I remember correctly. Right. So, this is still actually a fair amount of warning then? Yes. I think it had about three-day, you know, lead time. And when they issue that Category 5 warning, that also prompts, it triggers a set of preparatory responses. And then the local officials know, okay, this is, there's a lot of confidence, information suggesting this is going to be very dangerous. We're going to start evacuating. We're going to do all the different things that wouldn't have taken place had it been a less intense storm.

5:08And this was, we were told later, this was the lowest intensity storm that the National Hurricane Center had ever forecast to become Category 5. They had never made a Category 5 forecast from such a low intensity. And we learned later that they said they were heavily informed by watching our model, that our model confidence in the forecast was really increasing their own confidence.

5:32Hannah Fry:Because you were saying it with 80 % confidence, right? Yeah, I think it varied by which forecast, because we made forecasts every six hours. But about, yeah, about 80, you know, as the week unfolded, it went from, you know, a lower probability to a pretty high probability. So they issued the Category 5 warning. It did strike Jamaica. I think 95 people lost their lives, a huge amount of damage. I think on record, it was the highest wind ever recorded. Yeah, 190 mile an hour winds. Yeah. I mean, the thing is, as devastating as it was, it could have been worse had there been less warning. Yeah, we can never really know what would happen.

6:10But we do know that these types of operational centers are crucially important for protecting people and protecting property. And again, also getting the services back online once the storm passes. So, yeah, and just in general, through that whole experience, that was very, I mean, we've had this wonderful partnership with the National Hurricane Center. And our researchers talk to them, you know, all the time. And we learn a lot about how they make their determination. So then we can feed that back into how we operate. So even though it's sort of a case study in a single instance, we actually, that partnership and seeing that whole thing through lets us then learn about how to improve our models and the types of information that the decision makers need to see in order to inform their decisions.

6:50decisions.

6:51Hannah Fry:We're going to get into the model a little bit later, but I just wonder on this topic of Melissa, do you think that the AI model has a sort of a kind of advantage when it comes to predicting hurricanes that far out in the future? Or is it just that you're doing something different to the other models and that's maybe why you get a different result? The way I think about it, it's pretty simple. What's happened in the past is the same physical process that happens in the future. So when you get enough evidence of the past and you have models that are capable of really making sense of the fine, you know, sort of subtle structure among these, you know, input and output and past and future relationships, you just get more accurate predictions.

7:34So the better you do your sort of modeling and your machine learning and your evaluation and your data, you know, all the data handling, the better your models are going to be.

7:42Hannah Fry:Because it's still according to the same rules. It's still the same rules. You just have to extract as much information about that data from the past as you can and then use it to forecast the future. So tell me a bit about this cyclone forecasting that you're releasing to the world. Tell me a bit about that. What was the motivation behind that? We wanted to make a special case of the model that was designed to predict tropical cyclones. These are like some of the most intense, strongest, rarest really weather phenomena. And we felt if we could do this well, it will have impact. It'll also be a pretty significant scientific challenge that'll force us to improve our methods.

8:16This sort of phase of our project began in earnest about four years ago, and we were working on global models, sort of forecasting all the weather on the surface and the atmosphere for 10, 15-day forecasts. As we made progress on that, we wanted to have like downstream impact forecasting the actual weather events. So we looked at things like tropical cyclones have been in all of our papers. We've done little analyses. Okay, so this predicted the temperature, you know, in seven days, but can it predict the track of a tropical cyclone? So that had been going on for a while, but then we began a sort of focused line of work, a work stream, with a dedicated sub-team about two years ago or so.

8:57And we put a lot of investment in this, and we also built partnerships right from the get-go, academics, operational, meteorological centers. We had trusted testers for many months before we released it, but then we released it last year and we made improvements to it over time. When we run the experimental evaluations over the last several years and across the globe, we see about an extra day of accuracy in the sense that a forecast which would have had an accuracy of some level at a two-day forecast, we achieve that same accuracy at a three-day forecast in many cases. and this allows you to make, you know, again, preparations for the storm and, you know, plan and issue warnings earlier.

9:45And in general, this is going to, you know, potentially be a pretty impactful tool for people to use.

9:51Hannah Fry:Do people have access to these forecasts? Like if I wanted to know whether it was going to rain next week, could I look at your forecast? Yeah. So there's different ways to access the forecast. One way is we actually have a live feed of our forecast that you can access. So you can Google for weather next and you'll find it in various forms. If you want the tropical cyclone forecast, you can go on Weather Lab. We actually just released beyond the tropical cyclones, like temperature and wind and pressure as well. And if you want to know what the weather is going to be, like if you want to just use your weather app, you can use pixel or search and the weather next forecasts are also contributing to those forecasts as well so there's a lot of ways you know whether you're a enterprise customer and you want to get the data or you just want to kind of see the icon you can see the forecast and we were talking about all of these extreme weather events right of hurricanes and cyclones and so on is weather prediction becoming more urgent as time goes on weather is becoming more extreme as time goes on That's pretty clear.

10:56The real reason is because weather is energy. I mean, you have like, you know, the sun is electromagnetic radiation. The wind is mechanical energy. Temperature is kinetic energy. When you have a warmer Earth, you have more energy. And so the weather will be more intense. And that intensity also may at best is less predictable, at least by historical standards, because it's sort of changing weather patterns. And we're seeing that there's warmer temperatures globally. I think last year or the year before was the hottest year on record. And if you look back over the last 10, 15 years, all of the hottest years on record have basically been occurring in the last few decades.

11:36And so I think we see much more wildfires, other types of flooding and things like this. So I think as we see AI advance, its calling is there to try to apply it to some of the challenges that are also becoming more difficult and important.

11:50Hannah Fry:I can imagine there's some people listening to this who are like, look, why is it so hot? We've done amazing, phenomenal things with science. Why can't you tell me whether it's going to rain next Wednesday? You know? What makes weather forecasting hard is that little things can have big effects. So this is like the butterfly effect. If a butterfly flaps its wings or it doesn't, you know, this can have actually an impact on what large scale, if it's a storm or it's clear or what. Well, we can't observe every butterfly. So there's a fundamental limit to what we can observe. And that then translates to a fundamental limit in what we can predict.

12:32But that doesn't mean that, again, on the basis of all the evidence we've ever seen, we can't detect subtle little patterns that maybe have gone unnoticed historically with previous methods. And as technology advances and gets better, we're always going to see an increase in our ability to predict things more accurately. That's the reason it's hard. It's hard because we don't observe important features that drive it. But they do leave little hints and breadcrumbs that we can capture with statistical learning.

13:03Hannah Fry:Because when people talk about the butterfly effect, I mean, it's sort of not meant metaphorically, right? It's like, it's sort of quite literally true, right? That in theory, a butterfly could cause a hurricane. I'm not sure like how many butterflies have actually caused hurricanes. Like I couldn't say. But the point is that the atmosphere is a fluid. And a fluid has a particular type of physical characteristics that mean that little things can make big, you know, impact. So, again, even if you drop like a small rock into a pond, you might see a little ring or a little wave or a little sort of, you know, splash of droplet of water.

13:41And if you can capture that and understand that that indicates that there's probably something happened that will cause a sort of, you know, concentric circle to grow, you can take advantage of that. So this is where I think AI and machine learning are really how they work. They're able to, you know, realize, wait a second, I've seen droplets before that got splashed in this little ring over here. And then what happens is you get a big ring of, you know, little waves that hit the other shore of the pond.

14:08Hannah Fry:When you put it like that, it sort of does make sense that this might be an AI problem because it's pattern recognition in a lot of ways. But why was an AI lab like DeepMind? Why did you guys get involved in weather forecasting in the first place? What was the motivation? I think there was two main reasons. So one is because weather is very important. It's like probably the oldest prediction problem, one of the oldest problems in science. And, you know, part of our mission at Will DeepMind is to try to solve major scientific challenges that humanity faces. You know, one of the goals of AI is to be able to, you know, increase our ability to solve major scientific challenges that we face.

14:47Weather itself is a challenge, but it's not an abstract problem. Literally everybody knows a lot about weather, and it impacts everyone's lives every single day. For me more personally, I had been working on machine learning for simulation for many, many years, even before this. And we had even been working on using machine learning to simulate fluids. So several teams at DeepMind came together. Folks were interested in weather, folks were interested in simulation, and we realized that the methods that we had probably could apply to some of the methods, some of the problems in weather. And then one other thing that actually helped us, helped push us over to work on weather was that there was amazing data sets on weather that were already available.

15:33So the ECMWF, the European Center for Media Range Weather Forecasting, had been building these records of weather on Earth that like spanned decades. So we see this and we're like, this is perfect for machine learning. Like this is, we're so fortunate to be able to build on this. And it's no surprise that they also have very powerful, good AI weather models as well. So, you know, when you have, when the time is right, you have the right sort of raw materials. And then you have like the teams that can put this together and it's aligned with your mission. It's something, it's a good choice to work on it.

16:03Hannah Fry:We should probably describe actually what the more traditional numerical method is. What was happening before? How would we solve the weather before? Yeah, so one of the dominant methods of forecasting the weather is called numerical weather prediction. So the way this works is you have a supercomputer, and it runs an algorithm that takes in the current estimate of the weather on the Earth. And then it makes a prediction about the weather in the next hour or six hours. And then it takes its own prediction, and it feeds it back in, and it makes another prediction for a few hours later. Sure. And it's all based on essentially physics equations.

16:41So yeah, the algorithm itself, it's an approximation to the solution to the equations of fluid motion. So again, the atmosphere is a fluid. But if you say, I only know the variables of the present, and I want to solve for the variables of the future, I need to solve that somehow. Now, again, because of the butterfly effect and because there's coupling across scales, it's very difficult to solve these equations exactly because you'd have to know very, very detailed information to be able to solve for the whole thing. And it's a very big problem. So instead, they approximate this. And they approximate it by simulating the weather at a sort of coarse, blurry scale.

17:24And they find approximate solutions to those equations. and I mean really in practice this has been a sort of triumph of science and engineering for decades right the fact that you can like know what's going to happen in a week and a half or two weeks like what's the sky is you know whether there's rain doesn't fall or something is amazing really like this was never historically this was never possible maybe a day or two in advance but it just sort of shows that through decades of you know physics and engineering and computing and data collection. This has already been a huge triumph for humanity and an amazing demonstration of human ingenuity and intelligence.

18:01Hannah Fry:But then how does Google DeepMind's approach differ from everything that went before it? So these AI weather forecasts that we're building are based on looking at a history of weather and how it unfolds in time, and then learning the statistical patterns and on the basis of the past patterns, making predictions about the future in the same way. So in the same way that you might fit a line to a trend of numbers that are increasing, here we fit a very complicated line to a very complicated set of weather from the past and then extrapolate it out into the future. Talk me through the lineage then of AI and weather forecasting.

18:40Hannah Fry:How has it progressed over time? So the earliest use of machine learning and AI and weather forecasting was usually to help traditional numerical models fill in the blanks, especially in the finer scale structure that they weren't explicitly simulating. Then we saw as the image modeling work in machine learning evolved in the last maybe eight, 10 years, a new type of weather, AI weather model that was predicting, say, the rain over a country for 90 minutes or directly trying to predict the wind velocities in a small region. They weren't using numerical weather prediction, but they also weren't simulating all of the weather over the earth.

19:30They were just trying to basically do image or video modeling, but with weather images and video. And this third phase we're in now is simulating all the weather over the Earth in the same way that the numerical weather prediction methods are also simulating them. So they're trying to predict what's happening on the surface and in the atmosphere at all parts of the globe. And in principle, these are able to capture everything about the weather, at least at the resolution they're modeling, the same way that numerical weather prediction does.

20:04Hannah Fry:That thing you're describing, that's GraphCast, essentially, is it? Yeah, GraphCast was one of the first models in phase three, where they were taking all the weather on the Earth and then simulating a forecast out to 10 days. So, GraphCast, the way it works is it takes the full state of the weather over the globe. And similar to other AI and machine learning method, it runs the same local operation or learned function everywhere. And this roughly reflects that physics is the same everywhere. And then it processes this into a larger set of representations that cover the whole globe. And then it takes that and then predicts back down to what will happen locally again.

20:51Hannah Fry:What will happen in London? Does this make sense across the entire globe all at once and back down to what's going to happen in London? And you carry on going up and down and up and down. That's right. And the reason that's helpful, so numerical weather prediction doesn't do that. It just makes predictions at a very local scale. But statistical learning methods are able to learn large-scale structure of weather. So, for example, a very large hurricane can span, you know, 100 or more kilometers. And there's a lot of structure there. So, even the west side of a hurricane can tell you a lot about the east side of the hurricane.

21:27So by having the model able to represent the whole hurricane in one representation, it can better inform the local properties of what's going to happen next. And this is one big difference between AI weather models and traditional numerical weather prediction. That is probably why the AI models are so effective.

21:45Hannah Fry:Because they can see the whole globe at once. They can see large scale patterns as well and learn that structure and exploit that as well as the local structure. That makes sense. At what point did these models become probabilistic? Probabilistic means probability or probably. So a deterministic model always makes exactly one guess based on its inputs. A probabilistic model makes many guesses because this could happen or that could happen. And this allows a model to express the range of scenarios, most likely, and even some of the more unlikely but still possible events. So in the field of weather forecasting, they've been moving toward probabilistic forecasts for a while.

22:22So even traditional numerical weather forecasting has been using probabilistic models. And they just roll out different scenarios that represent different possible futures. We started working on probabilistic weather models just after GraphCast. So this was around 2023. And the first model we had in that was called GenCast. So it was in many ways a follow-on to GraphCast. It changed a bunch of things. but the biggest difference was instead of trying to predict the average weather that was expected to happen it predicted many different scenarios that were likely to happen and this is much more useful for extreme events and for any kind of decision making scenario where if you have you know extreme things or rare things that matter a lot you really want to kind of know even if it's only a 5 % or 10 % chance of happening, you probably want to prepare for it.

Read the full transcript

23:18Hannah Fry:I mean, these are, I guess, in a way, the sort of cones of probability that you see when you're looking at the trajectory of a hurricane. Exactly. It will probably land somewhere within this bound. Exactly. If you've seen all the little lines, they call them spaghetti plots, the different scenarios. Yeah, absolutely. So how do you do it then within the AI models? How do you get them to be probabilistic? Because by nature, they're making a prediction at a time, aren't they? Yeah, so now we have two different ways of doing this. So one way of doing it is, again, like many other AI techniques for video generation, we use diffusion models.

23:55And the idea there is the model, it learns to take a very noisy image and turn it into something that looks like weather, in this case. by starting with lots of different noisy images. When you refine it to look like weather, you wind up at a slightly different scenario. And that is how you get this diversity in these different scenarios.

24:18Hannah Fry:So it's almost like we were talking earlier about the butterfly and these little perturbations. So it's almost like you're injecting a bit of statistical perturbation and then running it forward so that you can see if anything changes. Yeah, so I think there's, again, we have two techniques. So diffusion models are traditionally used. we have another technique we use, which we invented, called functional generative networks. And what this does is injects different input scenarios, and it changes the actual weights in the neural network, the parameters of the neural network slightly. And this gives a diversity of outputs.

24:55Hannah Fry:So it's almost like you're saying, what would the world look like if there was a butterfly here, or a butterfly here, or a butterfly here, run them over and over and over and over And then when you've done it hundreds, maybe thousands of times, you sort of get a sense of what the future is most likely to look like. Yeah, the best way to just, you know, it's just these models just give a range of scenarios, each of which could have happened. And that allows people to look at the thing. They can, you know, again, I'm going back to the Hurricane Melissa example. When you see them all sort of making the same prediction about the intensity, you can start to have a lot of confidence that's what's going to happen.

25:32if they're spaghetti plots and they're all over the place then the model is saying it's very difficult for us to understand what could happen and that's a very important thing because it's a fact of how we forecast whether we cannot know certain things so it's important to for our models to recognize that and to essentially be sort of humble in the sense of not trying to over you know be overly confident about that and i guess the flip side of that is that that is how

25:59Hannah Fry:you are coming up with your confidence scores for the predictions that you do make that's That's right. That's right. So when they all are making the same prediction, you know that the model is, there's a very high chance that will happen. How's Weather Next 3 different to all of this then? So Weather Next 3 differs because instead of strictly taking in the estimate of the state of the weather that's produced by a weather bureau, it also takes in raw satellite imagery. And instead of simply predicting the estimate of the global weather, it also predicts what's measured at high-quality weather stations like airports.

26:35So this is one big, big feature where Weather Next 3 is moving beyond traditional numerical weather prediction to take raw data as input and predict raw data as output. So traditionally in the field of weather forecasting, there's actually a pretty mature and robust sequence of steps. So I like to use this analogy of a tree. I call it like the weather tree. The roots represent the data. So you get data from all sorts of places. And then where the roots meet the trunk, that's where we make the guess about the state of the weather at the current time. The trunk represents the operational models that predict all the weather on the Earth.

27:16And then as you go up into the branches, you start using the weather forecast for many, many different things. So you can maybe have like a regional model or a model that's focused on energy forecasting or extremes. You have all sorts of different types of weather models that start to be developed by different groups for specific use cases. And at the leaves of the tree, that's like your applications. I want to know what the weather is. You know, I pull out my phone. I want to know what's the temperature right where I am right now. We want to change the whole value chain of weather and we want to reshape this weather tree.

27:48So a single model takes the information from the roots and makes predictions about the leaves all at once. And so WeatherNext is the first attempt for us to do that, where we're taking in raw satellite observations, and we're also predicting raw station observations on the other side, all in a single model. Traditionally, this has been done in at least three or four different stages. Many groups are thinking about this. It's a pretty obvious idea to take more raw data and try to do the thing end-to-end. But Weather Next 3 is probably the first that is doing this at a level that's significantly more accurate than any previous AI or traditional model.

28:26Hannah Fry:Is this sort of the AI version of looking out the window? In some ways, yes. It's a very sophisticated. A sophisticated version of that. It's a very sophisticated way. It uses more computers. But yeah, I mean, that's exactly right. When you look out the window, you're looking at the sky. You kind of go, oh, well, it's like cloudy. It's probably not going to be as warm. Or I can see the trees moving. It's probably windy. Or there's rain, so I'm going to get wet. And so we are collapsing the many, many stages of processing into a more singular architecture and algorithm. Some other features are that it's operating at a higher resolution.

29:06So this means instead of seeing a sort of blurry or pixelated image, it's a much more refined image. And in fact, it has different resolutions that you can make predictions at. Another feature is instead of making a prediction about the weather every six hours, it makes a new prediction forecast every one hour. And the reason we can do that is because it's taking in satellite imagery that changes on an hourly basis. So by having data that's changing more frequently, we can then make forecasts that are different more frequently. And those forecasts themselves also have a higher temporal resolution.

29:41the model natively predicts a range of different weather states across a six-hour window. So it says in one o 'clock, two o 'clock, three o 'clock, we're going to get this weather instead of just saying at six o 'clock, at 12 o 'clock, we're going to have this weather.

29:56Hannah Fry:Which I can imagine ends up being quite useful for, I don't know, renewable energy prediction as to what you're actually going to get. Yeah. So I think a lot of the decisions that went into Weather Next 3 were made on the basis of what people have been telling us they would like to see from the next generation of weather models. So for renewable energy forecasting or load forecasting. What do you mean load forecasting? So load is, yeah, that's a technical term for electricity demand. So, you know, renewable wind power is mostly dependent on the wind speed. The solar, you know, solar power is dependent on how sunny it is, it turns out that the amount of electricity that the power grid needs to provide tends to be highly influenced by the temperature.

30:43Because people turn on the heat when it's cold, they turn on their air conditioners when it's hot, so you get peaks in the hottest parts of the summer and the coldest parts of the winter in electrical demand. So if we can predict the wet, the temperature, and also the humidity more accurately, we can make better predictions of the grid's, the demand for electricity. And then we also, if we can make better wind and solar predictions, we can make better predictions about the supply of electricity. So Weather Next 3 also offers new wind and solar variables that we hadn't been providing before. And that should help with the generation and also with the higher resolution surface temperature, we should be able to help with the electrical demand forecasting.

31:25Hannah Fry:I'm thinking about the impact on agriculture here as well. I mean, this is, they care a lot about weather. I think, I'm not sure this is true, but I think farmers are probably the oldest category of weather forecasters because they, like timing when to, you know, plant and when to harvest is like completely determined based on, you know, the temperature and the rain. So if you could start to forecast even like weekly rainfall or, you know, average temperature over a month, things like this, that can inform agricultural decision-making. You can also plant different types of crops, drought-resistant seeds, rain-resistant seeds.

32:02As AI weather models start to bridge out into these impact areas, we can think about making much longer-term forecasts, which people are starting to study, and also trying to model more directly these agricultural decisions. How much rainfall is too much rainfall that we'd want to then prepare for? How much is sort of normal and it's okay to just sort of ignore.

32:26Hannah Fry:Has this required a complete overhaul of the architecture that went before or are you able to just sort of plug in the data into what was there already? Some parts of the innovations in Weathernext 3 were relatively straightforward. So adding in solar variables and wind variables was relatively straightforward. It wasn't trivial because these variables have different characteristics that have to be accounted for. But making predictions about finer temporal resolutions or taking in satellite imagery or predicting stations were much more profound, dramatic changes to the architecture of the model and the training process that we use to actually train it with data.

33:03Hannah Fry:So let me ask about their performance then. How do they compare to the sort of more traditional numerical processes? Yeah, I mean, these days, the AI weather models are considerably more accurate. For us, GraphCast, I believe, was the first AI weather model to be more accurate than the traditional deterministic forecast. GenCast was the first that was significantly more accurate than the best probabilistic forecast from numerical weather prediction. Our new models are building on the performances of our old models. There's other, again, there's many other groups who are doing great work. I think the models we're building tend to be more accurate than those.

33:45But it's also hard to say because there's different variables, there's temperature, there's wind, there's different forecast horizons in the far future, the near term. There's lots of regions. So you can't always say one model is uniformly better, even in tropical cyclones. Historically, they usually relied on two different types of models to predict the track and the intensity. It turned out that predicting the track was better for models that were sort of coarse-grained and large-scale. The intensity was better predicted by models that had very fine-grained, kind of highly-resolved local features.

34:21Our model was the best at track and intensity, and it's a single model. Even then, though, you say, well, you have to look at, is it better at most intense storms? Is it better in the Pacific? Is it better in the Atlantic? It's very important to not make a single claim about this because it actually matters for decision-makers. If you say this is the best model and then, well, in this region, it's not. You don't want people to rely on it as much. So there's a lot. I just, the way I would say is we're really on a journey. It's hard to say that we're better than anyone uniformly the models. But when we evaluate, we tend to outperform the competitors at the, you know, the ones we're comparing.

35:00Hannah Fry:What about extreme weather events? The AI models as good as the traditional ones? Our models appear to be best on tropical cyclones. That's some of the most extreme weather on Earth. Yeah. There's been less work on things like extreme heat, extreme cold, even fine grain like tornadoes and things like this. There's less work that I'm aware of. But I think all of this stuff is going to, when you apply these same methods and, you know, using high quality data sets, you're going to, you know, the next few years, you're going to see most of these phenomena be best predicted by AI models. Here's one question about the fact that you are using the current time step to predict the next time step.

35:39Hannah Fry:If you end up getting a prediction slightly wrong, if there's like a little error in there, can those errors not compound over time? So that tends to be more a problem of traditional methods. There's nothing to kind of bring them back to what's most plausible. Because you're just using the equations, the physics equations. Once it just starts to go off into something that's rare, there's nothing about the equation that says it must be like normal weather. With AI models, their failure mode tends to be when they start to make errors, they tend to more just predict average weather. Like predicting the average weather is actually a pretty good way to predict weather.

36:13And it's actually the oldest way to predict weather. So if you're like a farmer and you're trying to figure out like, you know, when do I plant my seeds? You use like the season, like in the spring before it gets warm when we're going to have a lot of sunlight. So we see that statistical models tend to, when they start to generate errors, they just tend to predict, you know, they regress to the mean, it's called. They regress to the average weather. So they don't really blow up or explode very much like we see in kind of traditional numerical methods.

36:41Hannah Fry:But then I also wonder about unusual weather events, you know, that we're getting more and more of with climate change, these sort of statistical outliers, as it were. So those two things feel almost contradictory, that it tends towards the average weather but can also do even weather events you haven't seen before. Exactly. It's a strange phenomena that these statistical learning methods can also predict the strongest hurricanes that have ever been recorded. Right. The reason we think this is possible is because the weather is, it's really a mosaic of lots of local weather. So while the model might not have seen this specific instance of this storm at this location, this trajectory, it has seen intense weather in other parts of the globe, in other smaller scale things like storms and things like this.

37:28So the models learn the statistics of the local statistics, and then they can form a sort of novel, new, extreme forecast because they've seen the parts. And that's the best that we, to our understanding of why this works. But I think also this is an area that probably needs to be explored better as well. So as we try to get into regimes where we want to predict like the monsoon or things that are just, they only happen once a year. We just don't really actually have many examples of this. And we want to make sure that we're also innovating on the efficiency of the learning, that it can take not that many examples and still make use of them in a way that's sort of unbiased and accurate.

38:08Hannah Fry:Because even if you've got a few decades worth of data, it's still... It's not that many. Yeah. ...and full of points. Right, right. What's next for weather next then? What improvements would you like to see in the future? So there's so many applications of weather forecasting. Like weather, they estimate weather itself affects like a third of the economy. Now, it's not that a better weather forecast can help a third of the economy necessarily, but it makes contact with all sorts of things. energy, agriculture, insurance, transportation, disasters, all of those things need very specific information about what's going to happen.

38:46And also, there's a lot of applications of weather, like an energy especially, where they're also collecting a lot of weather observations themselves. And we could potentially incorporate these into our weather models. And we haven't done any of this yet. So the way I think about it is we've kind of made a significant advance on just forecasting the global weather. But now as we go into the many, many different branches of weather, there's just zillions of problems that can be tackled. And you can bring in data from the problem itself, much higher resolution. I mean, you often want to, you see weather patterns that are like happening on a less than a kilometer scale.

39:25And there's all sorts of data sources that can be brought in as well. I mean, most weather observations are actually not even used by weather agencies. So I actually think there's a ton of data, there's a ton of problems that haven't even been touched yet. We've just sort of demonstrated that we can make a very accurate forecast and now it's time to really get to work, I think.

39:44Hannah Fry:Some people sort of, I think, imagine that there'll be a point where the AI stuff just replaces the existing numerical methods, the existing supercomputers and so on that they've got running. Do you think that that will be the case? Do you think we'll move away from physics-based equations and those kind of simulations? Yes. So I think we will move away from approximating the solutions to equations, but we're not moving away from physics. The data was also created by physics. We're just going to approximate the physics in a different way. And I actually think that we're probably going to open a lot more applications of weather forecasting.

40:23My hope is that this will actually create a lot more opportunities and value in cottage industries and things like this as it's possible to make forecasts that are more accurate and also make forecasts that are more directly tied to the impact of weather. So instead of forecasting the wind, maybe you forecast the damage that the wind will cause to the power lines. If we can get to a regime where we're starting to forecast the impact, I think the sky's the limit.

40:54Hannah Fry:It's just so interesting, though, this idea that you're still not quite sure why it's able to do it so well. Like, are you working on interpretability too? To some extent. The lesson that I've learned about AI and machine learning is that ultimately it's the evaluation that determines the truth and the quality of the model. So while it's very helpful, I think, to understand how the model is making its predictions, why it makes errors and things like this, and it can also help folks who want to understand why the weather is, maybe they are meteorologists and they actually have a lot of knowledge about how the weather works.

41:27So if the model can help, can speak to them in that language, then they can make more use of it. But at the end of the day, I think if we want more accurate models, we need to be very diligent about keeping our focus on the evaluation. And we just expand our evaluation beyond, you know, the temperature or the wind to, again, these many more variables and many more observations. That's what's most important.

41:50Hannah Fry:My final question, I think the public is really focused on large language models at the moment, right? and sort of, to some extent, forgotten that there are all these other phenomenal research projects that are going on all over the place. Do you think there's things that the work on weather prediction has learned that can be applied to other applications? Yeah, I mean, our weather forecasts are much bigger than the videos that we generate. The scale that we're operating at is enormous. The data is enormous. These are gigabytes of data, many gigabytes of data that are going in and out of the models.

42:24Even the technique we've used, we've invented for the probabilistic forecasting, the functional generative network is a new technique of it's much more efficient to train and turned out to be much more effective for us than diffusion models. So we're also looking at that, how to incorporate some of the technical advances back into video modeling, probabilistic modeling that can span into other areas. By the same token, I want for us to also think about how to take LLMs and draw in insights from them. and you can start to think about maybe the weather model takes in text data. Why not? People are talking about the weather.

42:58Why doesn't it operate on that? Maybe you can interrogate the model with an LLM the same way that you can interrogate a video model with an LLM and ask it questions about what's happening in the video. Maybe you can say, is it going to rain on that mountaintop or in that valley? So we haven't even really scratched the surface of this, but I think there's a nice two-way interaction between the innovations we're making and feeding those back into video modeling and large-scale models and also taking the insights from language and these models take very diverse information.

43:28Hannah Fry:So much exciting stuff going on. Peter, thank you so much. Thank you for having me. Thank you. Weather prediction is one of the oldest puzzles we have. For most of human history, all we had to go on were signs like whether the sky was red at dusk or if you got a bad knee before the rain. And about 100 years ago, we started calculating the future using the best equations we had at our disposal. And now this is one place where AI is out there in the real world making a gigantic difference already, buying ourselves a bit more warning, an extra hour, an extra day. But on the right day, that makes all the difference.

44:10Hannah Fry:You have been listening to Google Deep Mind, the podcast, with me, Professor Hannah Fry. We've got lots more coming up in this series. So make sure you subscribe and we'll see you next time.

From the publisher

Can artificial intelligence solve one of science’s most chaotic physics puzzles? In this episode, Professor Hannah Fry sits down with Peter Battaglia, Senior Director of Research at Google DeepMind, to explore how machine learning is transforming global weather forecasting. From providing critical early warnings for Category 5 storms like Hurricane Melissa to predicting renewable energy supply and agricultural impacts, see how models like GraphCast and WeatherNext 3 are building upon decades of numerical physics to reshape our understanding of the atmosphere.

Learn more about WeatherNext 3, our most advanced global weather AI model yet: https://deepmind.google/science/weathernext/

Timestamps: 

00:00 Introduction

00:38 Hurricane Melissa

11:50 Why weather forecasting is hard

14:13 Traditional models vs AI models 

21:55 Probabilistic forecasting 

26:00 WeatherNext 3 

33:00 Future outlook 

43:44 Hannah's reflections 
 

Please leave us a review on Spotify or Apple Podcasts if you enjoyed this episode. We always want to hear from our audience whether that's in the form of feedback, new idea or a guest recommendation!


Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

More from Google DeepMind: The Podcast

All 18 episodes
Can AI help us better predict the weather?Google DeepMind: The Podcast · 44 min
Listen in VO