Conditional diffusion models for downscaling & bias correction of Earth system model precipitation
2404.14416
0
0
Abstract
Climate change exacerbates extreme weather events like heavy rainfall and flooding. As these events cause severe losses of property and lives, accurate high-resolution simulation of precipitation is imperative. However, existing Earth System Models (ESMs) struggle with resolving small-scale dynamics and suffer from biases, especially for extreme events. Traditional statistical bias correction and downscaling methods fall short in improving spatial structure, while recent deep learning methods lack controllability over the output and suffer from unstable training. Here, we propose a novel machine learning framework for simultaneous bias correction and downscaling. We train a generative diffusion model in a supervised way purely on observational data. We map observational and ESM data to a shared embedding space, where both are unbiased towards each other and train a conditional diffusion model to reverse the mapping. Our method can be used to correct any ESM field, as the training is independent of the ESM. Our approach ensures statistical fidelity, preserves large-scale spatial patterns and outperforms existing methods especially regarding extreme events and small-scale spatial features that are crucial for impact assessments.
Create account to get full access
Overview
- This paper presents a novel approach to downscaling and bias correcting Earth system model precipitation using conditional diffusion models.
- The researchers develop a generative model that can produce high-resolution precipitation patterns from low-resolution climate model outputs.
- The model also addresses biases in the climate model predictions, improving their accuracy.
- Key applications include enhancing climate change impact assessments and improving regional-scale weather forecasting.
Plain English Explanation
The paper discusses a new way to take the predictions from large-scale climate models and turn them into more detailed, local-level rainfall patterns. Climate models give us a general idea of how precipitation might change in the future, but they often struggle to capture the finer details at smaller geographic scales.
The researchers created a diffusion-based generative model that can take the low-resolution rainfall forecasts from climate models and generate high-resolution precipitation maps. This helps to "downscale" the information, filling in the missing details.
The model also corrects for biases in the climate model predictions. Climate models have certain limitations and tend to over- or underestimate rainfall amounts in different regions. This new approach can adjust the precipitation patterns to better match observed real-world data, improving the accuracy.
These capabilities are important for assessing the local impacts of climate change and supporting regional weather forecasting efforts. By generating more realistic precipitation maps, the model can provide key insights for planners, policymakers, and emergency responders.
Technical Explanation
The paper introduces a conditional diffusion model for jointly downscaling and bias correcting Earth system model precipitation. Diffusion models are a type of generative AI that learn to gradually transform noise into realistic data samples.
The key innovation is conditioning the diffusion process on low-resolution climate model outputs. This allows the model to generate high-resolution precipitation fields that are coherent with the large-scale climate patterns, while also correcting systematic biases in the climate model predictions.
The researchers train the model using a diverse dataset spanning observational precipitation records, reanalysis products, and climate model simulations. They demonstrate the model's effectiveness through extensive quantitative and qualitative evaluations, showing significant improvements over existing downscaling and bias correction methods.
The conditional diffusion approach outperforms benchmark techniques in terms of spatial coherence, fine-scale detail, and bias reduction. The generated precipitation fields exhibit realistic small-scale structures and capture important regional climate features that are typically missed by coarse-resolution climate models.
Critical Analysis
The paper presents a compelling approach to address key limitations in climate model precipitation outputs. By leveraging the flexible and powerful diffusion modeling framework, the researchers are able to generate high-fidelity precipitation fields that are more useful for impact assessment and regional forecasting applications.
However, the study does not deeply explore the model's robustness to different climate regimes or extreme precipitation events. Additionally, the computational cost of running the diffusion model may limit its real-world deployment, especially for operational forecasting. Further research is needed to optimize the model's efficiency and generalization capabilities.
It would also be valuable to see the model integrated into a full end-to-end climate analysis pipeline, allowing its outputs to be used directly in impact studies or decision support systems. Assessing the downstream benefits for specific use cases would help quantify the practical value of this approach.
Overall, this is a promising step forward in the important challenge of bridging the scale gap between global climate models and local-level impacts. The diffusion-based downscaling and bias correction techniques showcased in this paper deserve further exploration and refinement.
Conclusion
This research presents a novel conditional diffusion model for enhancing Earth system model precipitation forecasts. By jointly downscaling and bias correcting the climate model outputs, the approach generates high-resolution precipitation patterns that are more accurate and spatially coherent.
The ability to bridge the scale gap between global climate models and local impacts is crucial for assessing the regional consequences of climate change and improving weather forecasting at regional scales. The techniques demonstrated in this paper represent an important step forward in this direction, with promising applications in climate adaptation planning, disaster risk management, and beyond.
As the field of generative AI continues to advance, we can expect to see more innovative solutions like this that leverage flexible modeling frameworks to extract greater value from climate data. Continued research and refinement of these methods will be essential for supporting robust climate decision-making in the years ahead.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
Precipitation Downscaling with Spatiotemporal Video Diffusion
Prakhar Srivastava, Ruihan Yang, Gavin Kerrigan, Gideon Dresdner, Jeremy McGibbon, Christopher Bretherton, Stephan Mandt
0
0
In climate science and meteorology, high-resolution local precipitation (rain and snowfall) predictions are limited by the computational costs of simulation-based methods. Statistical downscaling, or super-resolution, is a common workaround where a low-resolution prediction is improved using statistical approaches. Unlike traditional computer vision tasks, weather and climate applications require capturing the accurate conditional distribution of high-resolution given low-resolution patterns to assure reliable ensemble averages and unbiased estimates of extreme events, such as heavy rain. This work extends recent video diffusion models to precipitation super-resolution, employing a deterministic downscaler followed by a temporally-conditioned diffusion model to capture noise characteristics and high-frequency patterns. We test our approach on FV3GFS output, an established large-scale global atmosphere model, and compare it against six state-of-the-art baselines. Our analysis, capturing CRPS, MSE, precipitation distributions, and qualitative aspects using California and the Himalayas as examples, establishes our method as a new standard for data-driven precipitation downscaling.
6/21/2024
Diffusion-Based Joint Temperature and Precipitation Emulation of Earth System Models
Katie Christensen, Lyric Otto, Seth Bassetti, Claudia Tebaldi, Brian Hutchinson
0
0
Earth system models (ESMs) are the principal tools used in climate science to generate future climate projections under various atmospheric emissions scenarios on a global or regional scale. Generative deep learning approaches are suitable for emulating these tools due to their computational efficiency and ability, once trained, to generate realizations in a fraction of the time required by ESMs. We extend previous work that used a generative probabilistic diffusion model to emulate ESMs by targeting the joint emulation of multiple variables, temperature and precipitation, by a single diffusion model. Joint generation of multiple variables is critical to generate realistic samples of phenomena resulting from the interplay of multiple variables. The diffusion model emulator takes in the monthly mean-maps of temperature and precipitation and produces the daily values of each of these variables that exhibit statistical properties similar to those generated by ESMs. Our results show the outputs from our extended model closely resemble those from ESMs on various climate metrics including dry spells and hot streaks, and that the joint distribution of temperature and precipitation in our sample closely matches those of ESMs.
4/16/2024
Generative Diffusion-based Downscaling for Climate
Robbie A. Watt, Laura A. Mansfield
0
0
Downscaling, or super-resolution, provides decision-makers with detailed, high-resolution information about the potential risks and impacts of climate change, based on climate model output. Machine learning algorithms are proving themselves to be efficient and accurate approaches to downscaling. Here, we show how a generative, diffusion-based approach to downscaling gives accurate downscaled results. We focus on an idealised setting where we recover ERA5 at $0.25degree$~resolution from coarse grained version at $2degree$~resolution. The diffusion-based method provides superior accuracy compared to a standard U-Net, particularly at the fine scales, as highlighted by a spectral decomposition. Additionally, the generative approach provides users with a probability distribution which can be used for risk assessment. This research highlights the potential of diffusion-based downscaling techniques in providing reliable and detailed climate predictions.
4/30/2024
👀
Diffusion Model-based Probabilistic Downscaling for 180-year East Asian Climate Reconstruction
Fenghua Ling, Zeyu Lu, Jing-Jia Luo, Lei Bai, Swadhin K. Behera, Dachao Jin, Baoxiang Pan, Huidong Jiang, Toshio Yamagata
0
0
As our planet is entering into the global boiling era, understanding regional climate change becomes imperative. Effective downscaling methods that provide localized insights are crucial for this target. Traditional approaches, including computationally-demanding regional dynamical models or statistical downscaling frameworks, are often susceptible to the influence of downscaling uncertainty. Here, we address these limitations by introducing a diffusion probabilistic downscaling model (DPDM) into the meteorological field. This model can efficiently transform data from 1{deg} to 0.1{deg} resolution. Compared with deterministic downscaling schemes, it not only has more accurate local details, but also can generate a large number of ensemble members based on probability distribution sampling to evaluate the uncertainty of downscaling. Additionally, we apply the model to generate a 180-year dataset of monthly surface variables in East Asia, offering a more detailed perspective for understanding local scale climate change over the past centuries.
4/8/2024