Towards Physically Consistent Deep Learning For Climate Model Parameterizations

2406.03920

YC

0

Reddit

0

Published 6/7/2024 by Birgit Kuhbacher, Fernando Iglesias-Suarez, Niki Kilbertus, Veronika Eyring
Towards Physically Consistent Deep Learning For Climate Model Parameterizations

Abstract

Climate models play a critical role in understanding and projecting climate change. Due to their complexity, their horizontal resolution of ~40-100 km remains too coarse to resolve processes such as clouds and convection, which need to be approximated via parameterizations. These parameterizations are a major source of systematic errors and large uncertainties in climate projections. Deep learning (DL)-based parameterizations, trained on computationally expensive, short high-resolution simulations, have shown great promise for improving climate models in that regard. However, their lack of interpretability and tendency to learn spurious non-physical correlations result in reduced trust in the climate simulation. We propose an efficient supervised learning framework for DL-based parameterizations that leads to physically consistent models with improved interpretability and negligible computational overhead compared to standard supervised training. First, key features determining the target physical processes are uncovered. Subsequently, the neural network is fine-tuned using only those relevant features. We show empirically that our method robustly identifies a small subset of the inputs as actual physical drivers, therefore, removing spurious non-physical relationships. This results in by design physically consistent and interpretable neural networks while maintaining the predictive performance of standard black-box DL-based parameterizations. Our framework represents a crucial step in addressing a major challenge in data-driven climate model parameterizations by respecting the underlying physical processes, and may also benefit physically consistent deep learning in other research fields.

Create account to get full access

or

If you already have an account, we'll log you in

Overview

  • This paper proposes a new approach to incorporating physical constraints into deep learning models for climate model parameterizations.
  • The authors aim to develop more physically consistent and interpretable deep learning models for climate modeling tasks.
  • The proposed method enforces physical constraints during the training process to ensure the models adhere to known physical principles.
  • The authors demonstrate the effectiveness of their approach on several climate modeling tasks and compare it to traditional physics-based and data-driven models.

Plain English Explanation

Climate models are complex mathematical representations of the Earth's atmosphere, oceans, and other environmental systems. These models are essential for understanding and predicting the Earth's climate, but they can be computationally expensive and difficult to develop.

In this paper, the researchers explore using deep learning – a type of artificial intelligence that can learn patterns from data – to create more efficient and accurate climate models. However, traditional deep learning models can sometimes produce results that don't align with the physical laws governing the climate system.

To address this issue, the researchers developed a new deep learning approach that explicitly incorporates physical constraints into the model training process. This helps ensure the models behave in a way that is consistent with our understanding of the physical world, making them more interpretable and reliable for climate modeling tasks.

The researchers tested their approach on several climate-related problems, such as [link to joint parameter-parameterization inference paper] and [link to decomposing weather forecasting paper], and found that it outperformed traditional physics-based and data-driven models. This suggests that their method could be a valuable tool for improving the accuracy and efficiency of climate modeling, which is crucial for understanding and responding to the challenges of climate change.

Technical Explanation

The authors propose a novel deep learning framework that enforces physical consistency during the training process. They introduce a set of physically-informed loss functions that penalize model outputs that violate known physical constraints, such as conservation of mass, energy, and momentum.

These physical constraints are incorporated into the deep learning model's objective function, ensuring that the model learns to respect the underlying physical principles of the climate system. The authors demonstrate the effectiveness of this approach on several climate modeling tasks, including [link to capturing climatic variability paper] and [link to inductive biases paper].

Compared to traditional physics-based models and purely data-driven deep learning approaches, the authors show that their physically-consistent deep learning model achieves superior performance while maintaining interpretability and adherence to physical laws. This is particularly important in the context of climate modeling, where the ability to trust and understand the model's predictions is critical for informing policy decisions and responding to the challenges of climate change.

Critical Analysis

The authors present a compelling approach for improving the physical consistency of deep learning models in the context of climate modeling. By incorporating physical constraints directly into the model training process, they address a key limitation of traditional data-driven deep learning models, which can sometimes produce outputs that violate physical principles.

However, the authors acknowledge several limitations and areas for further research. For example, they note that their approach may be computationally more expensive than purely data-driven models, and that the specific choice of physical constraints to include may require domain-specific expertise.

Additionally, while the authors demonstrate the effectiveness of their approach on several climate modeling tasks, it remains to be seen how well it will generalize to a wider range of climate-related problems. [link to physics-based deep learning paper] raises important questions about the inductive biases of deep learning models and their ability to capture complex, long-term climate phenomena.

Overall, the authors' work represents a significant step forward in the integration of physical principles into deep learning models for climate applications. As the field of climate modeling continues to evolve, approaches like the one presented in this paper will likely play an increasingly important role in developing more accurate, interpretable, and trustworthy models to address the challenges of climate change.

Conclusion

This paper presents a novel deep learning framework that explicitly incorporates physical constraints into the model training process, enabling the development of more physically consistent and interpretable climate models. The authors demonstrate the effectiveness of their approach on several climate modeling tasks, showing that it outperforms traditional physics-based and purely data-driven models.

By bridging the gap between data-driven and physics-based approaches, the authors' work represents an important advancement in the field of climate modeling, with the potential to improve the accuracy, reliability, and transparency of climate projections. As the world grapples with the urgent challenges of climate change, tools like the one described in this paper will be crucial for informing policy decisions and guiding our response to this global crisis.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Related Papers

Embedding machine-learnt sub-grid variability improves climate model biases

Embedding machine-learnt sub-grid variability improves climate model biases

Daniel Giles, James Briant, Cyril J. Morcrette, Serge Guillas

YC

0

Reddit

0

The under-representation of cloud formation is a long-standing bias associated with climate simulations. Parameterisation schemes are required to capture cloud processes within current climate models but have known biases. We overcome these biases by embedding a Multi-Output Gaussian Process (MOGP) trained on high resolution Unified Model simulations to represent the variability of temperature and specific humidity within a climate model. A trained MOGP model is coupled in-situ with a simplified Atmospheric General Circulation Model named SPEEDY. The temperature and specific humidity profiles of SPEEDY are perturbed at fixed intervals according to the variability predicted from the MOGP. Ten-year predictions are generated for both control and ML-hybrid models. The hybrid model reduces the global precipitation bias by 18% and over the tropics by 22%. To further understand the drivers of these improvements, physical quantities of interest are explored, such as the distribution of lifted index values and the alteration of the Hadley cell. The control and hybrid set-ups are also run in a plus 4K sea-surface temperature experiment to explore the effects of the approach on patterns relating to cloud cover and precipitation in a warmed climate setting.

Read more

6/17/2024

Joint Parameter and Parameterization Inference with Uncertainty Quantification through Differentiable Programming

Joint Parameter and Parameterization Inference with Uncertainty Quantification through Differentiable Programming

Yongquan Qu, Mohamed Aziz Bhouri, Pierre Gentine

YC

0

Reddit

0

Accurate representations of unknown and sub-grid physical processes through parameterizations (or closure) in numerical simulations with quantified uncertainty are critical for resolving the coarse-grained partial differential equations that govern many problems ranging from weather and climate prediction to turbulence simulations. Recent advances have seen machine learning (ML) increasingly applied to model these subgrid processes, resulting in the development of hybrid physics-ML models through the integration with numerical solvers. In this work, we introduce a novel framework for the joint estimation of physical parameters and machine learning parameterizations with uncertainty quantification. Our framework incorporates online training and efficient Bayesian inference within a high-dimensional parameter space, facilitated by differentiable programming. This proof of concept underscores the substantial potential of differentiable programming in synergistically combining machine learning with differential equations, thereby enhancing the capabilities of hybrid physics-ML modeling.

Read more

5/8/2024

Probabilistic Emulation of a Global Climate Model with Spherical DYffusion

Probabilistic Emulation of a Global Climate Model with Spherical DYffusion

Salva Ruhling Cachay, Brian Henn, Oliver Watt-Meyer, Christopher S. Bretherton, Rose Yu

YC

0

Reddit

0

Data-driven deep learning models are on the verge of transforming global weather forecasting. It is an open question if this success can extend to climate modeling, where long inference rollouts and data complexity pose significant challenges. Here, we present the first conditional generative model able to produce global climate ensemble simulations that are accurate and physically consistent. Our model runs at 6-hourly time steps and is shown to be stable for 10-year-long simulations. Our approach beats relevant baselines and nearly reaches a gold standard for successful climate model emulation. We discuss the key design choices behind our dynamics-informed diffusion model-based approach which enables this significant step towards efficient, data-driven climate simulations that can help us better understand the Earth and adapt to a changing climate.

Read more

6/24/2024

👨‍🏫

Transferring climate change knowledge

Francesco Immorlano, Veronika Eyring, Thomas le Monnier de Gouville, Gabriele Accarino, Donatello Elia, Giovanni Aloisio, Pierre Gentine

YC

0

Reddit

0

Accurate and precise climate projections are required for climate adaptation and mitigation, but Earth system models still exhibit great uncertainties. Several approaches have been developed to reduce the spread of climate projections and feedbacks, yet those methods cannot capture the non-linear complexity inherent in the climate system. Using a Transfer Learning approach, we show that Machine Learning can be used to optimally leverage and merge the knowledge gained from Earth system models simulations and historical observations to more accurately project global surface air temperature fields in the 21st century. We reach an uncertainty reduction of more than 50% with respect to state-of-the-art approaches. We give evidence that our novel method provides narrower projection uncertainty together with more accurate mean climate projections, urgently required for climate adaptation.

Read more

6/21/2024