Exploring the Potential of Hybrid Machine-Learning/Physics-Based Modeling for Atmospheric/Oceanic Prediction Beyond the Medium Range
2405.19518
0
0
Abstract
This paper explores the potential of a hybrid modeling approach that combines machine learning (ML) with conventional physics-based modeling for weather prediction beyond the medium range. It extends the work of Arcomano et al. (2022), which tested the approach for short- and medium-range weather prediction, and the work of Arcomano et al. (2023), which investigated its potential for climate modeling. The hybrid model used for the forecast experiments of the paper is based on the low-resolution, simplified parameterization atmospheric general circulation model (AGCM) SPEEDY. In addition to the hybridized prognostic variables of SPEEDY, the current version of the model has three purely ML-based prognostic variables. One of these is 6~h cumulative precipitation, another is the sea surface temperature, while the third is the heat content of the top 300 m deep layer of the ocean. The model has skill in predicting the El Ni~no cycle and its global teleconnections with precipitation for 3-7 months depending on the season. The model captures equatorial variability of the precipitation associated with Kelvin and Rossby waves and MJO. Predictions of the precipitation in the equatorial region have skill for 15 days in the East Pacific and 11.5 days in the West Pacific. Though the model has low spatial resolution, for these tasks it has prediction skill comparable to what has been published for high-resolution, purely physics-based, conventional operational forecast models.
Create account to get full access
Overview
- This paper explores the potential of using a hybrid approach combining machine learning and physics-based modeling for improving atmospheric and oceanic prediction beyond the medium range.
- The researchers investigate whether integrating machine learning techniques with traditional numerical weather prediction models can lead to enhanced forecasting performance.
- The study examines the capabilities and limitations of this hybrid approach compared to existing methods.
Plain English Explanation
The paper looks at a new way to improve weather and ocean forecasts for longer time periods, beyond the typical medium-range forecasts of about 7-10 days. Existing weather forecast models are based on complex physical equations, but advances in machine learning may allow for more accurate predictions.
The researchers test a "hybrid" approach that combines traditional physics-based weather models with machine learning techniques. The idea is that the strengths of each method can complement the weaknesses of the other, leading to better long-term forecasts. Validating the performance of these deep learning weather models is an important part of the study.
By improving global weather and ocean wave forecasting, this hybrid approach could have significant practical applications in areas like disaster preparedness, renewable energy planning, and transportation. Understanding the future advancements in meteorological forecasting is crucial for society.
Technical Explanation
The paper investigates the potential of using a hybrid machine learning/physics-based modeling approach for improving atmospheric and oceanic prediction beyond the medium range. The researchers combine numerical weather prediction (NWP) models, which are based on physical equations, with various machine learning techniques.
The goal is to leverage the strengths of both approaches - the physical realism of NWP models and the data-driven flexibility of machine learning - to achieve better long-term forecasting performance compared to existing methods. The study explores different ways of integrating the two components, such as using machine learning to correct NWP model biases or to emulate specific physical processes.
Key aspects of the research include:
- Experiment design to test the hybrid approach on a range of atmospheric and oceanic prediction tasks
- Architecture of the combined NWP and machine learning models
- Analysis of the performance gains, limitations, and sources of improvement compared to traditional NWP
Critical Analysis
The paper provides a thorough exploration of the potential benefits and challenges of the hybrid machine learning/physics-based modeling approach for weather and ocean forecasting. The researchers acknowledge several caveats and areas for further research, such as the need to better understand the relative contributions of the physical and data-driven components, and to investigate the robustness of the hybrid models to changes in the underlying physical systems.
One potential concern is the computational complexity and resource requirements of the hybrid approach, which may limit its practical deployability, especially for operational weather centers with constrained budgets and infrastructure. Further research is needed to improve the efficiency and scalability of these models.
Additionally, while the paper demonstrates promising results, it remains to be seen how well the hybrid models will generalize to a wider range of weather and ocean phenomena, especially in the context of rapidly evolving climatic conditions and technological advancements. Continued validation and testing of the hybrid approach will be crucial.
Conclusion
This paper presents a compelling exploration of using a hybrid machine learning/physics-based modeling approach to improve atmospheric and oceanic prediction beyond the medium range. The results suggest that by combining the strengths of these two complementary techniques, it may be possible to achieve enhanced long-term forecasting capabilities with significant practical benefits.
However, the research also highlights the need for further investigation into the relative contributions of the physical and data-driven components, as well as the scalability and robustness of the hybrid models. Ongoing validation and refinement of this approach will be essential as the field of weather and ocean forecasting continues to evolve.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
Embedding machine-learnt sub-grid variability improves climate model biases
Daniel Giles, James Briant, Cyril J. Morcrette, Serge Guillas
0
0
The under-representation of cloud formation is a long-standing bias associated with climate simulations. Parameterisation schemes are required to capture cloud processes within current climate models but have known biases. We overcome these biases by embedding a Multi-Output Gaussian Process (MOGP) trained on high resolution Unified Model simulations to represent the variability of temperature and specific humidity within a climate model. A trained MOGP model is coupled in-situ with a simplified Atmospheric General Circulation Model named SPEEDY. The temperature and specific humidity profiles of SPEEDY are perturbed at fixed intervals according to the variability predicted from the MOGP. Ten-year predictions are generated for both control and ML-hybrid models. The hybrid model reduces the global precipitation bias by 18% and over the tropics by 22%. To further understand the drivers of these improvements, physical quantities of interest are explored, such as the distribution of lifted index values and the alteration of the Hadley cell. The control and hybrid set-ups are also run in a plus 4K sea-surface temperature experiment to explore the effects of the approach on patterns relating to cloud cover and precipitation in a warmed climate setting.
6/17/2024
Coupled Ocean-Atmosphere Dynamics in a Machine Learning Earth System Model
Chenggong Wang, Michael S. Pritchard, Noah Brenowitz, Yair Cohen, Boris Bonev, Thorsten Kurth, Dale Durran, Jaideep Pathak
0
0
Seasonal climate forecasts are socioeconomically important for managing the impacts of extreme weather events and for planning in sectors like agriculture and energy. Climate predictability on seasonal timescales is tied to boundary effects of the ocean on the atmosphere and coupled interactions in the ocean-atmosphere system. We present the Ocean-linked-atmosphere (Ola) model, a high-resolution (0.25{deg}) Artificial Intelligence/ Machine Learning (AI/ML) coupled earth-system model which separately models the ocean and atmosphere dynamics using an autoregressive Spherical Fourier Neural Operator architecture, with a view towards enabling fast, accurate, large ensemble forecasts on the seasonal timescale. We find that Ola exhibits learned characteristics of ocean-atmosphere coupled dynamics including tropical oceanic waves with appropriate phase speeds, and an internally generated El Ni~no/Southern Oscillation (ENSO) having realistic amplitude, geographic structure, and vertical structure within the ocean mixed layer. We present initial evidence of skill in forecasting the ENSO which compares favorably to the SPEAR model of the Geophysical Fluid Dynamics Laboratory.
6/14/2024
🧠
Decomposing weather forecasting into advection and convection with neural networks
Mengxuan Chen, Ziqi Yuan, Jinxiao Zhang, Runmin Dong, Haohuan Fu
0
0
Operational weather forecasting models have advanced for decades on both the explicit numerical solvers and the empirical physical parameterization schemes. However, the involved high computational costs and uncertainties in these existing schemes are requiring potential improvements through alternative machine learning methods. Previous works use a unified model to learn the dynamics and physics of the atmospheric model. Contrarily, we propose a simple yet effective machine learning model that learns the horizontal movement in the dynamical core and vertical movement in the physical parameterization separately. By replacing the advection with a graph attention network and the convection with a multi-layer perceptron, our model provides a new and efficient perspective to simulate the transition of variables in atmospheric models. We also assess the model's performance over a 5-day iterative forecasting. Under the same input variables and training methods, our model outperforms existing data-driven methods with a significantly-reduced number of parameters with a resolution of 5.625 deg. Overall, this work aims to contribute to the ongoing efforts that leverage machine learning techniques for improving both the accuracy and efficiency of global weather forecasting.
5/13/2024
🔎
Generalizing Weather Forecast to Fine-grained Temporal Scales via Physics-AI Hybrid Modeling
Wanghan Xu, Fenghua Ling, Wenlong Zhang, Tao Han, Hao Chen, Wanli Ouyang, Lei Bai
0
0
Data-driven artificial intelligence (AI) models have made significant advancements in weather forecasting, particularly in medium-range and nowcasting. However, most data-driven weather forecasting models are black-box systems that focus on learning data mapping rather than fine-grained physical evolution in the time dimension. Consequently, the limitations in the temporal scale of datasets prevent these models from forecasting at finer time scales. This paper proposes a physics-AI hybrid model (i.e., WeatherGFT) which Generalizes weather forecasts to Finer-grained Temporal scales beyond training dataset. Specifically, we employ a carefully designed PDE kernel to simulate physical evolution on a small time scale (e.g., 300 seconds) and use a parallel neural networks with a learnable router for bias correction. Furthermore, we introduce a lead time-aware training framework to promote the generalization of the model at different lead times. The weight analysis of physics-AI modules indicates that physics conducts major evolution while AI performs corrections adaptively. Extensive experiments show that WeatherGFT trained on an hourly dataset, achieves state-of-the-art performance across multiple lead times and exhibits the capability to generalize 30-minute forecasts.
5/30/2024