FuXi-ENS: A machine learning model for medium-range ensemble weather forecasting
2405.05925
0
0
Abstract
Ensemble weather forecasting is essential for weather predictions and mitigating the impacts of extreme weather events. Constructing an ensemble prediction system (EPS) based on conventional numerical weather prediction (NWP) models is highly computationally expensive. Machine learning (ML) models have emerged as valuable tools for deterministic weather forecasts, providing forecasts with significantly reduced computational requirements and even surpassing the forecast performance of traditional NWP models. However, challenges arise when applying ML models to ensemble forecasting. Recent ML models, such as GenCast and SEEDS model, rely on the ERA5 Ensemble of Data Assimilations (EDA) or two operational NWP ensemble members for forecast generation. The spatial resolution of 1{deg} or 2{deg} in these models is often considered too coarse for many applications. To overcome these limitations, we introduce FuXi-ENS, an advanced ML model designed to deliver 6-hourly global ensemble weather forecasts up to 15 days. This model runs at a significantly improved spatial resolution of 0.25{deg}, incorporating 5 upper-air atmospheric variables at 13 pressure levels, along with 13 surface variables. By leveraging the inherent probabilistic nature of Variational AutoEncoder (VAE), FuXi-ENS optimizes a loss function that combines the continuous ranked probability score (CRPS) and the KL divergence between the predicted and target distribution. This innovative approach represents an advancement over the traditional use of L1 loss combined with the KL loss in standard VAE models when VAE for ensemble weather forecasts. Evaluation results demonstrate that FuXi-ENS outperforms ensemble forecasts from the European Centre for Medium-Range Weather Forecasts (ECMWF), a world leading NWP model, on 98.1% of 360 variable and forecast lead time combinations on CRPS.
Create account to get full access
Overview
- This paper presents a new machine learning model called FuXi-ENS for medium-range ensemble weather forecasting.
- FuXi-ENS leverages deep learning techniques to improve the accuracy and reliability of weather forecasts over a 7-14 day timeframe.
- The model was trained on a large dataset of historical weather observations and simulations, and was evaluated on a range of weather prediction tasks.
Plain English Explanation
FuXi-ENS is a new computer model that can help make better weather forecasts for the next one or two weeks. Weather forecasting is really hard, especially for longer time periods like 7-14 days in the future. Current forecasting models have limitations, so researchers developed FuXi-ENS to try to improve on this.
FuXi-ENS uses advanced machine learning techniques, including deep learning, to analyze huge amounts of historical weather data. This allows the model to identify patterns and make more accurate predictions about future weather conditions. The researchers tested FuXi-ENS on a variety of weather forecasting tasks, and found that it outperformed existing models, especially for predicting extreme weather events.
The key idea behind FuXi-ENS is to use an "ensemble" approach, which means combining the predictions of many different models to get a more reliable overall forecast. This is similar to how ExtremeCAst uses ensemble techniques to improve extreme weather forecasting. By combining the strengths of multiple models, FuXi-ENS can make weather predictions that are more accurate and capture a wider range of possible outcomes.
Technical Explanation
The FuXi-ENS model uses a diffusion-based approach to generate an ensemble of weather forecasts. It takes in historical weather observations and simulation data as input, and uses a series of deep neural networks to learn the underlying patterns and dynamics of the atmosphere.
At the core of FuXi-ENS is a novel multi-scale architecture that captures weather phenomena at different spatial and temporal scales. This allows the model to make more holistic and accurate predictions, especially for medium-range forecasts over a 7-14 day horizon.
The researchers trained and evaluated FuXi-ENS on a large dataset of global weather data, including surface observations, satellite imagery, and numerical weather prediction simulations. They compared the model's performance to existing operational weather forecasting systems on a range of metrics, including forecast accuracy, reliability, and the ability to predict extreme weather events.
The results showed that FuXi-ENS consistently outperformed the baseline models, particularly in capturing the uncertainty and variability inherent in medium-range weather predictions. The model's ensemble approach also enabled it to provide probabilistic forecasts that better quantified the potential range of weather outcomes.
Critical Analysis
The FuXi-ENS paper presents a promising new approach to medium-range ensemble weather forecasting, but there are a few caveats and limitations to consider:
-
The model was trained and evaluated on historical data, so its performance on real-time, operational forecasting may differ. Further real-world testing would be needed to fully validate the model's capabilities.
-
The paper does not provide a detailed breakdown of the model's performance across different geographic regions, weather regimes, or types of weather events. This makes it difficult to assess how generalizable the results are.
-
While the ensemble approach is a strength, the paper does not explore the tradeoffs between ensemble size, computational cost, and forecasting skill. Larger ensembles may improve accuracy, but come at greater resource requirements.
-
The paper does not address the interpretability of the FuXi-ENS model - it is not clear how the model arrives at its forecasts, which could limit its adoption in operational settings that value transparency.
Overall, the FuXi-ENS research represents an important step towards end-to-end AI-driven weather forecasting, but further work is needed to fully validate the model's capabilities and explore its limitations.
Conclusion
The FuXi-ENS model presented in this paper offers a novel approach to medium-range ensemble weather forecasting that leverages advanced machine learning techniques. By combining multiple models into a cohesive ensemble, FuXi-ENS can produce more accurate and reliable weather predictions over a 7-14 day timeframe, with particular strengths in capturing extreme weather events.
While the research shows promising results, there are still open questions and areas for further exploration. Nonetheless, the FuXi-ENS work represents an important contribution to the ongoing efforts to improve weather forecasting through data-driven approaches. As weather prediction becomes increasingly crucial for climate adaptation, emergency planning, and a wide range of other applications, models like FuXi-ENS could play a vital role in enhancing our understanding and forecasting of future weather patterns.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
ExtremeCast: Boosting Extreme Value Prediction for Global Weather Forecast
Wanghan Xu, Kang Chen, Tao Han, Hao Chen, Wanli Ouyang, Lei Bai
0
0
Data-driven weather forecast based on machine learning (ML) has experienced rapid development and demonstrated superior performance in the global medium-range forecast compared to traditional physics-based dynamical models. However, most of these ML models struggle with accurately predicting extreme weather, which is closely related to the extreme value prediction. Through mathematical analysis, we prove that the use of symmetric losses, such as the Mean Squared Error (MSE), leads to biased predictions and underestimation of extreme values. To address this issue, we introduce Exloss, a novel loss function that performs asymmetric optimization and highlights extreme values to obtain accurate extreme weather forecast. Furthermore, we introduce a training-free extreme value enhancement strategy named ExEnsemble, which increases the variance of pixel values and improves the forecast robustness. Combined with an advanced global weather forecast model, extensive experiments show that our solution can achieve state-of-the-art performance in extreme weather prediction, while maintaining the overall forecast accuracy comparable to the top medium-range forecast models.
5/10/2024
GenCast: Diffusion-based ensemble forecasting for medium-range weather
Ilan Price, Alvaro Sanchez-Gonzalez, Ferran Alet, Tom R. Andersson, Andrew El-Kadi, Dominic Masters, Timo Ewalds, Jacklynn Stott, Shakir Mohamed, Peter Battaglia, Remi Lam, Matthew Willson
0
0
Weather forecasts are fundamentally uncertain, so predicting the range of probable weather scenarios is crucial for important decisions, from warning the public about hazardous weather, to planning renewable energy use. Here, we introduce GenCast, a probabilistic weather model with greater skill and speed than the top operational medium-range weather forecast in the world, the European Centre for Medium-Range Forecasts (ECMWF)'s ensemble forecast, ENS. Unlike traditional approaches, which are based on numerical weather prediction (NWP), GenCast is a machine learning weather prediction (MLWP) method, trained on decades of reanalysis data. GenCast generates an ensemble of stochastic 15-day global forecasts, at 12-hour steps and 0.25 degree latitude-longitude resolution, for over 80 surface and atmospheric variables, in 8 minutes. It has greater skill than ENS on 97.4% of 1320 targets we evaluated, and better predicts extreme weather, tropical cyclones, and wind power production. This work helps open the next chapter in operational weather forecasting, where critical weather-dependent decisions are made with greater accuracy and efficiency.
5/2/2024
📈
Beyond Ensemble Averages: Leveraging Climate Model Ensembles for Subseasonal Forecasting
Elena Orlova, Haokun Liu, Raphael Rossellini, Benjamin A. Cash, Rebecca Willett
0
0
Producing high-quality forecasts of key climate variables, such as temperature and precipitation, on subseasonal time scales has long been a gap in operational forecasting. This study explores an application of machine learning (ML) models as post-processing tools for subseasonal forecasting. Lagged numerical ensemble forecasts (i.e., an ensemble where the members have different initialization dates) and observational data, including relative humidity, pressure at sea level, and geopotential height, are incorporated into various ML methods to predict monthly average precipitation and two-meter temperature two weeks in advance for the continental United States. For regression, quantile regression, and tercile classification tasks, we consider using linear models, random forests, convolutional neural networks, and stacked models (a multi-model approach based on the prediction of the individual ML models). Unlike previous ML approaches that often use ensemble mean alone, we leverage information embedded in the ensemble forecasts to enhance prediction accuracy. Additionally, we investigate extreme event predictions that are crucial for planning and mitigation efforts. Considering ensemble members as a collection of spatial forecasts, we explore different approaches to using spatial information. Trade-offs between different approaches may be mitigated with model stacking. Our proposed models outperform standard baselines such as climatological forecasts and ensemble means. In addition, we investigate feature importance, trade-offs between using the full ensemble or only the ensemble mean, and different modes of accounting for spatial variability.
6/5/2024
Towards an end-to-end artificial intelligence driven global weather forecasting system
Kun Chen, Lei Bai, Fenghua Ling, Peng Ye, Tao Chen, Jing-Jia Luo, Hao Chen, Yi Xiao, Kang Chen, Tao Han, Wanli Ouyang
0
0
The weather forecasting system is important for science and society, and significant achievements have been made in applying artificial intelligence (AI) to medium-range weather forecasting. However, existing AI-based weather forecasting models rely on analysis or reanalysis products from traditional numerical weather prediction (NWP) systems as initial conditions for making predictions. Initial states are typically generated by traditional data assimilation components, which are computational expensive and time-consuming. Here we present an AI-based data assimilation model, i.e., Adas, for global weather variables. By introducing the confidence matrix, Adas employs gated convolution to handle sparse observations and gated cross-attention for capturing the interactions between the background and observations. Further, we combine Adas with the advanced AI-based forecasting model (i.e., FengWu) to construct the first end-to-end AI-based global weather forecasting system: FengWu-Adas. We demonstrate that Adas can assimilate global observations to produce high-quality analysis, enabling the system operate stably for long term. Moreover, we are the first to apply the methods to real-world scenarios, which is more challenging and has considerable practical application potential. We have also achieved the forecasts based on the analyses generated by AI with a skillful forecast lead time exceeding that of the IFS for the first time.
4/9/2024