Implicit Assimilation of Sparse In Situ Data for Dense & Global Storm Surge Forecasting
2404.05758
0
0
📊
Abstract
Hurricanes and coastal floods are among the most disastrous natural hazards. Both are intimately related to storm surges, as their causes and effects, respectively. However, the short-term forecasting of storm surges has proven challenging, especially when targeting previously unseen locations or sites without tidal gauges. Furthermore, recent work improved short and medium-term weather forecasting but the handling of raw unassimilated data remains non-trivial. In this paper, we tackle both challenges and demonstrate that neural networks can implicitly assimilate sparse in situ tide gauge data with coarse ocean state reanalysis in order to forecast storm surges. We curate a global dataset to learn and validate the dense prediction of storm surges, building on preceding efforts. Other than prior work limited to known gauges, our approach extends to ungauged sites, paving the way for global storm surge forecasting.
Create account to get full access
Overview
- Hurricanes and coastal floods are among the most destructive natural disasters.
- Storm surges are a key factor in both, as they can cause the catastrophic effects of these events.
- However, forecasting storm surges, especially in areas without tide gauges, has proven challenging.
- This paper explores using neural networks to improve storm surge forecasting by implicitly assimilating sparse in situ data with coarse ocean state reanalysis.
Plain English Explanation
Hurricanes and coastal floods are some of the most devastating natural disasters that can occur. These events are closely tied to something called "storm surges," which are the abnormal rises in sea level that happen during a storm. Being able to accurately predict storm surges is crucial for preparing for and responding to hurricanes and coastal flooding.
Unfortunately, forecasting storm surges has been quite difficult, especially in areas that don't have tide gauges to measure the water levels. This paper proposes a new approach using neural networks to try to improve storm surge forecasting. The key idea is that the neural networks can take in sparse, local data from tide gauges and combine it with broader ocean data to make better predictions, even in places without their own tide gauge measurements.
The researchers built a global dataset to train and test their neural network models. Unlike previous work that was limited to only areas with tide gauges, this new approach can be used to forecast storm surges in locations that don't have their own measurement instruments. This could pave the way for more accurate and widespread storm surge forecasting around the world.
Technical Explanation
The researchers tackle two main challenges in this work: the difficulty of short-term storm surge forecasting, especially in areas without tide gauges, and the non-trivial handling of raw, unassimilated data for weather and ocean forecasting.
To address these challenges, the researchers demonstrate that neural networks can implicitly assimilate sparse in situ tide gauge data with coarse ocean state reanalysis to forecast storm surges. They build on previous efforts by curating a global dataset to learn and validate the dense prediction of storm surges.
Unlike prior work that was limited to only forecasting at known tide gauge locations, this new approach extends to ungauged sites as well. This allows for the potential of global storm surge forecasting, which could be invaluable for preparing and responding to hurricanes and coastal floods.
The neural network models used in this research are able to combine the local, sparse tide gauge measurements with the broader, lower-resolution ocean data to make accurate storm surge predictions, even in areas without their own monitoring instruments. This represents an advance over previous methods that were constrained to only forecasting at locations with dedicated tide gauges.
Critical Analysis
The paper presents a promising approach for improving storm surge forecasting, especially in areas that lack dedicated tide gauge measurements. By leveraging neural networks to implicitly assimilate sparse local data with coarse ocean reanalysis, the researchers demonstrate the potential for more comprehensive and accurate storm surge prediction.
However, the paper does note some limitations and caveats. For example, the quality and coverage of the underlying ocean reanalysis data could impact the neural networks' performance, and the researchers acknowledge the need for further validation and testing of the approach in diverse real-world scenarios.
Additionally, while the ability to forecast storm surges at ungauged locations is a significant advancement, there may still be challenges in reliably predicting storm surges in areas with complex coastal topography or other unique characteristics. Further research may be needed to address these more nuanced forecasting challenges.
Overall, this work represents an important step towards more robust and widely applicable storm surge forecasting capabilities, with the potential to enhance preparedness and response to devastating hurricanes and coastal floods. As with any research, continued scrutiny, testing, and refinement will be crucial to ensuring the reliability and practical utility of the proposed neural network-based approach.
Conclusion
This paper presents a novel neural network-based approach for forecasting storm surges, a key driver of the catastrophic impacts of hurricanes and coastal floods. By leveraging neural networks to implicitly assimilate sparse local tide gauge data with coarse ocean reanalysis, the researchers demonstrate the potential to extend storm surge forecasting capabilities to areas without dedicated measurement instruments.
If further developed and validated, this work could pave the way for more comprehensive and accurate global storm surge forecasting. This could be invaluable for improving preparedness and response to these devastating natural disasters, potentially saving lives and reducing the costly damage they can cause. As with any research, there are still important caveats and areas for continued exploration, but the core ideas presented in this paper represent a promising step forward.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
Neural Incremental Data Assimilation
Matthieu Blanke, Ronan Fablet, Marc Lelarge
0
0
Data assimilation is a central problem in many geophysical applications, such as weather forecasting. It aims to estimate the state of a potentially large system, such as the atmosphere, from sparse observations, supplemented by prior physical knowledge. The size of the systems involved and the complexity of the underlying physical equations make it a challenging task from a computational point of view. Neural networks represent a promising method of emulating the physics at low cost, and therefore have the potential to considerably improve and accelerate data assimilation. In this work, we introduce a deep learning approach where the physical system is modeled as a sequence of coarse-to-fine Gaussian prior distributions parametrized by a neural network. This allows us to define an assimilation operator, which is trained in an end-to-end fashion to minimize the reconstruction error on a dataset with different observation processes. We illustrate our approach on chaotic dynamical physical systems with sparse observations, and compare it to traditional variational data assimilation methods.
6/24/2024
📊
Data Assimilation with Machine Learning Surrogate Models: A Case Study with FourCastNet
Melissa Adrian, Daniel Sanz-Alonso, Rebecca Willett
0
0
Modern data-driven surrogate models for weather forecasting provide accurate short-term predictions but inaccurate and nonphysical long-term forecasts. This paper investigates online weather prediction using machine learning surrogates supplemented with partial and noisy observations. We empirically demonstrate and theoretically justify that, despite the long-time instability of the surrogates and the sparsity of the observations, filtering estimates can remain accurate in the long-time horizon. As a case study, we integrate FourCastNet, a state-of-the-art weather surrogate model, within a variational data assimilation framework using partial, noisy ERA5 data. Our results show that filtering estimates remain accurate over a year-long assimilation window and provide effective initial conditions for forecasting tasks, including extreme event prediction.
5/24/2024
Deep Generative Data Assimilation in Multimodal Setting
Yongquan Qu, Juan Nathaniel, Shuolin Li, Pierre Gentine
0
0
Robust integration of physical knowledge and data is key to improve computational simulations, such as Earth system models. Data assimilation is crucial for achieving this goal because it provides a systematic framework to calibrate model outputs with observations, which can include remote sensing imagery and ground station measurements, with uncertainty quantification. Conventional methods, including Kalman filters and variational approaches, inherently rely on simplifying linear and Gaussian assumptions, and can be computationally expensive. Nevertheless, with the rapid adoption of data-driven methods in many areas of computational sciences, we see the potential of emulating traditional data assimilation with deep learning, especially generative models. In particular, the diffusion-based probabilistic framework has large overlaps with data assimilation principles: both allows for conditional generation of samples with a Bayesian inverse framework. These models have shown remarkable success in text-conditioned image generation or image-controlled video synthesis. Likewise, one can frame data assimilation as observation-conditioned state calibration. In this work, we propose SLAMS: Score-based Latent Assimilation in Multimodal Setting. Specifically, we assimilate in-situ weather station data and ex-situ satellite imagery to calibrate the vertical temperature profiles, globally. Through extensive ablation, we demonstrate that SLAMS is robust even in low-resolution, noisy, and sparse data settings. To our knowledge, our work is the first to apply deep generative framework for multimodal data assimilation using real-world datasets; an important step for building robust computational simulators, including the next-generation Earth system models. Our code is available at: https://github.com/yongquan-qu/SLAMS
6/14/2024
Remote Sensing Data Assimilation with a Chained Hydrologic-hydraulic Model for Flood Forecasting
Thanh Huy Nguyen, Andrea Piacentini, Sophie Ricci, Ludovic Cassan, Simon Munier, Quentin Bonassies, Raquel Rodriguez-Suquet
0
0
A chained hydrologic-hydraulic model is implemented using predicted runoff from a large-scale hydrologic model (namely ISBA-CTRIP) as inputs to local hydrodynamic models (TELEMAC-2D) to issue forecasts of water level and flood extent. The uncertainties in the hydrological forcing and in friction parameters are reduced by an Ensemble Kalman Filter that jointly assimilates in-situ water levels and flood extent maps derived from remote sensing observations. The data assimilation framework is cycled in a real-time forecasting configuration. A cycle consists of a reanalysis and a forecast phase. Over the analysis, observations up to the present are assimilated. An ensemble is then initialized from the last analyzed states and issued forecasts for next 36 hr. Three strategies of forcing data for this forecast are investigated: (i) using CTRIP runoff for reanalysis and forecast, (ii) using observed discharge for analysis, then CTRIP runoff for forecast and (iii) using observed discharge for reanalysis and keep a persistent discharge value for forecast. It was shown that the data assimilation strategy provides a reliable reanalysis in hindcast mode. The combination of observed discharge and CTRIP runoff provides the most accurate results. For all strategies, the quality of the forecast decreases as the lead time increases. When the errors in CTRIP forcing are non-stationary, the forecast capability may be reduced. This work demonstrates that the forcing provided by a hydrologic model, while imperfect, can be efficiently used as input to a hydraulic model to issue reanalysis and forecasts, thanks to the assimilation of in-situ and remote sensing observations.
5/2/2024