Discovery and inversion of the viscoelastic wave equation in inhomogeneous media

Read original: arXiv:2409.18370 - Published 9/30/2024 by Su Chen, Yi Ding, Hiroe Miyake, Xiaojun Li

⛏️

Overview

Identifying accurate partial differential equations (PDEs) from sparse and noisy data is a significant challenge in scientific machine learning.
Current sparse regression methods may produce inaccurate equations on sparse and noisy datasets and are not suitable for varying coefficients.
The proposed hybrid framework combines two alternating optimization phases: discovery and embedding.

Plain English Explanation

The paper addresses the problem of accurately identifying partial differential equations from limited and imperfect data. This is an important challenge in scientific machine learning, as these equations are used to model complex physical phenomena.

The key idea is to use a two-step process. First, the discovery phase employs existing sparse regression techniques to get a preliminary idea of the governing equations from the observations. Then, the embedding phase uses a specialized neural network model, called a recurrent convolutional neural network (RCNN), to further optimize the results and obtain more accurate equations and coefficients.

By alternating between these two phases, the framework is able to robustly identify the essential physical equations, even when faced with noisy and low-resolution measurements. This is important because real-world data is often imperfect, and being able to extract accurate models from such data has numerous applications in science and engineering.

Technical Explanation

The proposed hybrid framework combines two optimization phases:

Discovery Phase: This phase uses existing sparse regression techniques to get a preliminary identification of the governing equations from the observed data.
Embedding Phase: This phase employs a recurrent convolutional neural network (RCNN) model to further optimize the results from the discovery phase. The RCNN is designed to efficiently handle the time-space iterations involved in the discretized forms of the wave equation.

By alternating between these two phases, the framework can robustly identify the essential physical equations, even in the presence of high levels of noise and limited data availability in both spatial and temporal domains.

The performance of the proposed framework is evaluated through numerical experiments on various scenarios involving the wave equation in elastic/viscoelastic and homogeneous/inhomogeneous media. The results demonstrate the excellent robustness and accuracy of the proposed method.

Critical Analysis

The paper provides a comprehensive and rigorous approach to the challenging problem of identifying partial differential equations from noisy and limited data. The hybrid framework that combines discovery and embedding phases is a clever way to leverage the strengths of both sparse regression and deep learning techniques.

One potential limitation is the reliance on the wave equation, which may not be representative of all types of PDEs encountered in scientific applications. It would be valuable to see the framework tested on a wider range of PDE problems to assess its generalizability.

Additionally, the paper does not discuss the computational complexity of the proposed method, which could be an important consideration for real-world deployment, especially when dealing with large-scale datasets or high-dimensional PDEs.

Further research could explore ways to make the framework more adaptable, such as by incorporating physics-constrained learning or Bayesian techniques to better handle uncertainty and incorporate prior knowledge about the physical system.

Conclusion

The proposed hybrid framework offers a promising solution to the problem of accurately identifying partial differential equations from sparse and noisy data, a crucial challenge in scientific machine learning. By combining discovery and embedding phases, the method demonstrates excellent robustness and accuracy, even in the face of limited and imperfect data.

This research has the potential to significantly advance our ability to extract reliable mathematical models from real-world observations, with applications ranging from fluid dynamics and material science to climate modeling and beyond. As the field of scientific machine learning continues to evolve, innovative approaches like this hybrid framework will play a crucial role in unlocking new insights and driving scientific progress.

This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

⛏️

Discovery and inversion of the viscoelastic wave equation in inhomogeneous media

Su Chen, Yi Ding, Hiroe Miyake, Xiaojun Li

In scientific machine learning, the task of identifying partial differential equations accurately from sparse and noisy data poses a significant challenge. Current sparse regression methods may identify inaccurate equations on sparse and noisy datasets and are not suitable for varying coefficients. To address this issue, we propose a hybrid framework that combines two alternating direction optimization phases: discovery and embedding. The discovery phase employs current well-developed sparse regression techniques to preliminarily identify governing equations from observations. The embedding phase implements a recurrent convolutional neural network (RCNN), enabling efficient processes for time-space iterations involved in discretized forms of wave equation. The RCNN model further optimizes the imperfect sparse regression results to obtain more accurate functional terms and coefficients. Through alternating update of discovery-embedding phases, essential physical equations can be robustly identified from noisy and low-resolution measurements. To assess the performance of proposed framework, numerical experiments are conducted on various scenarios involving wave equation in elastic/viscoelastic and homogeneous/inhomogeneous media. The results demonstrate that the proposed method exhibits excellent robustness and accuracy, even when faced with high levels of noise and limited data availability in both spatial and temporal domains.

9/30/2024

Elastic Full-Waveform Inversion : How the physics of problem improves data-driven techniques?

Vahid Negahdari, Seyed Reza Moghadasi, Mohammad Reza Razvan

Full-Waveform Inversion (FWI) is a nonlinear iterative seismic imaging technique that, by reducing the misfit between recorded and predicted seismic waveforms, can produce detailed estimates of subsurface geophysical properties. Nevertheless, the strong nonlinearity of FWI can trap the optimization in local minima. This issue arises due to factors such as improper initial values, the absence of low frequencies in the measurements, noise, and other related considerations. To address this challenge and with the advent of advanced machine-learning techniques, data-driven methods, such as deep learning, have attracted significantly increasing attention in the geophysical community. Furthermore, the elastic wave equation should be included in FWI to represent elastic effects accurately. The intersection of data-driven techniques and elastic scattering theories presents opportunities and challenges. In this paper, by using the knowledge of elastic scattering (Physics of problem) and integrating it with deep learning techniques, we propose methods for the solution of time-harmonic FWI to enhance accuracy compared to pure data-driven approaches. Moreover, by modifying the structure of the Variational Autoencoder, we introduce a probabilistic deep learning method based on the physics of the problem that enables us to explore the uncertainties of the solution. According to the limited availability of datasets in this field and to assess the performance and accuracy of the proposed methods, we create a comprehensive dataset close to reality and conduct a comparative analysis of the presented approaches to it.

6/11/2024

📊

Physics-constrained robust learning of open-form partial differential equations from limited and noisy data

Mengge Du, Yuntian Chen, Longfeng Nie, Siyu Lou, Dongxiao Zhang

Unveiling the underlying governing equations of nonlinear dynamic systems remains a significant challenge. Insufficient prior knowledge hinders the determination of an accurate candidate library, while noisy observations lead to imprecise evaluations, which in turn result in redundant function terms or erroneous equations. This study proposes a framework to robustly uncover open-form partial differential equations (PDEs) from limited and noisy data. The framework operates through two alternating update processes: discovering and embedding. The discovering phase employs symbolic representation and a novel reinforcement learning (RL)-guided hybrid PDE generator to efficiently produce diverse open-form PDEs with tree structures. A neural network-based predictive model fits the system response and serves as the reward evaluator for the generated PDEs. PDEs with higher rewards are utilized to iteratively optimize the generator via the RL strategy and the best-performing PDE is selected by a parameter-free stability metric. The embedding phase integrates the initially identified PDE from the discovering process as a physical constraint into the predictive model for robust training. The traversal of PDE trees automates the construction of the computational graph and the embedding process without human intervention. Numerical experiments demonstrate our framework's capability to uncover governing equations from nonlinear dynamic systems with limited and highly noisy data and outperform other physics-informed neural network-based discovery methods. This work opens new potential for exploring real-world systems with limited understanding.

4/30/2024

Equation Discovery with Bayesian Spike-and-Slab Priors and Efficient Kernels

Da Long, Wei W. Xing, Aditi S. Krishnapriyan, Robert M. Kirby, Shandian Zhe, Michael W. Mahoney

Discovering governing equations from data is important to many scientific and engineering applications. Despite promising successes, existing methods are still challenged by data sparsity and noise issues, both of which are ubiquitous in practice. Moreover, state-of-the-art methods lack uncertainty quantification and/or are costly in training. To overcome these limitations, we propose a novel equation discovery method based on Kernel learning and BAyesian Spike-and-Slab priors (KBASS). We use kernel regression to estimate the target function, which is flexible, expressive, and more robust to data sparsity and noises. We combine it with a Bayesian spike-and-slab prior -- an ideal Bayesian sparse distribution -- for effective operator selection and uncertainty quantification. We develop an expectation-propagation expectation-maximization (EP-EM) algorithm for efficient posterior inference and function estimation. To overcome the computational challenge of kernel regression, we place the function values on a mesh and induce a Kronecker product construction, and we use tensor algebra to enable efficient computation and optimization. We show the advantages of KBASS on a list of benchmark ODE and PDE discovery tasks.

4/23/2024