Accelerating Full Waveform Inversion By Transfer Learning

Read original: arXiv:2408.00695 - Published 8/2/2024 by Divya Shyam Singh, Leon Herrmann, Qing Sun, Tim Burchner, Felix Dietrich, Stefan Kollmannsberger
Total Score

0

🔄

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • This blog post provides a plain English summary and critical analysis of a technical research paper.
  • The paper explores a novel approach to full waveform inversion, a geophysical technique used to model the Earth's subsurface.
  • Key ideas include using physics-guided neural networks and stochastic optimization to improve the accuracy and efficiency of this inverse problem.

Plain English Explanation

The research paper describes a new way to model the Earth's underground structure using a technique called full waveform inversion. This is important for applications like oil and gas exploration, where companies need detailed information about the rock layers and structures beneath the surface.

Traditionally, full waveform inversion has been a challenging problem because it involves complex mathematical models and a lot of computational power. The researchers in this paper propose using physics-guided neural networks to help make the inversion process more efficient and accurate.

The key idea is to incorporate prior knowledge about the physical laws governing wave propagation into the neural network architecture. This allows the model to learn patterns in the data that are consistent with the underlying physics, rather than just trying to fit the data without any physical constraints.

Additionally, the researchers explore using stochastic optimization techniques to further improve the inversion process. This involves introducing randomness into the optimization algorithm, which can help the model escape local minima and explore a wider range of possible solutions.

Overall, this research represents an important step forward in making full waveform inversion more practical and widely applicable for real-world problems in geophysics and related fields.

Technical Explanation

The paper proposes a physics-guided neural network architecture for full waveform inversion. The key elements of this approach include:

  1. Physics-Guided Encoder: The neural network includes an encoder module that takes in the observed seismic data and learns a compressed representation that is consistent with the underlying physics of wave propagation. This is achieved by incorporating differentiable wave simulation models into the network architecture.

  2. Stochastic Optimization: The researchers use stochastic gradient descent with a deep generative prior to optimize the network parameters. This helps the model explore a wider range of possible solutions and avoid getting stuck in local minima.

  3. Ensemble Approach: To further improve the robustness of the inversion, the authors train an ensemble of physics-guided neural networks and combine their outputs using a weighted average.

Through extensive experiments on both synthetic and real-world seismic datasets, the researchers demonstrate that their approach outperforms traditional full waveform inversion methods in terms of accuracy, efficiency, and stability.

Critical Analysis

The paper presents a compelling approach to addressing the challenges of full waveform inversion, but there are a few potential limitations and areas for further research:

  • The performance of the physics-guided neural network is still dependent on the accuracy of the underlying wave simulation model. Errors or simplifications in this model could introduce biases in the inversion results.
  • The stochastic optimization technique requires careful tuning of hyperparameters, which could be challenging in practice, especially for large-scale problems.
  • The ensemble approach increases the computational cost of the inversion, which may be a concern for real-time or resource-constrained applications.

Future research could explore ways to make the neural network architecture and optimization more robust to model uncertainties, or investigate how to balance the tradeoffs between accuracy, efficiency, and computational cost for different application scenarios.

Conclusion

This research paper presents a novel approach to full waveform inversion that leverages physics-guided neural networks and stochastic optimization. By incorporating prior knowledge about the underlying physics, the method is able to achieve improved accuracy and efficiency compared to traditional techniques.

The potential impact of this work is significant, as full waveform inversion is a critical tool for a wide range of geophysical applications, from oil and gas exploration to infrastructure monitoring and hazard assessment. The advancements described in this paper could help make these techniques more practical and accessible for real-world use, ultimately contributing to our understanding of the Earth's subsurface and the development of more sustainable energy and infrastructure solutions.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

🔄

Total Score

0

Accelerating Full Waveform Inversion By Transfer Learning

Divya Shyam Singh, Leon Herrmann, Qing Sun, Tim Burchner, Felix Dietrich, Stefan Kollmannsberger

Full waveform inversion (FWI) is a powerful tool for reconstructing material fields based on sparsely measured data obtained by wave propagation. For specific problems, discretizing the material field with a neural network (NN) improves the robustness and reconstruction quality of the corresponding optimization problem. We call this method NN-based FWI. Starting from an initial guess, the weights of the NN are iteratively updated to fit the simulated wave signals to the sparsely measured data set. For gradient-based optimization, a suitable choice of the initial guess, i.e., a suitable NN weight initialization, is crucial for fast and robust convergence. In this paper, we introduce a novel transfer learning approach to further improve NN-based FWI. This approach leverages supervised pretraining to provide a better NN weight initialization, leading to faster convergence of the subsequent optimization problem. Moreover, the inversions yield physically more meaningful local minima. The network is pretrained to predict the unknown material field using the gradient information from the first iteration of conventional FWI. In our computational experiments on two-dimensional domains, the training data set consists of reference simulations with arbitrarily positioned elliptical voids of different shapes and orientations. We compare the performance of the proposed transfer learning NN-based FWI with three other methods: conventional FWI, NN-based FWI without pretraining and conventional FWI with an initial guess predicted from the pretrained NN. Our results show that transfer learning NN-based FWI outperforms the other methods in terms of convergence speed and reconstruction quality.

Read more

8/2/2024

Physics-guided Full Waveform Inversion using Encoder-Solver Convolutional Neural Networks
Total Score

0

Physics-guided Full Waveform Inversion using Encoder-Solver Convolutional Neural Networks

Matan Goren, Eran Treister

Full Waveform Inversion (FWI) is an inverse problem for estimating the wave velocity distribution in a given domain, based on observed data on the boundaries. The inversion is computationally demanding because we are required to solve multiple forward problems, either in time or frequency domains, to simulate data that are then iteratively fitted to the observed data. We consider FWI in the frequency domain, where the Helmholtz equation is used as a forward model, and its repeated solution is the main computational bottleneck of the inversion process. To ease this cost, we integrate a learning process of an encoder-solver preconditioner that is based on convolutional neural networks (CNNs). The encoder-solver is trained to effectively precondition the discretized Helmholtz operator given velocity medium parameters. Then, by re-training the CNN between the iterations of the optimization process, the encoder-solver is adapted to the iteratively evolving velocity medium as part of the inversion. Without retraining, the performance of the solver deteriorates as the medium changes. Using our light retraining procedures, we obtain the forward simulations effectively throughout the process. We demonstrate our approach to solving FWI problems using 2D geophysical models with high-frequency data.

Read more

5/29/2024

Inversion-DeepONet: A Novel DeepONet-Based Network with Encoder-Decoder for Full Waveform Inversion
Total Score

0

Inversion-DeepONet: A Novel DeepONet-Based Network with Encoder-Decoder for Full Waveform Inversion

Zekai Guo, Lihui Chai, Shengjun Huang, Ye Li

Full waveform inversion (FWI) plays a crucial role in the field of geophysics. There has been lots of research about applying deep learning (DL) methods to FWI. The success of DL-FWI relies significantly on the quantity and diversity of the datasets. Nevertheless, existing FWI datasets, like OpenFWI, where sources have fixed locations or identical frequencies, provide limited information and do not represent the complex real-world scene. For instance, low frequencies help in resolving larger-scale structures. High frequencies allow for a more detailed subsurface features. %A single source frequency is insufficient to describe subsurface structural properties. We consider that simultaneously using sources with different frequencies, instead of performing inversion using low frequencies data and then gradually introducing higher frequencies data, has rationale and potential advantages. Hence, we develop three enhanced datasets based on OpenFWI where each source have varying locations, frequencies or both. Moreover, we propose a novel deep operator network (DeepONet) architecture Inversion-DeepONet for FWI. We utilize convolutional neural network (CNN) to extract the features from seismic data in branch net. Source parameters, such as locations and frequencies, are fed to trunk net. Then another CNN is employed as the decoder of DeepONet to reconstruct the velocity models more effectively. Through experiments, we confirm the superior performance on accuracy and generalization ability of our network, compared with existing data-driven FWI methods.

Read more

8/16/2024

Elastic Full-Waveform Inversion : How the physics of problem improves data-driven techniques?
Total Score

0

Elastic Full-Waveform Inversion : How the physics of problem improves data-driven techniques?

Vahid Negahdari, Seyed Reza Moghadasi, Mohammad Reza Razvan

Full-Waveform Inversion (FWI) is a nonlinear iterative seismic imaging technique that, by reducing the misfit between recorded and predicted seismic waveforms, can produce detailed estimates of subsurface geophysical properties. Nevertheless, the strong nonlinearity of FWI can trap the optimization in local minima. This issue arises due to factors such as improper initial values, the absence of low frequencies in the measurements, noise, and other related considerations. To address this challenge and with the advent of advanced machine-learning techniques, data-driven methods, such as deep learning, have attracted significantly increasing attention in the geophysical community. Furthermore, the elastic wave equation should be included in FWI to represent elastic effects accurately. The intersection of data-driven techniques and elastic scattering theories presents opportunities and challenges. In this paper, by using the knowledge of elastic scattering (Physics of problem) and integrating it with deep learning techniques, we propose methods for the solution of time-harmonic FWI to enhance accuracy compared to pure data-driven approaches. Moreover, by modifying the structure of the Variational Autoencoder, we introduce a probabilistic deep learning method based on the physics of the problem that enables us to explore the uncertainties of the solution. According to the limited availability of datasets in this field and to assess the performance and accuracy of the proposed methods, we create a comprehensive dataset close to reality and conduct a comparative analysis of the presented approaches to it.

Read more

6/11/2024