Accelerated training of deep learning surrogate models for surface displacement and flow, with application to MCMC-based history matching of CO2 storage operations

Read original: arXiv:2408.10717 - Published 8/21/2024 by Yifu Han, Francois P. Hamon, Louis J. Durlofsky
Total Score

0

Accelerated training of deep learning surrogate models for surface displacement and flow, with application to MCMC-based history matching of CO2 storage operations

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • This paper presents a method for accelerating the training of deep learning surrogate models for surface displacement and flow, with an application to MCMC-based history matching of CO2 storage operations.
  • The key contributions include:
    • Developing a framework for efficiently training deep learning surrogate models for surface displacement and flow simulations.
    • Applying the surrogate models to speed up MCMC-based history matching of CO2 storage operations.
    • Demonstrating the effectiveness of the approach on a real-world case study.

Plain English Explanation

The paper discusses a technique to speed up the training of deep learning models that can approximate the behavior of complex physical systems. These "surrogate models" can be used to quickly predict things like surface displacement and fluid flow, which is important for analyzing and optimizing processes like CO2 storage underground.

The researchers developed a framework to efficiently train these deep learning surrogate models. They then applied the surrogate models to a real-world problem of history matching - adjusting the simulation model to match observed data - for a CO2 storage operation.

By using the fast surrogate models instead of the full, detailed simulations, the history matching process was accelerated significantly. This could lead to faster and more efficient analysis and optimization of CO2 storage and other complex physical systems.

Technical Explanation

The paper develops a framework for training deep learning surrogate models that can approximate the behavior of complex physical systems, such as surface displacement and fluid flow simulations. The key technical contributions include:

  1. Surrogate Model Architecture: The authors propose a deep neural network architecture consisting of graph convolutional layers and long short-term memory (LSTM) layers to capture the spatial and temporal dynamics of the physical system.

  2. Accelerated Training: To speed up the training of the surrogate models, the authors utilize techniques such as transfer learning and meta-learning, which allow the model to leverage knowledge from previously trained models.

  3. Application to MCMC-based History Matching: The trained surrogate models are used to accelerate the Markov Chain Monte Carlo (MCMC) -based history matching process for CO2 storage operations. The surrogate models provide fast predictions of the system behavior, allowing for more efficient exploration of the parameter space.

  4. Case Study Evaluation: The effectiveness of the approach is demonstrated on a real-world case study of CO2 storage, where the surrogate models are shown to provide accurate predictions while significantly speeding up the history matching process.

Critical Analysis

The paper presents a promising approach for accelerating the training of deep learning surrogate models and applying them to complex physical systems. However, some potential limitations and areas for further research include:

  1. Generalization Capabilities: The authors mention that the surrogate models are trained and evaluated on a specific case study. Additional research is needed to understand how well the models generalize to other types of physical systems or scenarios.

  2. Uncertainty Quantification: The paper focuses on improving the computational efficiency of the history matching process, but does not explicitly address the quantification of uncertainties in the surrogate model predictions. Incorporating uncertainty quantification could be an important area for future work.

  3. Scalability to Larger Systems: The case study presented is relatively small-scale. Evaluating the performance of the approach on larger, more complex physical systems could provide valuable insights into the scalability of the method.

  4. Comparison to Other Surrogate Modeling Techniques: While the paper compares the proposed approach to the full-scale simulations, a comparison to other surrogate modeling techniques, such as reduced-order models or Gaussian processes, could provide a more comprehensive evaluation.

Conclusion

This paper presents a novel framework for accelerating the training of deep learning surrogate models for complex physical systems, with a focus on applications to CO2 storage operations. The key contributions include the development of an efficient surrogate model architecture and the application of the models to speed up MCMC-based history matching. The results demonstrate the potential of this approach to enable faster and more efficient analysis and optimization of complex physical processes, which could have important implications for fields such as energy, climate, and environmental engineering.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

Accelerated training of deep learning surrogate models for surface displacement and flow, with application to MCMC-based history matching of CO2 storage operations
Total Score

0

Accelerated training of deep learning surrogate models for surface displacement and flow, with application to MCMC-based history matching of CO2 storage operations

Yifu Han, Francois P. Hamon, Louis J. Durlofsky

Deep learning surrogate modeling shows great promise for subsurface flow applications, but the training demands can be substantial. Here we introduce a new surrogate modeling framework to predict CO2 saturation, pressure and surface displacement for use in the history matching of carbon storage operations. Rather than train using a large number of expensive coupled flow-geomechanics simulation runs, training here involves a large number of inexpensive flow-only simulations combined with a much smaller number of coupled runs. The flow-only runs use an effective rock compressibility, which is shown to provide accurate predictions for saturation and pressure for our system. A recurrent residual U-Net architecture is applied for the saturation and pressure surrogate models, while a new residual U-Net model is introduced to predict surface displacement. The surface displacement surrogate accepts, as inputs, geomodel quantities along with saturation and pressure surrogate predictions. Median relative error for a diverse test set is less than 4% for all variables. The surrogate models are incorporated into a hierarchical Markov chain Monte Carlo history matching workflow. Surrogate error is included using a new treatment involving the full model error covariance matrix. A high degree of prior uncertainty, with geomodels characterized by uncertain geological scenario parameters (metaparameters) and associated realizations, is considered. History matching results for a synthetic true model are generated using in-situ monitoring-well data only, surface displacement data only, and both data types. The enhanced uncertainty reduction achieved with both data types is quantified. Posterior saturation and surface displacement fields are shown to correspond well with the true solution.

Read more

8/21/2024

Graph Network Surrogate Model for Subsurface Flow Optimization
Total Score

0

Graph Network Surrogate Model for Subsurface Flow Optimization

Haoyu Tang, Louis J. Durlofsky

The optimization of well locations and controls is an important step in the design of subsurface flow operations such as oil production or geological CO2 storage. These optimization problems can be computationally expensive, however, as many potential candidate solutions must be evaluated. In this study, we propose a graph network surrogate model (GNSM) for optimizing well placement and controls. The GNSM transforms the flow model into a computational graph that involves an encoding-processing-decoding architecture. Separate networks are constructed to provide global predictions for the pressure and saturation state variables. Model performance is enhanced through the inclusion of the single-phase steady-state pressure solution as a feature. A multistage multistep strategy is used for training. The trained GNSM is applied to predict flow responses in a 2D unstructured model of a channelized reservoir. Results are presented for a large set of test cases, in which five injection wells and five production wells are placed randomly throughout the model, with a random control variable (bottom-hole pressure) assigned to each well. Median relative error in pressure and saturation for 300 such test cases is 1-2%. The ability of the trained GNSM to provide accurate predictions for a new (geologically similar) permeability realization is demonstrated. Finally, the trained GNSM is used to optimize well locations and controls with a differential evolution algorithm. GNSM-based optimization results are comparable to those from simulation-based optimization, with a runtime speedup of a factor of 36. Much larger speedups are expected if the method is used for robust optimization, in which each candidate solution is evaluated on multiple geological models.

Read more

5/16/2024

Machine learning surrogates for efficient hydrologic modeling: Insights from stochastic simulations of managed aquifer recharge
Total Score

0

Machine learning surrogates for efficient hydrologic modeling: Insights from stochastic simulations of managed aquifer recharge

Timothy Dai, Kate Maher, Zach Perzan

Process-based hydrologic models are invaluable tools for understanding the terrestrial water cycle and addressing modern water resources problems. However, many hydrologic models are computationally expensive and, depending on the resolution and scale, simulations can take on the order of hours to days to complete. While techniques such as uncertainty quantification and optimization have become valuable tools for supporting management decisions, these analyses typically require hundreds of model simulations, which are too computationally expensive to perform with a process-based hydrologic model. To address this gap, we propose a hybrid modeling workflow in which a process-based model is used to generate an initial set of simulations and a machine learning (ML) surrogate model is then trained to perform the remaining simulations required for downstream analysis. As a case study, we apply this workflow to simulations of variably saturated groundwater flow at a prospective managed aquifer recharge (MAR) site. We compare the accuracy and computational efficiency of several ML architectures, including deep convolutional networks, recurrent neural networks, vision transformers, and networks with Fourier transforms. Our results demonstrate that ML surrogate models can achieve under 10% mean absolute percentage error and yield order-of-magnitude runtime savings over processed-based models. We also offer practical recommendations for training hydrologic surrogate models, including implementing data normalization to improve accuracy, using a normalized loss function to improve training stability and downsampling input features to decrease memory requirements.

Read more

7/31/2024

Neural Operator-Based Proxy for Reservoir Simulations Considering Varying Well Settings, Locations, and Permeability Fields
Total Score

0

Neural Operator-Based Proxy for Reservoir Simulations Considering Varying Well Settings, Locations, and Permeability Fields

Daniel Badawi, Eduardo Gildin

Simulating Darcy flows in porous media is fundamental to understand the future flow behavior of fluids in hydrocarbon and carbon storage reservoirs. Geological models of reservoirs are often associated with high uncertainly leading to many numerical simulations for history matching and production optimization. Machine learning models trained with simulation data can provide a faster alternative to traditional simulators. In this paper we present a single Fourier Neural Operator (FNO) surrogate that outperforms traditional reservoir simulators by the ability to predict pressures and saturations on varying permeability fields, well locations, well controls, and number of wells. The maximum-mean relative error of 95% of pressure and saturation predictions is less than 5%. This is achieved by employing a simple yet very effective data augmentation technique that reduces the dataset size by 75% and reduces overfitting. Also, constructing the input tensor in a binary fashion enables predictions on unseen well locations, well controls, and number of wells. Such model can accelerate history matching and reservoir characterization procedures by several orders of magnitude. The ability to predict on new well locations, well controls, and number of wells enables highly efficient reservoir management and optimization.

Read more

7/16/2024