Data-Driven Stochastic Closure Modeling via Conditional Diffusion Model and Neural Operator
0
Sign in to get full access
Overview
- This paper proposes a data-driven approach to modeling stochastic closures using a conditional diffusion model and neural operator.
- The method aims to capture the uncertainty and complex relationships in turbulence modeling by learning from data.
- Key techniques include a conditional diffusion model for generating realistic closure fields and a neural operator for efficient prediction.
Plain English Explanation
The paper presents a new way to model the uncertainty and complexity in turbulence simulations. Turbulence is a chaotic phenomenon that is difficult to capture accurately in computer models. Traditional methods often rely on simplified mathematical equations, called "closure models," to represent the effects of small-scale turbulent eddies.
The researchers developed a machine learning-based approach that can learn directly from data on turbulent flows. Their conditional diffusion model generates realistic samples of the closure fields, capturing the inherent randomness. And their neural operator efficiently predicts these closure fields for new flow conditions.
This data-driven method allows the turbulence model to adapt to different situations, rather than relying on fixed mathematical equations. By learning from examples, it can better represent the complex and stochastic nature of turbulence. This could lead to more accurate simulations in engineering applications like aerodynamics or combustion.
Technical Explanation
The key elements of the paper's methodology are:
-
Conditional Diffusion Model: The authors use a diffusion model, a type of generative AI, to learn the distribution of turbulence closure fields from data. This allows the model to generate realistic samples that capture the inherent randomness and uncertainty in the closure fields.
-
Neural Operator: To efficiently predict the closure fields for new flow conditions, the researchers develop a neural operator - a type of machine learning model that can learn the mapping between input flow conditions and output closure fields. This avoids the need for costly iterative solvers.
-
Training and Evaluation: The models are trained on high-fidelity simulation data of turbulent flows. The performance is evaluated by comparing the generated closure fields to ground truth data, as well as the accuracy of the neural operator predictions on held-out test cases.
The results show that the proposed data-driven approach can outperform traditional deterministic closure models in terms of accuracy and flexibility. The ability to capture the stochastic nature of turbulence is a key advantage of this method.
Critical Analysis
The paper acknowledges some limitations of the proposed approach. The conditional diffusion model and neural operator are still computationally more expensive than traditional closure models, though more efficient than brute-force solvers. Additionally, the training data requirements may be high, and the models may struggle to generalize to flow regimes not well represented in the training set.
Further research could explore ways to reduce the computational cost, such as linearization techniques or a priori uncertainty quantification. Developing more robust data-driven closure models and discovering closure terms from data are also promising research directions.
Conclusion
This paper presents a novel data-driven approach to modeling turbulence closures using a conditional diffusion model and neural operator. By learning directly from data, the method can capture the inherent randomness and complexity of turbulence, potentially leading to more accurate and flexible simulations in engineering applications. While there are still some practical limitations, the proposed techniques represent an important step forward in the field of turbulence modeling.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
0
Data-Driven Stochastic Closure Modeling via Conditional Diffusion Model and Neural Operator
Xinghao Dong, Chuanqi Chen, Jin-Long Wu
Closure models are widely used in simulating complex multiscale dynamical systems such as turbulence and the earth system, for which direct numerical simulation that resolves all scales is often too expensive. For those systems without a clear scale separation, deterministic and local closure models often lack enough generalization capability, which limits their performance in many real-world applications. In this work, we propose a data-driven modeling framework for constructing stochastic and non-local closure models via conditional diffusion model and neural operator. Specifically, the Fourier neural operator is incorporated into a score-based diffusion model, which serves as a data-driven stochastic closure model for complex dynamical systems governed by partial differential equations (PDEs). We also demonstrate how accelerated sampling methods can improve the efficiency of the data-driven stochastic closure model. The results show that the proposed methodology provides a systematic approach via generative machine learning techniques to construct data-driven stochastic closure models for multiscale dynamical systems with continuous spatiotemporal fields.
Read more8/7/2024
🧠
0
Diffusion models as probabilistic neural operators for recovering unobserved states of dynamical systems
Katsiaryna Haitsiukevich, Onur Poyraz, Pekka Marttinen, Alexander Ilin
This paper explores the efficacy of diffusion-based generative models as neural operators for partial differential equations (PDEs). Neural operators are neural networks that learn a mapping from the parameter space to the solution space of PDEs from data, and they can also solve the inverse problem of estimating the parameter from the solution. Diffusion models excel in many domains, but their potential as neural operators has not been thoroughly explored. In this work, we show that diffusion-based generative models exhibit many properties favourable for neural operators, and they can effectively generate the solution of a PDE conditionally on the parameter or recover the unobserved parts of the system. We propose to train a single model adaptable to multiple tasks, by alternating between the tasks during training. In our experiments with multiple realistic dynamical systems, diffusion models outperform other neural operators. Furthermore, we demonstrate how the probabilistic diffusion model can elegantly deal with systems which are only partially identifiable, by producing samples corresponding to the different possible solutions.
Read more5/14/2024
0
A Priori Uncertainty Quantification of Reacting Turbulence Closure Models using Bayesian Neural Networks
Graham Pash, Malik Hassanaly, Shashank Yellapantula
While many physics-based closure model forms have been posited for the sub-filter scale (SFS) in large eddy simulation (LES), vast amounts of data available from direct numerical simulation (DNS) create opportunities to leverage data-driven modeling techniques. Albeit flexible, data-driven models still depend on the dataset and the functional form of the model chosen. Increased adoption of such models requires reliable uncertainty estimates both in the data-informed and out-of-distribution regimes. In this work, we employ Bayesian neural networks (BNNs) to capture both epistemic and aleatoric uncertainties in a reacting flow model. In particular, we model the filtered progress variable scalar dissipation rate which plays a key role in the dynamics of turbulent premixed flames. We demonstrate that BNN models can provide unique insights about the structure of uncertainty of the data-driven closure models. We also propose a method for the incorporation of out-of-distribution information in a BNN. The efficacy of the model is demonstrated by a priori evaluation on a dataset consisting of a variety of flame conditions and fuels.
Read more7/26/2024
0
A probabilistic, data-driven closure model for RANS simulations with aleatoric, model uncertainty
Atul Agrawal, Phaedon-Stelios Koutsourelakis
We propose a data-driven, closure model for Reynolds-averaged Navier-Stokes (RANS) simulations that incorporates aleatoric, model uncertainty. The proposed closure consists of two parts. A parametric one, which utilizes previously proposed, neural-network-based tensor basis functions dependent on the rate of strain and rotation tensor invariants. This is complemented by latent, random variables which account for aleatoric model errors. A fully Bayesian formulation is proposed, combined with a sparsity-inducing prior in order to identify regions in the problem domain where the parametric closure is insufficient and where stochastic corrections to the Reynolds stress tensor are needed. Training is performed using sparse, indirect data, such as mean velocities and pressures, in contrast to the majority of alternatives that require direct Reynolds stress data. For inference and learning, a Stochastic Variational Inference scheme is employed, which is based on Monte Carlo estimates of the pertinent objective in conjunction with the reparametrization trick. This necessitates derivatives of the output of the RANS solver, for which we developed an adjoint-based formulation. In this manner, the parametric sensitivities from the differentiable solver can be combined with the built-in, automatic differentiation capability of the neural network library in order to enable an end-to-end differentiable framework. We demonstrate the capability of the proposed model to produce accurate, probabilistic, predictive estimates for all flow quantities, even in regions where model errors are present, on a separated flow in the backward-facing step benchmark problem.
Read more4/16/2024