Closure Discovery for Coarse-Grained Partial Differential Equations Using Grid-based Reinforcement Learning
0
Sign in to get full access
Overview
- This paper explores using multi-agent reinforcement learning to discover closure models for coarse-grained partial differential equations.
- Closure models are used to represent the effects of unresolved small-scale processes in coarse-grained simulations.
- The authors propose a multi-agent approach where each agent learns a closure model for a specific subregion of the domain.
Plain English Explanation
Partial differential equations (PDEs) are mathematical models used to describe a wide range of physical phenomena, from fluid flow to heat transfer. However, directly solving these equations can be computationally expensive, especially for large or complex systems. One way to address this is through coarse-graining, where the equations are simplified by averaging over small-scale details.
This simplification introduces uncertainty, as the effects of the unresolved small-scale processes need to be accounted for. This is where closure models come into play. Closure models are mathematical expressions that represent the impact of these unresolved processes on the coarse-grained simulation. Developing accurate closure models is a significant challenge in computational science.
In this paper, the authors propose using multi-agent reinforcement learning to discover closure models for coarse-grained PDEs. The key idea is to have multiple "agents" (AI-powered decision-makers) work together to learn the optimal closure model for their respective subregions of the simulation domain. By dividing the problem in this way, the agents can focus on learning the local interactions and patterns that contribute to the overall closure model.
Technical Explanation
The authors present a multi-agent reinforcement learning framework for discovering closure models for coarse-grained PDEs. The core idea is to have multiple agents, each responsible for learning a closure model for a specific subregion of the simulation domain.
Each agent observes the coarse-grained state of its subregion and the neighboring subregions, as well as the true fine-grained state (which is assumed to be available for training). The agents then use reinforcement learning to learn a closure model that minimizes the error between the coarse-grained simulation with the closure model and the true fine-grained simulation.
The authors test their approach on two example PDE systems: the Burgers' equation and the Gray-Scott reaction-diffusion system. They show that the multi-agent approach outperforms a single-agent baseline, as the local agents are able to capture the nuanced interactions within their subregions more effectively.
Critical Analysis
The authors acknowledge several limitations of their approach. First, the method relies on the availability of fine-grained simulation data, which may not be practical for many real-world applications. Additionally, the agents are trained independently, which may lead to suboptimal global closure models due to a lack of coordination.
Another potential issue is the scalability of the approach as the problem size grows. With more subregions, the number of agents and the complexity of their interactions will increase, which could make the training process more challenging.
The authors also note that their approach assumes the subregions are predetermined and fixed, which may not always be the case. Developing a more flexible framework that can adaptively partition the domain could be an area for future research.
Conclusion
This paper presents a novel approach to discovering closure models for coarse-grained PDEs using multi-agent reinforcement learning. By dividing the problem into subregions and having each agent learn a local closure model, the authors demonstrate improved performance compared to a single-agent baseline.
While the method has some limitations, the key insight of leveraging multiple agents to capture the nuanced local interactions in a complex system is a promising direction for further research in computational science and PDE control. The work also contributes to the broader field of automating the discovery of PDEs and dynamical systems using machine learning techniques.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
0
Closure Discovery for Coarse-Grained Partial Differential Equations Using Grid-based Reinforcement Learning
Jan-Philipp von Bassewitz, Sebastian Kaltenbach, Petros Koumoutsakos
Reliable predictions of critical phenomena, such as weather, wildfires and epidemics often rely on models described by Partial Differential Equations (PDEs). However, simulations that capture the full range of spatio-temporal scales described by such PDEs are often prohibitively expensive. Consequently, coarse-grained simulations are usually deployed that adopt various heuristics and empirical closure terms to account for the missing information. We propose a novel and systematic approach for identifying closures in under-resolved PDEs using grid-based Reinforcement Learning. This formulation incorporates inductive bias and exploits locality by deploying a central policy represented efficiently by a Fully Convolutional Network (FCN). We demonstrate the capabilities and limitations of our framework through numerical solutions of the advection equation and the Burgers' equation. Our results show accurate predictions for in- and out-of-distribution test cases as well as a significant speedup compared to resolving all scales.
Read more5/24/2024
đź“Š
0
Physics-constrained robust learning of open-form partial differential equations from limited and noisy data
Mengge Du, Yuntian Chen, Longfeng Nie, Siyu Lou, Dongxiao Zhang
Unveiling the underlying governing equations of nonlinear dynamic systems remains a significant challenge. Insufficient prior knowledge hinders the determination of an accurate candidate library, while noisy observations lead to imprecise evaluations, which in turn result in redundant function terms or erroneous equations. This study proposes a framework to robustly uncover open-form partial differential equations (PDEs) from limited and noisy data. The framework operates through two alternating update processes: discovering and embedding. The discovering phase employs symbolic representation and a novel reinforcement learning (RL)-guided hybrid PDE generator to efficiently produce diverse open-form PDEs with tree structures. A neural network-based predictive model fits the system response and serves as the reward evaluator for the generated PDEs. PDEs with higher rewards are utilized to iteratively optimize the generator via the RL strategy and the best-performing PDE is selected by a parameter-free stability metric. The embedding phase integrates the initially identified PDE from the discovering process as a physical constraint into the predictive model for robust training. The traversal of PDE trees automates the construction of the computational graph and the embedding process without human intervention. Numerical experiments demonstrate our framework's capability to uncover governing equations from nonlinear dynamic systems with limited and highly noisy data and outperform other physics-informed neural network-based discovery methods. This work opens new potential for exploring real-world systems with limited understanding.
Read more4/30/2024
🎲
0
Learning Closed-form Equations for Subgrid-scale Closures from High-fidelity Data: Promises and Challenges
Karan Jakhar, Yifei Guan, Rambod Mojgani, Ashesh Chattopadhyay, Pedram Hassanzadeh
There is growing interest in discovering interpretable, closed-form equations for subgrid-scale (SGS) closures/parameterizations of complex processes in Earth systems. Here, we apply a common equation-discovery technique with expansive libraries to learn closures from filtered direct numerical simulations of 2D turbulence and Rayleigh-B'enard convection (RBC). Across common filters (e.g., Gaussian, box), we robustly discover closures of the same form for momentum and heat fluxes. These closures depend on nonlinear combinations of gradients of filtered variables, with constants that are independent of the fluid/flow properties and only depend on filter type/size. We show that these closures are the nonlinear gradient model (NGM), which is derivable analytically using Taylor-series. Indeed, we suggest that with common (physics-free) equation-discovery algorithms, for many common systems/physics, discovered closures are consistent with the leading term of the Taylor-series (except when cutoff filters are used). Like previous studies, we find that large-eddy simulations with NGM closures are unstable, despite significant similarities between the true and NGM-predicted fluxes (correlations $> 0.95$). We identify two shortcomings as reasons for these instabilities: in 2D, NGM produces zero kinetic energy transfer between resolved and subgrid scales, lacking both diffusion and backscattering. In RBC, potential energy backscattering is poorly predicted. Moreover, we show that SGS fluxes diagnosed from data, presumed the ''truth'' for discovery, depend on filtering procedures and are not unique. Accordingly, to learn accurate, stable closures in future work, we propose several ideas around using physics-informed libraries, loss functions, and metrics. These findings are relevant to closure modeling of any multi-scale system.
Read more7/9/2024
0
Beyond Closure Models: Learning Chaotic-Systems via Physics-Informed Neural Operators
Chuwei Wang, Julius Berner, Zongyi Li, Di Zhou, Jiayun Wang, Jane Bae, Anima Anandkumar
Accurately predicting the long-term behavior of chaotic systems is crucial for various applications such as climate modeling. However, achieving such predictions typically requires iterative computations over a dense spatiotemporal grid to account for the unstable nature of chaotic systems, which is expensive and impractical in many real-world situations. An alternative approach to such a full-resolved simulation is using a coarse grid and then correcting its errors through a textit{closure model}, which approximates the overall information from fine scales not captured in the coarse-grid simulation. Recently, ML approaches have been used for closure modeling, but they typically require a large number of training samples from expensive fully-resolved simulations (FRS). In this work, we prove an even more fundamental limitation, i.e., the standard approach to learning closure models suffers from a large approximation error for generic problems, no matter how large the model is, and it stems from the non-uniqueness of the mapping. We propose an alternative end-to-end learning approach using a physics-informed neural operator (PINO) that overcomes this limitation by not using a closure model or a coarse-grid solver. We first train the PINO model on data from a coarse-grid solver and then fine-tune it with (a small amount of) FRS and physics-based losses on a fine grid. The discretization-free nature of neural operators means that they do not suffer from the restriction of a coarse grid that closure models face, and they can provably approximate the long-term statistics of chaotic systems. In our experiments, our PINO model achieves a 120x speedup compared to FRS with a relative error $sim 5%$. In contrast, the closure model coupled with a coarse-grid solver is $58$x slower than PINO while having a much higher error $sim205%$ when the closure model is trained on the same FRS dataset.
Read more8/12/2024