Deep NURBS -- Admissible Physics-informed Neural Networks

Read original: arXiv:2210.13900 - Published 7/30/2024 by Hamed Saidaoui, Luis Espath, R'aul Tempone
Total Score

0

🤿

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • Proposes a new numerical scheme for physics-informed neural networks (PINNs) to solve partial differential equations (PDEs) in arbitrary geometries
  • Combines NURBS parametrizations to define the physical domain and Dirichlet boundary conditions with a PINN solver
  • Ensures fundamental boundary conditions are automatically satisfied in this "Deep NURBS" framework
  • Verified the approach using 2D elliptic PDEs, including non-Lipschitz domains
  • Demonstrates significantly faster convergence compared to classical PINN solvers
  • Achieves high accuracy with only one hidden layer of neural networks
  • Aims to enable more effective solutions for high-dimensional PDE problems

Plain English Explanation

The researchers have developed a new way to use physics-informed neural networks (PINNs) to solve partial differential equations (PDEs) - mathematical equations that describe physical phenomena. Their approach combines a technique called NURBS (non-uniform rational B-splines) to define the physical domain and boundary conditions, with the PINN solver.

This "Deep NURBS" framework automatically satisfies the fundamental boundary conditions - the rules that describe how the solution to the PDE must behave at the edges of the physical domain. The researchers tested their method on 2D elliptic PDEs, including some with complex, non-smooth shapes (non-Lipschitz domains).

Compared to the standard PINN approach, the Deep NURBS method converges much faster - it can achieve high accuracy using only a single hidden layer of neurons in the neural network. This is a significant improvement, as it means the method can solve PDE problems more efficiently, especially for high-dimensional problems where the complexity of the neural network can become a bottleneck.

The researchers believe this new approach is an important step towards solving more realistic, physics-based problems using machine learning techniques like PINNs. By better accounting for the physical constraints and geometry of the problem, the Deep NURBS framework allows for more accurate and computationally efficient solutions.

Technical Explanation

The researchers propose a new numerical scheme for physics-informed neural networks (PINNs) that enables precise and inexpensive solutions for partial differential equations (PDEs) in arbitrary geometries while strictly enforcing Dirichlet boundary conditions.

The key innovation is the combination of NURBS parametrizations to define the physical domain and Dirichlet boundary conditions, with a PINN solver. This "Deep NURBS" framework automatically satisfies the fundamental boundary conditions, addressing a limitation of classical PINN solvers.

The researchers verified their approach using two-dimensional elliptic PDEs, including non-Lipschitz domains (i.e., domains with non-smooth boundaries). Compared to the standard PINN solver, the Deep NURBS estimator demonstrated a remarkably high convergence rate for all the studied problems. Moreover, they were able to achieve desirable accuracy for most of the PDEs using only a single hidden layer of neural networks, which is a significant improvement in efficiency.

Critical Analysis

The paper presents a novel and promising approach for solving PDE problems using PINNs, particularly for cases with complex geometries. The key strength is the integration of NURBS parametrizations, which allows the method to automatically satisfy the fundamental boundary conditions - a crucial aspect for obtaining accurate solutions.

One potential limitation is the focus on 2D elliptic PDEs in this study. While the results are compelling, it would be important to evaluate the performance of the Deep NURBS framework on higher-dimensional problems and a wider range of PDE types to fully assess its capabilities and limitations.

Additionally, the paper does not provide a detailed comparison to other state-of-the-art methods for solving PDEs in complex geometries, such as the physics-informed boundary integral networks (PIBI-Nets) or the Newton-informed neural operator approaches. A more comprehensive benchmarking against these and other relevant techniques would help contextualize the contributions of the Deep NURBS framework.

Overall, this research represents an important step towards more effective solutions for high-dimensional PDE problems using physics-informed statistical learning. Further exploration and comparison to other cutting-edge methods could help solidify the advantages and limitations of the proposed approach.

Conclusion

The researchers have developed a new numerical scheme for physics-informed neural networks (PINNs) that combines NURBS parametrizations and a PINN solver to enable precise and efficient solutions for partial differential equations (PDEs) in arbitrary geometries. This "Deep NURBS" framework automatically satisfies the fundamental boundary conditions, addressing a key limitation of classical PINN solvers.

The results demonstrate significantly faster convergence and high accuracy using only a single hidden layer of neural networks, even for PDEs with non-smooth boundaries. This promising approach represents an important step towards more effective solutions for high-dimensional PDE problems, potentially enabling more realistic physics-informed statistical learning to solve these complex variational problems.

Further research is needed to evaluate the Deep NURBS framework on a wider range of PDE types and higher-dimensional problems, as well as to compare its performance to other state-of-the-art methods for solving PDEs in complex geometries. Nonetheless, this work contributes valuable insights and lays the groundwork for more advanced physics-informed machine learning techniques to tackle challenging PDE-based problems.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

🤿

Total Score

0

Deep NURBS -- Admissible Physics-informed Neural Networks

Hamed Saidaoui, Luis Espath, R'aul Tempone

In this study, we propose a new numerical scheme for physics-informed neural networks (PINNs) that enables precise and inexpensive solution for partial differential equations (PDEs) in case of arbitrary geometries while strictly enforcing Dirichlet boundary conditions. The proposed approach combines admissible NURBS parametrizations required to define the physical domain and the Dirichlet boundary conditions with a PINN solver. The fundamental boundary conditions are automatically satisfied in this novel Deep NURBS framework. We verified our new approach using two-dimensional elliptic PDEs when considering arbitrary geometries, including non-Lipschitz domains. Compared to the classical PINN solver, the Deep NURBS estimator has a remarkably high convergence rate for all the studied problems. Moreover, a desirable accuracy was realized for most of the studied PDEs using only one hidden layer of neural networks. This novel approach is considered to pave the way for more effective solutions for high-dimensional problems by allowing for more realistic physics-informed statistical learning to solve PDE-based variational problems.

Read more

7/30/2024

Parameterized Physics-informed Neural Networks for Parameterized PDEs
Total Score

0

Parameterized Physics-informed Neural Networks for Parameterized PDEs

Woojin Cho, Minju Jo, Haksoo Lim, Kookjin Lee, Dongeun Lee, Sanghyun Hong, Noseong Park

Complex physical systems are often described by partial differential equations (PDEs) that depend on parameters such as the Reynolds number in fluid mechanics. In applications such as design optimization or uncertainty quantification, solutions of those PDEs need to be evaluated at numerous points in the parameter space. While physics-informed neural networks (PINNs) have emerged as a new strong competitor as a surrogate, their usage in this scenario remains underexplored due to the inherent need for repetitive and time-consuming training. In this paper, we address this problem by proposing a novel extension, parameterized physics-informed neural networks (P$^2$INNs). P$^2$INNs enable modeling the solutions of parameterized PDEs via explicitly encoding a latent representation of PDE parameters. With the extensive empirical evaluation, we demonstrate that P$^2$INNs outperform the baselines both in accuracy and parameter efficiency on benchmark 1D and 2D parameterized PDEs and are also effective in overcoming the known failure modes.

Read more

8/20/2024

A Physics Informed Neural Network (PINN) Methodology for Coupled Moving Boundary PDEs
Total Score

0

New!A Physics Informed Neural Network (PINN) Methodology for Coupled Moving Boundary PDEs

Shivprasad Kathane (Indian Institute of Technology Bombay Mumbai India), Shyamprasad Karagadde (Indian Institute of Technology Bombay Mumbai India)

Physics-Informed Neural Network (PINN) is a novel multi-task learning framework useful for solving physical problems modeled using differential equations (DEs) by integrating the knowledge of physics and known constraints into the components of deep learning. A large class of physical problems in materials science and mechanics involve moving boundaries, where interface flux balance conditions are to be satisfied while solving DEs. Examples of such systems include free surface flows, shock propagation, solidification of pure and alloy systems etc. While recent research works have explored applicability of PINNs for an uncoupled system (such as solidification of pure system), the present work reports a PINN-based approach to solve coupled systems involving multiple governing parameters (energy and species, along with multiple interface balance equations). This methodology employs an architecture consisting of a separate network for each variable with a separate treatment of each phase, a training strategy which alternates between temporal learning and adaptive loss weighting, and a scheme which progressively reduces the optimisation space. While solving the benchmark problem of binary alloy solidification, it is distinctly successful at capturing the complex composition profile, which has a characteristic discontinuity at the interface and the resulting predictions align well with the analytical solutions. The procedure can be generalised for solving other transient multiphysics problems especially in the low-data regime and in cases where measurements can reveal new physics.

Read more

9/18/2024

⛏️

Total Score

0

Physics-Informed Boundary Integral Networks (PIBI-Nets): A Data-Driven Approach for Solving Partial Differential Equations

Monika Nagy-Huber, Volker Roth

Partial differential equations (PDEs) are widely used to describe relevant phenomena in dynamical systems. In real-world applications, we commonly need to combine formal PDE models with (potentially noisy) observations. This is especially relevant in settings where we lack information about boundary or initial conditions, or where we need to identify unknown model parameters. In recent years, Physics-Informed Neural Networks (PINNs) have become a popular tool for this kind of problems. In high-dimensional settings, however, PINNs often suffer from computational problems because they usually require dense collocation points over the entire computational domain. To address this problem, we present Physics-Informed Boundary Integral Networks (PIBI-Nets) as a data-driven approach for solving PDEs in one dimension less than the original problem space. PIBI-Nets only require points at the computational domain boundary, while still achieving highly accurate results. Moreover, PIBI-Nets clearly outperform PINNs in several practical settings. Exploiting elementary properties of fundamental solutions of linear differential operators, we present a principled and simple way to handle point sources in inverse problems. We demonstrate the excellent performance of PIBI- Nets for the Laplace and Poisson equations, both on artificial datasets and within a real-world application concerning the reconstruction of groundwater flows.

Read more

7/8/2024