Physics-Informed Neural Network based inverse framework for time-fractional differential equations for rheology
0
Sign in to get full access
Overview
- This paper presents a Physics-Informed Neural Network (PINN) based inverse framework for solving time-fractional differential equations in the field of rheology.
- Time-fractional differential equations are used to model complex viscoelastic materials, but solving these equations can be challenging.
- The proposed PINN-based approach aims to overcome the limitations of traditional methods and provide a robust and efficient way to solve these inverse problems.
Plain English Explanation
Time-fractional differential equations are a type of mathematical model used to study the behavior of complex materials like gels, polymers, and biological tissues. These materials often exhibit both solid-like and liquid-like properties, which can be difficult to capture using traditional models.
The Physics-Informed Neural Network (PINN) approach proposed in this paper provides a new way to solve these time-fractional differential equations. PINNs are a type of machine learning model that can incorporate the underlying physics of a problem directly into the neural network architecture.
In this case, the authors use a PINN to solve the inverse problem - that is, they want to determine the underlying parameters of the time-fractional differential equation based on observed data. This is important in rheology, where researchers often need to infer the properties of complex materials from experimental measurements.
The key advantage of the PINN-based approach is that it can handle the curse of dimensionality that can arise when solving these high-dimensional, fractional-order differential equations. By leveraging the randomized and Bayesian techniques built into the PINN framework, the authors demonstrate improved accuracy and efficiency compared to traditional methods.
Technical Explanation
The authors formulate the inverse problem of determining the parameters of a time-fractional differential equation model for rheological materials as an optimization problem. They then propose a PINN-based approach to solve this optimization problem.
The key components of the PINN architecture include:
- An input layer that takes in the independent variables (e.g., time, spatial coordinates) and the observed data.
- Hidden layers that use a physics-informed loss function to ensure the neural network satisfies the underlying time-fractional differential equation.
- An output layer that predicts the parameter values of the differential equation.
The authors employ efficient error certification techniques to monitor the training process and ensure the PINN converges to the optimal solution.
Through numerical experiments on benchmark rheological problems, the authors demonstrate that their PINN-based inverse framework outperforms traditional methods in terms of accuracy, robustness, and computational efficiency.
Critical Analysis
The authors acknowledge several limitations of their approach, including the need for high-quality training data and the potential for overfitting in high-dimensional problems. They also note that the choice of hyperparameters, such as the neural network architecture and the physics-informed loss function, can significantly impact the performance of the PINN.
One potential area for further research is the extension of the PINN framework to handle more complex rheological models, such as those involving multiple fractional derivatives or nonlinear constitutive relationships. Additionally, the authors could explore the integration of uncertainty quantification techniques to provide more robust and reliable parameter estimates.
Conclusion
This paper presents a novel PINN-based inverse framework for solving time-fractional differential equations in the field of rheology. The proposed approach demonstrates improved accuracy, robustness, and computational efficiency compared to traditional methods, making it a promising tool for researchers and engineers working with complex viscoelastic materials. While the method has some limitations, the authors have laid the groundwork for further advancements in this area of research.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
0
Physics-Informed Neural Network based inverse framework for time-fractional differential equations for rheology
Sukirt Thakur, Harsa Mitra, Arezoo M. Ardekani
Time-fractional differential equations offer a robust framework for capturing intricate phenomena characterized by memory effects, particularly in fields like biotransport and rheology. However, solving inverse problems involving fractional derivatives presents notable challenges, including issues related to stability and uniqueness. While Physics-Informed Neural Networks (PINNs) have emerged as effective tools for solving inverse problems, most existing PINN frameworks primarily focus on integer-ordered derivatives. In this study, we extend the application of PINNs to address inverse problems involving time-fractional derivatives, specifically targeting two problems: 1) anomalous diffusion and 2) fractional viscoelastic constitutive equation. Leveraging both numerically generated datasets and experimental data, we calibrate the concentration-dependent generalized diffusion coefficient and parameters for the fractional Maxwell model. We devise a tailored residual loss function that scales with the standard deviation of observed data. We rigorously test our framework's efficacy in handling anomalous diffusion. Even after introducing 25% Gaussian noise to the concentration dataset, our framework demonstrates remarkable robustness. Notably, the relative error in predicting the generalized diffusion coefficient and the order of the fractional derivative is less than 10% for all cases, underscoring the resilience and accuracy of our approach. In another test case, we predict relaxation moduli for three pig tissue samples, consistently achieving relative errors below 10%. Furthermore, our framework exhibits promise in modeling anomalous diffusion and non-linear fractional viscoelasticity.
Read more7/16/2024
0
Data-Guided Physics-Informed Neural Networks for Solving Inverse Problems in Partial Differential Equations
Wei Zhou, Y. F. Xu
Physics-informed neural networks (PINNs) represent a significant advancement in scientific machine learning by integrating fundamental physical laws into their architecture through loss functions. PINNs have been successfully applied to solve various forward and inverse problems in partial differential equations (PDEs). However, a notable challenge can emerge during the early training stages when solving inverse problems. Specifically, data losses remain high while PDE residual losses are minimized rapidly, thereby exacerbating the imbalance between loss terms and impeding the overall efficiency of PINNs. To address this challenge, this study proposes a novel framework termed data-guided physics-informed neural networks (DG-PINNs). The DG-PINNs framework is structured into two distinct phases: a pre-training phase and a fine-tuning phase. In the pre-training phase, a loss function with only the data loss is minimized in a neural network. In the fine-tuning phase, a composite loss function, which consists of the data loss, PDE residual loss, and, if available, initial and boundary condition losses, is minimized in the same neural network. Notably, the pre-training phase ensures that the data loss is already at a low value before the fine-tuning phase commences. This approach enables the fine-tuning phase to converge to a minimal composite loss function with fewer iterations compared to existing PINNs. To validate the effectiveness, noise-robustness, and efficiency of DG-PINNs, extensive numerical investigations are conducted on inverse problems related to several classical PDEs, including the heat equation, wave equation, Euler--Bernoulli beam equation, and Navier--Stokes equation. The numerical results demonstrate that DG-PINNs can accurately solve these inverse problems and exhibit robustness against noise in training data.
Read more7/16/2024
📉
0
Tackling the Curse of Dimensionality in Fractional and Tempered Fractional PDEs with Physics-Informed Neural Networks
Zheyuan Hu, Kenji Kawaguchi, Zhongqiang Zhang, George Em Karniadakis
Fractional and tempered fractional partial differential equations (PDEs) are effective models of long-range interactions, anomalous diffusion, and non-local effects. Traditional numerical methods for these problems are mesh-based, thus struggling with the curse of dimensionality (CoD). Physics-informed neural networks (PINNs) offer a promising solution due to their universal approximation, generalization ability, and mesh-free training. In principle, Monte Carlo fractional PINN (MC-fPINN) estimates fractional derivatives using Monte Carlo methods and thus could lift CoD. However, this may cause significant variance and errors, hence affecting convergence; in addition, MC-fPINN is sensitive to hyperparameters. In general, numerical methods and specifically PINNs for tempered fractional PDEs are under-developed. Herein, we extend MC-fPINN to tempered fractional PDEs to address these issues, resulting in the Monte Carlo tempered fractional PINN (MC-tfPINN). To reduce possible high variance and errors from Monte Carlo sampling, we replace the one-dimensional (1D) Monte Carlo with 1D Gaussian quadrature, applicable to both MC-fPINN and MC-tfPINN. We validate our methods on various forward and inverse problems of fractional and tempered fractional PDEs, scaling up to 100,000 dimensions. Our improved MC-fPINN/MC-tfPINN using quadrature consistently outperforms the original versions in accuracy and convergence speed in very high dimensions.
Read more6/18/2024
🧠
0
PINNIES: An Efficient Physics-Informed Neural Network Framework to Integral Operator Problems
Alireza Afzal Aghaei, Mahdi Movahedian Moghaddam, Kourosh Parand
This paper introduces an efficient tensor-vector product technique for the rapid and accurate approximation of integral operators within physics-informed deep learning frameworks. Our approach leverages neural network architectures to evaluate problem dynamics at specific points, while employing Gaussian quadrature formulas to approximate the integral components, even in the presence of infinite domains or singularities. We demonstrate the applicability of this method to both Fredholm and Volterra integral operators, as well as to optimal control problems involving continuous time. Additionally, we outline how this approach can be extended to approximate fractional derivatives and integrals and propose a fast matrix-vector product algorithm for efficiently computing the fractional Caputo derivative. In the numerical section, we conduct comprehensive experiments on forward and inverse problems. For forward problems, we evaluate the performance of our method on over 50 diverse mathematical problems, including multi-dimensional integral equations, systems of integral equations, partial and fractional integro-differential equations, and various optimal control problems in delay, fractional, multi-dimensional, and nonlinear configurations. For inverse problems, we test our approach on several integral equations and fractional integro-differential problems. Finally, we introduce the pinnies Python package to facilitate the implementation and usability of the proposed method.
Read more9/4/2024