Navigating Uncertainties in Machine Learning for Structural Dynamics: A Comprehensive Review of Probabilistic and Non-Probabilistic Approaches in Forward and Inverse Problems
0
🧪
Sign in to get full access
Overview
- In the era of big data, machine learning (ML) has become a powerful tool in various fields, notably impacting structural dynamics.
- ML algorithms offer advantages by modeling physical phenomena based on data, even in the absence of underlying mechanisms.
- Uncertainties such as measurement noise and modeling errors can compromise the reliability of ML predictions, highlighting the need for effective uncertainty awareness to enhance prediction robustness.
Plain English Explanation
With the increasing availability of large datasets, machine learning has become a valuable tool for studying the behavior of structures and systems. These ML algorithms can model complex physical phenomena based on data, even without a complete understanding of the underlying mechanisms. However, real-world uncertainties, such as measurement errors and imperfect modeling, can make the predictions from these ML models less reliable. To address this, researchers have developed techniques to help ML models account for and quantify these uncertainties, improving the robustness and trustworthiness of the predictions.
Technical Explanation
This paper provides a comprehensive review of the approaches used to navigate uncertainties in machine learning for structural dynamics applications. The authors categorize uncertainty-aware methods into two main groups: probabilistic approaches (including Bayesian and frequentist perspectives) and non-probabilistic approaches (such as interval learning and fuzzy learning). Bayesian neural networks, known for their ability to quantify uncertainty and model nonlinear relationships, are highlighted for their superior performance and potential in this domain.
The review covers various techniques and methodologies for addressing uncertainties in ML, discussing the fundamentals and implementation procedures of each method. It examines the strengths and limitations of these approaches, as well as their applications in structural dynamic forward problems (like response prediction, sensitivity assessment, and reliability analysis) and inverse problems (such as system identification, model updating, and damage identification).
Critical Analysis
The paper provides a comprehensive overview of the techniques used to incorporate uncertainty awareness into machine learning models for structural dynamics applications. However, it refrains from providing in-depth critical explanations of the reviewed methods, which may limit the reader's understanding of the nuances and trade-offs between the different approaches.
The authors identify research gaps and suggest future directions for investigations, but do not delve into the potential challenges or limitations of implementing these methods in real-world scenarios. Additionally, the paper does not discuss the computational and resource requirements of the various uncertainty-aware techniques, which could be an important consideration for practitioners.
Conclusion
This review paper offers a broad introduction to the field of uncertainty-aware machine learning in structural dynamics, covering both probabilistic and non-probabilistic approaches. By providing an extensive overview of the available techniques, the authors aim to assist researchers and practitioners in making informed decisions when utilizing ML to address uncertainties in structural dynamic problems. The insights gained from this review can contribute to the development of more robust and reliable ML-based models for applications in structural engineering and beyond.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
🧪
0
Navigating Uncertainties in Machine Learning for Structural Dynamics: A Comprehensive Review of Probabilistic and Non-Probabilistic Approaches in Forward and Inverse Problems
Wang-Ji Yan (State Key Laboratory of Internet of Things for Smart City and Department of Civil and Environmental Engineering, University of Macau, Guangdong-Hong Kong-Macau Joint Laboratory for Smart Cities, China), Lin-Feng Mei (State Key Laboratory of Internet of Things for Smart City and Department of Civil and Environmental Engineering, University of Macau), Jiang Mo (State Key Laboratory of Internet of Things for Smart City and Department of Civil and Environmental Engineering, University of Macau), Costas Papadimitriou (Department of Mechanical Engineering, University of Thessaly), Ka-Veng Yuen (State Key Laboratory of Internet of Things for Smart City and Department of Civil and Environmental Engineering, University of Macau, Guangdong-Hong Kong-Macau Joint Laboratory for Smart Cities, China), Michael Beer (Leibniz University Hannover, Institute for Risk and Reliability, Department of Civil and Environmental Engineering, University of Liverpool, International Joint Research Center for Resilient Infrastructure & International Joint Research Center for Engineering Reliability and Stochastic Mechanics, Tongji University)
In the era of big data, machine learning (ML) has become a powerful tool in various fields, notably impacting structural dynamics. ML algorithms offer advantages by modeling physical phenomena based on data, even in the absence of underlying mechanisms. However, uncertainties such as measurement noise and modeling errors can compromise the reliability of ML predictions, highlighting the need for effective uncertainty awareness to enhance prediction robustness. This paper presents a comprehensive review on navigating uncertainties in ML, categorizing uncertainty-aware approaches into probabilistic methods (including Bayesian and frequentist perspectives) and non-probabilistic methods (such as interval learning and fuzzy learning). Bayesian neural networks, known for their uncertainty quantification and nonlinear mapping capabilities, are emphasized for their superior performance and potential. The review covers various techniques and methodologies for addressing uncertainties in ML, discussing fundamentals and implementation procedures of each method. While providing a concise overview of fundamental concepts, the paper refrains from in-depth critical explanations. Strengths and limitations of each approach are examined, along with their applications in structural dynamic forward problems like response prediction, sensitivity assessment, and reliability analysis, and inverse problems like system identification, model updating, and damage identification. Additionally, the review identifies research gaps and suggests future directions for investigations, aiming to provide comprehensive insights to the research community. By offering an extensive overview of both probabilistic and non-probabilistic approaches, this review aims to assist researchers and practitioners in making informed decisions when utilizing ML techniques to address uncertainties in structural dynamic problems.
Read more8/19/2024
0
Bayesian neural networks for predicting uncertainty in full-field material response
George D. Pasparakis, Lori Graham-Brady, Michael D. Shields
Stress and material deformation field predictions are among the most important tasks in computational mechanics. These predictions are typically made by solving the governing equations of continuum mechanics using finite element analysis, which can become computationally prohibitive considering complex microstructures and material behaviors. Machine learning (ML) methods offer potentially cost effective surrogates for these applications. However, existing ML surrogates are either limited to low-dimensional problems and/or do not provide uncertainty estimates in the predictions. This work proposes an ML surrogate framework for stress field prediction and uncertainty quantification for diverse materials microstructures. A modified Bayesian U-net architecture is employed to provide a data-driven image-to-image mapping from initial microstructure to stress field with prediction (epistemic) uncertainty estimates. The Bayesian posterior distributions for the U-net parameters are estimated using three state-of-the-art inference algorithms: the posterior sampling-based Hamiltonian Monte Carlo method and two variational approaches, the Monte-Carlo Dropout method and the Bayes by Backprop algorithm. A systematic comparison of the predictive accuracy and uncertainty estimates for these methods is performed for a fiber reinforced composite material and polycrystalline microstructure application. It is shown that the proposed methods yield predictions of high accuracy compared to the FEA solution, while uncertainty estimates depend on the inference approach. Generally, the Hamiltonian Monte Carlo and Bayes by Backprop methods provide consistent uncertainty estimates. Uncertainty estimates from Monte Carlo Dropout, on the other hand, are more difficult to interpret and depend strongly on the method's design.
Read more6/24/2024
🤿
0
A Structured Review of Literature on Uncertainty in Machine Learning & Deep Learning
Fahimeh Fakour, Ali Mosleh, Ramin Ramezani
The adaptation and use of Machine Learning (ML) in our daily lives has led to concerns in lack of transparency, privacy, reliability, among others. As a result, we are seeing research in niche areas such as interpretability, causality, bias and fairness, and reliability. In this survey paper, we focus on a critical concern for adaptation of ML in risk-sensitive applications, namely understanding and quantifying uncertainty. Our paper approaches this topic in a structured way, providing a review of the literature in the various facets that uncertainty is enveloped in the ML process. We begin by defining uncertainty and its categories (e.g., aleatoric and epistemic), understanding sources of uncertainty (e.g., data and model), and how uncertainty can be assessed in terms of uncertainty quantification techniques (Ensembles, Bayesian Neural Networks, etc.). As part of our assessment and understanding of uncertainty in the ML realm, we cover metrics for uncertainty quantification for a single sample, dataset, and metrics for accuracy of the uncertainty estimation itself. This is followed by discussions on calibration (model and uncertainty), and decision making under uncertainty. Thus, we provide a more complete treatment of uncertainty: from the sources of uncertainty to the decision-making process. We have focused the review of uncertainty quantification methods on Deep Learning (DL), while providing the necessary background for uncertainty discussion within ML in general. Key contributions in this review are broadening the scope of uncertainty discussion, as well as an updated review of uncertainty quantification methods in DL.
Read more6/4/2024
🔮
0
Physics-Informed Machine Learning for Seismic Response Prediction OF Nonlinear Steel Moment Resisting Frame Structures
R. Bailey Bond, Pu Ren, Jerome F. Hajjar, Hao Sun
There is growing interest in using machine learning (ML) methods for structural metamodeling due to the substantial computational cost of traditional simulations. Purely data-driven strategies often face limitations in model robustness, interpretability, and dependency on extensive data. To address these challenges, this paper introduces a novel physics-informed machine learning (PiML) method that integrates scientific principles and physical laws into deep neural networks to model seismic responses of nonlinear structures. The approach constrains the ML model's solution space within known physical bounds through three main features: dimensionality reduction via combined model order reduction and wavelet analysis, long short-term memory (LSTM) networks, and Newton's second law. Dimensionality reduction addresses structural systems' redundancy and boosts efficiency while extracting essential features through wavelet analysis. LSTM networks capture temporal dependencies for accurate time-series predictions. Manipulating the equation of motion helps learn system nonlinearities and confines solutions within physically interpretable results. These attributes allow for model training with sparse data, enhancing accuracy, interpretability, and robustness. Furthermore, a dataset of archetype steel moment resistant frames under seismic loading, available in the DesignSafe-CI Database [1], is considered for evaluation. The resulting metamodel handles complex data better than existing physics-guided LSTM models and outperforms other non-physics data-driven networks.
Read more4/30/2024