Uncertainty Quantification in Multivariable Regression for Material Property Prediction with Bayesian Neural Networks

Abstract

With the increased use of data-driven approaches and machine learning-based methods in material science, the importance of reliable uncertainty quantification (UQ) of the predicted variables for informed decision-making cannot be overstated. UQ in material property prediction poses unique challenges, including the multi-scale and multi-physics nature of advanced materials, intricate interactions between numerous factors, limited availability of large curated datasets for model training, etc. Recently, Bayesian Neural Networks (BNNs) have emerged as a promising approach for UQ, offering a probabilistic framework for capturing uncertainties within neural networks. In this work, we introduce an approach for UQ within physics-informed BNNs, which integrates knowledge from governing laws in material modeling to guide the models toward physically consistent predictions. To evaluate the effectiveness of this approach, we present case studies for predicting the creep rupture life of steel alloys. Experimental validation with three datasets of collected measurements from creep tests demonstrates the ability of BNNs to produce accurate point and uncertainty estimates that are competitive or exceed the performance of the conventional method of Gaussian Process Regression. Similarly, we evaluated the suitability of BNNs for UQ in an active learning application and reported competitive performance. The most promising framework for creep life prediction is BNNs based on Markov Chain Monte Carlo approximation of the posterior distribution of network parameters, as it provided more reliable results in comparison to BNNs based on variational inference approximation or related NNs with probabilistic outputs. The codes are available at: https://github.com/avakanski/Creep-uncertainty-quantification.

arXiv comment24 pages, 4 figures

References in corpus (9)

• A Review of Uncertainty Quantification in Deep Learning: Techniques, Applications and Challenges
• Artificial Neural Networks for Solving Ordinary and Partial Differential Equations
• Ensemble deep learning: A review
• Recent Advances and Applications of Deep Learning Methods in Materials Science
• B-PINNs: Bayesian Physics-Informed Neural Networks for Forward and Inverse PDE Problems with Noisy Data
• Pyro: Deep Universal Probabilistic Programming
• Scalable Bayesian Optimization Using Deep Neural Networks
• A Variance Maximization Criterion for Active Learning
• Adaptive weighting of Bayesian physics informed neural networks for multitask and multiscale forward and inverse problems

Cited by in corpus (2)

• Review of Machine Learning Methods for Additive Manufacturing of Functionally Graded Materials
• Machine Learning-based Correlation of Charpy Impact Properties Between Sub-sized and Standard-sized Specimens for Nuclear Structural Materials