Alpha-VI DeepONet: A prior-robust variational Bayesian approach for enhancing DeepONets with uncertainty quantification

Abstract

We introduce a novel deep operator network (DeepONet) framework that incorporates generalised variational inference (GVI) using Rényi's $\alpha$-divergence to learn complex operators while quantifying uncertainty. By incorporating Bayesian neural networks as the building blocks for the branch and trunk networks, our framework endows DeepONet with uncertainty quantification. The use of Rényi's $\alpha$-divergence, instead of the Kullback-Leibler divergence (KLD), commonly used in standard variational inference, mitigates issues related to prior misspecification that are prevalent in Variational Bayesian DeepONets. This approach offers enhanced flexibility and robustness. We demonstrate that modifying the variational objective function yields superior results in terms of minimising the mean squared error and improving the negative log-likelihood on the test set. Our framework's efficacy is validated across various mechanical systems, where it outperforms both deterministic and standard KLD-based VI DeepONets in predictive accuracy and uncertainty quantification. The hyperparameter $\alpha$, which controls the degree of robustness, can be tuned to optimise performance for specific problems. We apply this approach to a range of mechanics problems, including gravity pendulum, advection-diffusion, and diffusion-reaction systems. Our findings underscore the potential of $\alpha$-VI DeepONet to advance the field of data-driven operator learning and its applications in engineering and scientific domains.

References in corpus (9)

• Variational Inference: A Review for Statisticians
• DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operators
• Uncertainty Quantification in Scientific Machine Learning: Methods, Metrics, and Comparisons
• A physics-informed variational DeepONet for predicting the crack path in brittle materials
• DeepM&Mnet: Inferring the electroconvection multiphysics fields based on operator approximation by neural networks
• Novel DeepONet architecture to predict stresses in elastoplastic structures with variable complex geometries and loads
• A multi-fidelity deep operator network (DeepONet) for fusing simulation and monitoring data: Application to real-time settlement prediction during tunnel construction
• Scalable Uncertainty Quantification for Deep Operator Networks using Randomized Priors
• A DeepONet multi-fidelity approach for residual learning in reduced order modeling