Improved generalization with deep neural operators for engineering systems: Path towards digital twin

Abstract

Neural Operator Networks (ONets) represent a novel advancement in machine learning algorithms, offering a robust and generalizable alternative for approximating partial differential equations (PDEs) solutions. Unlike traditional Neural Networks (NN), which directly approximate functions, ONets specialize in approximating mathematical operators, enhancing their efficacy in addressing complex PDEs. In this work, we evaluate the capabilities of Deep Operator Networks (DeepONets), an ONets implementation using a branch/trunk architecture. Three test cases are studied: a system of ODEs, a general diffusion system, and the convection/diffusion Burgers equation. It is demonstrated that DeepONets can accurately learn the solution operators, achieving prediction accuracy scores above 0.96 for the ODE and diffusion problems over the observed domain while achieving zero shot (without retraining) capability. More importantly, when evaluated on unseen scenarios (zero shot feature), the trained models exhibit excellent generalization ability. This underscores ONets vital niche for surrogate modeling and digital twin development across physical systems. While convection-diffusion poses a greater challenge, the results confirm the promise of ONets and motivate further enhancements to the DeepONet algorithm. This work represents an important step towards unlocking the potential of digital twins through robust and generalizable surrogates.

References in corpus (10)

• Deep Learning in Neural Networks: An Overview
• Explainable, Interpretable & Trustworthy AI for Intelligent Digital Twin: Case Study on Remaining Useful Life
• Operator learning for predicting multiscale bubble growth dynamics
• Reliable extrapolation of deep neural operators informed by physics or sparse observations
• Learning Deep Implicit Fourier Neural Operators (IFNOs) with Applications to Heterogeneous Material Modeling
• Wavelet neural operator: a neural operator for parametric partial differential equations
• Multi-fidelity wavelet neural operator with application to uncertainty quantification
• Assessment of DeepONet for reliability analysis of stochastic nonlinear dynamical systems
• Digital Twin-Centered Hybrid Data-Driven Multi-Stage Deep Learning Framework for Enhanced Nuclear Reactor Power Prediction
• Structure and Distribution Metric for Quantifying the Quality of Uncertainty: Assessing Gaussian Processes, Deep Neural Nets, and Deep Neural Operators for Regression

Cited by in corpus (7)

• Separable DeepONet: Breaking the Curse of Dimensionality in Physics-Informed Machine Learning
• Deep Neural Operator Driven Real Time Inference for Nuclear Systems to Enable Digital Twin Solutions
• AI-driven non-intrusive uncertainty quantification of advanced nuclear fuels for digital twin-enabling technology
• An Advanced Physics-Informed Neural Operator for Comprehensive Design Optimization of Highly-Nonlinear Systems: An Aerospace Composites Processing Case Study
• Predictions of Transient Vector Solution Fields with Sequential Deep Operator Network
• Physics-informed Partitioned Coupled Neural Operator for Complex Networks
• Physics-Informed Time-Integrated DeepONet: Temporal Tangent Space Operator Learning for High-Accuracy Inference