Multi-fidelity surrogate modeling using long short-term memory networks

Abstract

When evaluating quantities of interest that depend on the solutions to differential equations, we inevitably face the trade-off between accuracy and efficiency. Especially for parametrized, time dependent problems in engineering computations, it is often the case that acceptable computational budgets limit the availability of high-fidelity, accurate simulation data. Multi-fidelity surrogate modeling has emerged as an effective strategy to overcome this difficulty. Its key idea is to leverage many low-fidelity simulation data, less accurate but much faster to compute, to improve the approximations with limited high-fidelity data. In this work, we introduce a novel data-driven framework of multi-fidelity surrogate modeling for parametrized, time-dependent problems using long short-term memory (LSTM) networks, to enhance output predictions both for unseen parameter values and forward in time simultaneously - a task known to be particularly challenging for data-driven models. We demonstrate the wide applicability of the proposed approaches in a variety of engineering problems with high- and low-fidelity data generated through fine versus coarse meshes, small versus large time steps, or finite element full-order versus deep learning reduced-order models. Numerical results show that the proposed multi-fidelity LSTM networks not only improve single-fidelity regression significantly, but also outperform the multi-fidelity models based on feed-forward neural networks.

References in corpus (2)

• Multi-Fidelity Recursive Behavior Prediction
• A brief note on understanding neural networks as Gaussian processes

Cited by in corpus (12)

• Reduced order modeling of parametrized systems through autoencoders and SINDy approach: continuation of periodic solutions
• A multi-fidelity deep operator network (DeepONet) for fusing simulation and monitoring data: Application to real-time settlement prediction during tunnel construction
• An unsupervised latent/output physics-informed convolutional-LSTM network for solving partial differential equations using peridynamic differential operator
• Multi-fidelity physics constrained neural networks for dynamical systems
• Multi-Physics Model Bias Correction with Data-Driven Reduced Order Modelling Techniques: Application to Nuclear Case Studies
• A Latent Variable Approach for Non-Hierarchical Multi-Fidelity Adaptive Sampling
• Surrogate modelling and uncertainty quantification based on multi-fidelity deep neural network
• Neural Ordinary Differential Equations for Model Order Reduction of Stiff Systems
• Enhancing Bayesian model updating in structural health monitoring via learnable mappings
• Residual Multi-Fidelity Neural Network Computing
• Single- to multi-fidelity history-dependent learning with uncertainty quantification and disentanglement: application to data-driven constitutive modeling
• Projection-based multifidelity linear regression for data-scarce applications