A Latent Variable Approach for Non-Hierarchical Multi-Fidelity Adaptive Sampling

Abstract

Multi-fidelity (MF) methods are gaining popularity for enhancing surrogate modeling and design optimization by incorporating data from various low-fidelity (LF) models. While most existing MF methods assume a fixed dataset, adaptive sampling methods that dynamically allocate resources among fidelity models can achieve higher efficiency in the exploring and exploiting the design space. However, most existing MF methods rely on the hierarchical assumption of fidelity levels or fail to capture the intercorrelation between multiple fidelity levels and utilize it to quantify the value of the future samples and navigate the adaptive sampling. To address this hurdle, we propose a framework hinged on a latent embedding for different fidelity models and the associated pre-posterior analysis to explicitly utilize their correlation for adaptive sampling. In this framework, each infill sampling iteration includes two steps: We first identify the location of interest with the greatest potential improvement using the high-fidelity (HF) model, then we search for the next sample across all fidelity levels that maximize the improvement per unit cost at the location identified in the first step. This is made possible by a single Latent Variable Gaussian Process (LVGP) model that maps different fidelity models into an interpretable latent space to capture their correlations without assuming hierarchical fidelity levels. The LVGP enables us to assess how LF sampling candidates will affect HF response with pre-posterior analysis and determine the next sample with the best benefit-to-cost ratio. Through test cases, we demonstrate that the proposed method outperforms the benchmark methods in both MF global fitting (GF) and Bayesian Optimization (BO) problems in convergence rate and robustness. Moreover, the method offers the flexibility to switch between GF and BO by simply changing the acquisition function.

References in corpus (17)

• A Tutorial on Bayesian Optimization of Expensive Cost Functions, with Application to Active User Modeling and Hierarchical Reinforcement Learning
• Predictive Entropy Search for Efficient Global Optimization of Black-box Functions
• Transfer learning based multi-fidelity physics informed deep neural network
• Multi-fidelity Bayesian Neural Networks: Algorithms and Applications
• Multi-fidelity Bayesian Optimisation with Continuous Approximations
• Multi-fidelity surrogate modeling using long short-term memory networks
• Multi-Fidelity Cost-Aware Bayesian Optimization
• A General Framework for Multi-fidelity Bayesian Optimization with Gaussian Processes
• Deep Gaussian Processes for Multi-fidelity Modeling
• Digital Twins for the Designs of Systems: a Perspective
• A DeepONet multi-fidelity approach for residual learning in reduced order modeling
• Multi-Fidelity Bayesian Optimization via Deep Neural Networks
• Deep Multi-Fidelity Active Learning of High-dimensional Outputs
• Multi-Fidelity High-Order Gaussian Processes for Physical Simulation
• CAMERA: A Method for Cost-aware, Adaptive, Multifidelity, Efficient Reliability Analysis
• Disentangled Multi-Fidelity Deep Bayesian Active Learning
• General multi-fidelity surrogate models: Framework and active learning strategies for efficient rare event simulation

Cited by in corpus (3)

• Real-Time Decision-Making for Digital Twin in Additive Manufacturing with Model Predictive Control using Time-Series Deep Neural Networks
• Uncertainty-Aware Digital Twins: Robust Model Predictive Control using Time-Series Deep Quantile Learning
• Emerging Microelectronic Materials by Design: Navigating Combinatorial Design Space with Scarce and Dispersed Data