Model fusion with physics-guided machine learning

Abstract

The unprecedented amount of data generated from experiments, field observations, and large-scale numerical simulations at a wide range of spatio-temporal scales have enabled the rapid advancement of data-driven and especially deep learning models in the field of fluid mechanics. Although these methods are proven successful for many applications, there is a grand challenge of improving their generalizability. This is particularly essential when data-driven models are employed within outer-loop applications like optimization. In this work, we put forth a physics-guided machine learning (PGML) framework that leverages the interpretable physics-based model with a deep learning model. The PGML framework is capable of enhancing the generalizability of data-driven models and effectively protect against or inform about the inaccurate predictions resulting from extrapolation. We apply the PGML framework as a novel model fusion approach combining the physics-based Galerkin projection model and long-short term memory (LSTM) network for parametric model order reduction of fluid flows. We demonstrate the improved generalizability of the PGML framework against a purely data-driven approach through the injection of physics features into intermediate LSTM layers. Our quantitative analysis shows that the overall model uncertainty can be reduced through the PGML approach especially for test data coming from a distribution different than the training data. Moreover, we demonstrate that our approach can be used as an inverse diagnostic tool providing a confidence score associated with models and observations. The proposed framework also allows for multi-fidelity computing by making use of low-fidelity models in the online deployment of quantified data-driven models.

References in corpus (22)

• Machine Learning for Fluid Mechanics
• AutoML: A Survey of the State-of-the-Art
• Theory-guided Data Science: A New Paradigm for Scientific Discovery from Data
• Turbulence Modeling in the Age of Data
• Simple and Scalable Predictive Uncertainty Estimation using Deep Ensembles
• Data-Driven Forecasting of High-Dimensional Chaotic Systems with Long Short-Term Memory Networks
• Modeling the Dynamics of PDE Systems with Physics-Constrained Deep Auto-Regressive Networks
• Reduced-order modeling of advection-dominated systems with recurrent neural networks and convolutional autoencoders
• Machine learning based spatio-temporal super resolution reconstruction of turbulent flows
• Towards Automated Machine Learning: Evaluation and Comparison of AutoML Approaches and Tools
• Deep Neural Networks for Nonlinear Model Order Reduction of Unsteady Flows
• Multi-level Convolutional Autoencoder Networks for Parametric Prediction of Spatio-temporal Dynamics
• Enforcing Statistical Constraints in Generative Adversarial Networks for Modeling Chaotic Dynamical Systems
• Construction of Reduced Order Models for Fluid Flows Using Deep Feedforward Neural Networks
• Physics guided machine learning using simplified theories
• Composite Gaussian process models for emulating expensive functions
• Achieving Conservation of Energy in Neural Network Emulators for Climate Modeling
• A non-intrusive reduced order modeling framework for quasi-geostrophic turbulence
• POD/DEIM Reduced-Order Strategies for Efficient Four Dimensional Variational Data Assimilation
• Deep convolutional recurrent autoencoders for learning low-dimensional feature dynamics of fluid systems
• Leveraging reduced-order models for state estimation using deep learning
• Embedding Hard Physical Constraints in Neural Network Coarse-Graining of 3D Turbulence

Cited by in corpus (7)

• On closures for reduced order models $-$ A spectrum of first-principle to machine-learned avenues
• Digital Twins in Wind Energy: Emerging Technologies and Industry-Informed Future Directions
• Attention-Enhanced Neural Network Models for Turbulence Simulation
• Nonlinear proper orthogonal decomposition for convection-dominated flows
• Scientific machine learning in Hydrology: a unified perspective
• Validation and parameterization of a novel physics-constrained neural dynamics model applied to turbulent fluid flow
• Prospects of federated machine learning in fluid dynamics