Generalization techniques of neural networks for fluid flow estimation

Abstract

We demonstrate several techniques to encourage practical uses of neural networks for fluid flow estimation. In the present paper, three perspectives which are remaining challenges for applications of machine learning to fluid dynamics are considered: 1. interpretability of machine-learned results, 2. bulking out of training data, and 3. generalizability of neural networks. For the interpretability, we first demonstrate two methods to observe the internal procedure of neural networks, i.e., visualization of hidden layers and application of gradient-weighted class activation mapping (Grad-CAM), applied to canonical fluid flow estimation problems -- $(1)$ drag coefficient estimation of a cylinder wake and $(2)$ velocity estimation from particle images. It is exemplified that both approaches can successfully tell us evidences of the great capability of machine learning-based estimations. We then utilize some techniques to bulk out training data for super-resolution analysis and temporal prediction for cylinder wake and NOAA sea surface temperature data to demonstrate that sufficient training of neural networks with limited amount of training data can be achieved for fluid flow problems. The generalizability of machine learning model is also discussed by accounting for the perspectives of inter/extrapolation of training data, considering super-resolution of wakes behind two parallel cylinders. We find that various flow patterns generated by complex interaction between two cylinders can be reconstructed well, even for the test configurations regarding the distance factor. The present paper can be a significant step toward practical uses of neural networks for both laminar and turbulent flow problems.

arXiv comment24 pages, 24 figures

References in corpus (38)

• Adam: A Method for Stochastic Optimization
• A Comprehensive Survey on Graph Neural Networks
• Discovering governing equations from data: Sparse identification of nonlinear dynamical systems
• Machine Learning for Fluid Mechanics
• Turbulence Modeling in the Age of Data
• Super-resolution reconstruction of turbulent flows with machine learning
• Artificial Neural Networks trained through Deep Reinforcement Learning discover control strategies for active flow control
• Data-Driven Sparse Sensor Placement for Reconstruction
• Nonlinear mode decomposition with convolutional neural networks for fluid dynamics
• Grad-CAM: Why did you say that?
• Machine learning based spatio-temporal super resolution reconstruction of turbulent flows
• Sub-grid modelling for two-dimensional turbulence using neural networks
• Perspectives on Machine Learning-augmented Reynolds-averaged and Large Eddy Simulation Models of Turbulence
• Shallow Neural Networks for Fluid Flow Reconstruction with Limited Sensors
• Global field reconstruction from sparse sensors with Voronoi tessellation-assisted deep learning
• Searching for turbulence models by artificial neural network
• Assessment of supervised machine learning methods for fluid flows
• Convolutional neural network and long short-term memory based reduced order surrogate for minimal turbulent channel flow
• Robust active flow control over a range of Reynolds numbers using an artificial neural network trained through deep reinforcement learning
• Convolutional neural network based hierarchical autoencoder for nonlinear mode decomposition of fluid field data
• Machine-learning-based reduced order modeling for unsteady flows around bluff bodies of various shapes
• A neural network approach for the blind deconvolution of turbulent flows
• Construction of Reduced Order Models for Fluid Flows Using Deep Feedforward Neural Networks
• Probabilistic neural networks for fluid flow surrogate modeling and data recovery
• Synthetic turbulent inflow generator using machine learning
• Quantifying model form uncertainty in Reynolds-averaged turbulence models with Bayesian deep neural networks
• Convolutional neural networks for fluid flow analysis: toward effective metamodeling and low-dimensionalization
• Sparse identification of nonlinear dynamics with low-dimensionalized flow representations
• Experimental velocity data estimation for imperfect particle images using machine learning
• Sub-grid scale model classification and blending through deep learning
• Turbulent scalar flux in inclined jets in crossflow: counter gradient transport and deep learning modelling
• A priori analysis on deep learning of subgrid-scale parameterizations for Kraichnan turbulence
• Effect of Objective Function on Data-Driven Greedy Sparse Sensor Optimization
• Deep learning of mixing by two 'atoms' of stratified turbulence
• Data-driven Vector-measurement-sensor Selection based on Greedy Algorithm
• Convolutional-network models to predict wall-bounded turbulence from wall quantities
• Automating Turbulence Modeling by Multi-Agent Reinforcement Learning
• Inserting machine-learned virtual wall velocity for large-eddy simulation of turbulent channel flows

Cited by in corpus (11)

• Global field reconstruction from sparse sensors with Voronoi tessellation-assisted deep learning
• Convolutional neural network and long short-term memory based reduced order surrogate for minimal turbulent channel flow
• Super-Resolution Analysis via Machine Learning: A Survey for Fluid Flows
• Convolutional neural networks for fluid flow analysis: toward effective metamodeling and low-dimensionalization
• Sparse identification of nonlinear dynamics with low-dimensionalized flow representations
• Experimental velocity data estimation for imperfect particle images using machine learning
• Assessments of epistemic uncertainty using Gaussian stochastic weight averaging for fluid-flow regression
• Identifying key differences between linear stochastic estimation and neural networks for fluid flow regressions
• Joint Deep Reversible Regression Model and Physics-Informed Unsupervised Learning for Temperature Field Reconstruction
• Reconstructing three-dimensional bluff body wake from sectional flow fields with convolutional neural networks
• Model order reduction with neural networks: Application to laminar and turbulent flows