Identifying key differences between linear stochastic estimation and neural networks for fluid flow regressions

Abstract

Neural networks (NNs) and linear stochastic estimation (LSE) have widely been utilized as powerful tools for fluid-flow regressions. We investigate fundamental differences between them considering two canonical fluid-flow problems: 1. the estimation of high-order proper orthogonal decomposition coefficients from low-order their counterparts for a flow around a two-dimensional cylinder, and 2. the state estimation from wall characteristics in a turbulent channel flow. In the first problem, we compare the performance of LSE to that of a multi-layer perceptron (MLP). With the channel flow example, we capitalize on a convolutional neural network (CNN) as a nonlinear model which can handle high-dimensional fluid flows. For both cases, the nonlinear NNs outperform the linear methods thanks to nonlinear activation functions. We also perform error-curve analyses regarding the estimation error and the response of weights inside models. Our analysis visualizes the robustness against noisy perturbation on the error-curve domain while revealing the fundamental difference of the covered tools for fluid-flow regressions.

arXiv comment11 pages, 9 figures

References in corpus (17)

• Machine Learning for Fluid Mechanics
• Turbulence Modeling in the Age of Data
• Super-resolution reconstruction of turbulent flows with machine learning
• Nonlinear mode decomposition with convolutional neural networks for fluid dynamics
• Data-driven prediction of unsteady flow fields over a circular cylinder using deep learning
• Machine learning based spatio-temporal super resolution reconstruction of turbulent flows
• Global field reconstruction from sparse sensors with Voronoi tessellation-assisted deep learning
• Searching for turbulence models by artificial neural network
• Assessment of supervised machine learning methods for fluid flows
• Convolutional neural network and long short-term memory based reduced order surrogate for minimal turbulent channel flow
• Probabilistic neural networks for fluid flow surrogate modeling and data recovery
• Convolutional neural networks for fluid flow analysis: toward effective metamodeling and low-dimensionalization
• Generalization techniques of neural networks for fluid flow estimation
• Evolutional Deep Neural Network
• Leveraging reduced-order models for state estimation using deep learning
• Assessments of epistemic uncertainty using Gaussian stochastic weight averaging for fluid-flow regression
• Robust training approach of neural networks for fluid flow state estimations

Cited by in corpus (7)

• Super-Resolution Analysis via Machine Learning: A Survey for Fluid Flows
• Multi-fidelity prediction of fluid flow and temperature field based on transfer learning using Fourier Neural Operator
• Assessments of epistemic uncertainty using Gaussian stochastic weight averaging for fluid-flow regression
• Three-dimensional generative adversarial networks for turbulent flow estimation from wall measurements
• Robust training approach of neural networks for fluid flow state estimations
• Reconstructing three-dimensional bluff body wake from sectional flow fields with convolutional neural networks
• Projection-based multifidelity linear regression for data-scarce applications