Nonlinear mode decomposition with convolutional neural networks for fluid dynamics

Abstract

We present a new nonlinear mode decomposition method to visualize the decomposed flow fields, named the mode decomposing convolutional neural network autoencoder (MD-CNN-AE). The proposed method is applied to a flow around a circular cylinder at $R{e}_D=100$ as a test case. The flow attributes are mapped into two modes in the latent space and then these two modes are visualized in the physical space. Because the MD-CNN-AEs with nonlinear activation functions show lower reconstruction errors than the proper orthogonal decomposition (POD), the nonlinearity contained in the activation function is considered the key to improve the capability of the model. It is found by applying POD to each field decomposed using the MD-CNN-AE with hyperbolic tangent activation that a single nonlinear MD-CNN-AE mode contains multiple orthogonal bases, in contrast to the linear methods, i.e., POD and the MD-CNN-AE with linear activation. We further assess the proposed MD-CNN-AE by applying it to a transient process of a circular cylinder wake in order to examine its capability for flows containing high-order spatial modes. The present results suggest a great potential for the nonlinear MD-CNN-AE to be used for feature extraction of flow fields in lower dimension than POD, while retaining interpretable relationships with the conventional POD modes.

arXiv comment15 pages, 14 figures

References in corpus (10)

• Adam: A Method for Stochastic Optimization
• Machine Learning for Fluid Mechanics
• Turbulence Modeling in the Age of Data
• Super-resolution reconstruction of turbulent flows with machine learning
• Shallow Neural Networks for Fluid Flow Reconstruction with Limited Sensors
• A neural network approach for the blind deconvolution of turbulent flows
• Synthetic turbulent inflow generator using machine learning
• Extreme learning machine for reduced order modeling of turbulent geophysical flows
• Deep learning of mixing by two 'atoms' of stratified turbulence
• Locally linear embedding for transient cylinder wakes

Cited by in corpus (64)

• Enhancing Computational Fluid Dynamics with Machine Learning
• Physics-informed neural networks for solving Reynolds-averaged Navier$\unicode{x2013}$Stokes equations
• Machine learning based spatio-temporal super resolution reconstruction of turbulent flows
• Assessment of supervised machine learning methods for fluid flows
• Convolutional neural network and long short-term memory based reduced order surrogate for minimal turbulent channel flow
• Deep Neural Networks for Nonlinear Model Order Reduction of Unsteady Flows
• Convolutional neural network based hierarchical autoencoder for nonlinear mode decomposition of fluid field data
• Machine-learning-based reduced order modeling for unsteady flows around bluff bodies of various shapes
• Improving aircraft performance using machine learning: a review
• Super-Resolution Analysis via Machine Learning: A Survey for Fluid Flows
• Probabilistic neural networks for fluid flow surrogate modeling and data recovery
• Convolutional neural networks for fluid flow analysis: toward effective metamodeling and low-dimensionalization
• Sparse identification of nonlinear dynamics with low-dimensionalized flow representations
• Grasping Extreme Aerodynamics on a Low-Dimensional Manifold
• Assessment of unsteady flow predictions using hybrid deep learning based reduced order models
• Data-driven recovery of hidden physics in reduced order modeling of fluid flows
• Experimental velocity data estimation for imperfect particle images using machine learning
• Generalization techniques of neural networks for fluid flow estimation
• Residual Dynamic Mode Decomposition: Robust and verified Koopmanism
• Multi-resolution partial differential equations preserved learning framework for spatiotemporal dynamics
• Data-driven modal decomposition methods as feature detection techniques for flow problems: a critical assessment
• Three-dimensional deep learning-based reduced order model for unsteady flow dynamics with variable Reynolds number
• Multiscale Proper Orthogonal Decomposition (mPOD) of TR-PIV data-- a Case Study on Stationary and Transient Cylinder Wake Flows
• Nonlinear proper orthogonal decomposition for convection-dominated flows
• A priori analysis on deep learning of subgrid-scale parameterizations for Kraichnan turbulence
• Embedding Hard Physical Constraints in Neural Network Coarse-Graining of 3D Turbulence
• Assessments of epistemic uncertainty using Gaussian stochastic weight averaging for fluid-flow regression
• $\text{FastSVD-ML-ROM}$: A Reduced-Order Modeling Framework based on Machine Learning for Real-Time Applications
• Gaussian process regression + deep neural network autoencoder for probabilistic surrogate modeling in nonlinear mechanics of solids
• Reconstruction of three-dimensional turbulent flow structures using surface measurements for free-surface flows based on a convolutional neural network
• A cyclic perspective on transient gust encounters through the lens of persistent homology
• Identifying key differences between linear stochastic estimation and neural networks for fluid flow regressions
• An accuracy-enhanced transonic flow prediction method fusing deep learning and reduced-order model
• Convolutional-network models to predict wall-bounded turbulence from wall quantities
• Robust training approach of neural networks for fluid flow state estimations
• Compressing fluid flows with nonlinear machine learning: mode decomposition, latent modeling, and flow control
• Machine-learned control-oriented flow estimation for multiactuator multi-sensor systems exemplified for the fluidic pinball
• Image-based flow decomposition using empirical wavelet transform
• Multi-scale Time-stepping of Partial Differential Equations with Transformers
• Inserting machine-learned virtual wall velocity for large-eddy simulation of turbulent channel flows
• Model-Based Reinforcement Learning for Control of Strongly-Disturbed Unsteady Aerodynamic Flows
• Reconstructing three-dimensional bluff body wake from sectional flow fields with convolutional neural networks
• Physics-Assisted Reduced-Order Modeling for Identifying Dominant Features of Transonic Buffet
• An experimental modal testing method for subcritical flow around a cylinder
• A Tailored Convolutional Neural Network for Nonlinear Manifold Learning of Computational Physics Data using Unstructured Spatial Discretizations
• Decoder Decomposition for the Analysis of the Latent Space of Nonlinear Autoencoders With Wind-Tunnel Experimental Data
• Deep Learning for Reduced Order Modelling and Efficient Temporal Evolution of Fluid Simulations
• Reduced-order Model for Fluid Flows via Neural Ordinary Differential Equations
• Flow control by a hybrid use of machine learning and control theory
• Generalization capabilities and robustness of hybrid models grounded in physics compared to purely deep learning models
• Uncovering dynamically critical regions in near-wall turbulence using 3D Convolutional Neural Networks
• Godunov Loss Functions for Modelling of Hyperbolic Conservation Laws
• Data-assisted, physics-informed propagators for recurrent flows
• Compact representation of transonic airfoil buffet flows with observable-augmented machine learning
• Conditionally Parameterized, Discretization-Aware Neural Networks for Mesh-Based Modeling of Physical Systems
• A composable autoencoder-based iterative algorithm for accelerating numerical simulations
• Parametric 3D Convolutional Autoencoder for the Prediction of Flow Fields in a Bed Configuration of Hot Particles
• Model order reduction with neural networks: Application to laminar and turbulent flows
• Convolutional causal learning for aerodynamic flows
• Spatiotemporal wall pressure forecast of a rectangular cylinder with physics-aware DeepU-Fourier neural network
• Machine-Learning for Nonintrusive Model Order Reduction of the Parametric Inviscid Transonic Flow past an airfoil
• A Latent space solver for PDE generalization
• Modelling of Flow Past Long Cylindrical Structures
• Direct data-driven forecast of local turbulent heat flux in Rayleigh-Bénard convection