Linear and Nonlinear Dimensionality Reduction from Fluid Mechanics to Machine Learning

Abstract

Dimensionality reduction is the essence of many data processing problems, including filtering, data compression, reduced-order modeling and pattern analysis. While traditionally tackled using linear tools in the fluid dynamics community, nonlinear tools from machine learning are becoming increasingly popular. This article, halfway between a review and a tutorial, introduces a general framework for linear and nonlinear dimensionality reduction techniques. Differences and links between autoencoders and manifold learning methods are highlighted, and popular nonlinear techniques such as kernel Principal Component Analysis (kPCA), isometric feature learning (ISOMAPs) and Locally Linear Embedding (LLE) are placed in this framework. These algorithms are benchmarked in three classic problems: 1) filtering, 2) identification of oscillatory patterns, and 3) data compression. Their performances are compared against the traditional Proper Orthogonal Decomposition (POD) to provide a perspective on their diffusion in fluid dynamics.

arXiv commentsubmitted to Measurement Science and Technology

References in corpus (20)

• Scikit-learn: Machine Learning in Python
• SciPy 1.0--Fundamental Algorithms for Scientific Computing in Python
• Array Programming with NumPy
• On Dynamic Mode Decomposition: Theory and Applications
• Spectral proper orthogonal decomposition and its relationship to dynamic mode decomposition and resolvent analysis
• Sparsity-promoting dynamic mode decomposition
• Spectral proper orthogonal decomposition
• Sparse reduced-order modeling : Sensor-based dynamics to full-state estimation
• Deep Neural Networks for Nonlinear Model Order Reduction of Unsteady Flows
• Convolutional neural network based hierarchical autoencoder for nonlinear mode decomposition of fluid field data
• A deep learning enabler for non-intrusive reduced order modeling of fluid flows
• Multi-Scale Proper Orthogonal Decomposition of Complex Fluid Flows
• On closures for reduced order models $-$ A spectrum of first-principle to machine-learned avenues
• What Regularized Auto-Encoders Learn from the Data Generating Distribution
• Multiscale Proper Orthogonal Decomposition (mPOD) of TR-PIV data-- a Case Study on Stationary and Transient Cylinder Wake Flows
• From snapshots to manifolds - A tale of shear flows
• Locally Linear Embedding and its Variants: Tutorial and Survey
• On the Dynamics of the Jet Wiping Process: Numerical Simulations and Modal Analysis
• Multidimensional Scaling, Sammon Mapping, and Isomap: Tutorial and Survey
• Statistical Treatment, Fourier and Modal Decomposition

Cited by in corpus (3)

• Gaussian process regression + deep neural network autoencoder for probabilistic surrogate modeling in nonlinear mechanics of solids
• A meshless method to compute the proper orthogonal decomposition and its variants from scattered data
• Model-based time super-sampling of turbulent flow field sequences