Manifold Learning via Manifold Deflation
arXiv:2007.03315
Abstract
Nonlinear dimensionality reduction methods provide a valuable means to visualize and interpret high-dimensional data. However, many popular methods can fail dramatically, even on simple two-dimensional manifolds, due to problems such as vulnerability to noise, repeated eigendirections, holes in convex bodies, and boundary bias. We derive an embedding method for Riemannian manifolds that iteratively uses single-coordinate estimates to eliminate dimensions from an underlying differential operator, thus "deflating" it. These differential operators have been shown to characterize any local, spectral dimensionality reduction method. The key to our method is a novel, incremental tangent space estimator that incorporates global structure as coordinates are added. We prove its consistency when the coordinates converge to true coordinates. Empirically, we show our algorithm recovers novel and interesting embeddings on real-world and synthetic datasets.
References in corpus (6)
- UMAP: Uniform Manifold Approximation and Projection for Dimension Reduction
- Manifold Learning: The Price of Normalization
- Nonlinear Intrinsic Variables and State Reconstruction in Multiscale Simulations
- On the convergence of maximum variance unfolding
- On Nonlinear Dimensionality Reduction, Linear Smoothing and Autoencoding
- Non-Redundant Spectral Dimensionality Reduction