Approximating the Quadratic Transportation Metric in Near-Linear Time

Abstract

Computing the quadratic transportation metric (also called the $2$-Wasserstein distance or root mean square distance) between two point clouds, or, more generally, two discrete distributions, is a fundamental problem in machine learning, statistics, computer graphics, and theoretical computer science. A long line of work has culminated in a sophisticated geometric algorithm due to Agarwal and Sharathkumar in 2014, which runs in time $\tilde{O}(n^{3/2})$, where $n$ is the number of points. However, obtaining faster algorithms has proven difficult since the $2$-Wasserstein distance is known to have poor sketching and embedding properties, which limits the effectiveness of geometric approaches. In this paper, we give an extremely simple deterministic algorithm with $\tilde{O}(n)$ runtime by using a completely different approach based on entropic regularization, approximate Sinkhorn scaling, and low-rank approximations of Gaussian kernel matrices. We give explicit dependence of our algorithm on the dimension and precision of the approximation.

arXiv commentunchanged from v1; this article now superseded by arXiv:1812.05189

References in corpus (9)

• Fast Computation of Wasserstein Barycenters
• Near-linear time approximation algorithms for optimal transport via Sinkhorn iteration
• Stochastic Optimization for Large-scale Optimal Transport
• Computational Optimal Transport
• From optimal transport to generative modeling: the VEGAN cookbook
• Computational Optimal Transport: Complexity by Accelerated Gradient Descent Is Better Than by Sinkhorn's Algorithm
• Statistical Optimal Transport via Factored Couplings
• Interpretable Distribution Features with Maximum Testing Power
• Inference via low-dimensional couplings

Cited by in corpus (4)

• Massively scalable Sinkhorn distances via the Nyström method
• Linear-Time Gromov Wasserstein Distances using Low Rank Couplings and Costs
• Tree-Sliced Variants of Wasserstein Distances
• Approximation of Wasserstein distance with Transshipment