70 citations · 138 across the 21 of their papers we have counts for
22 papers
Efficient Diffusion Models for Symmetric Manifolds
Oren Mangoubi, Neil He, Nisheeth K. Vishnoi
We introduce a framework for designing efficient diffusion models for -dimensional symmetric-space Riemannian manifolds, including the torus, sphere, special orthogonal group an…
Private Low-Rank Approximation for Covariance Matrices, Dyson Brownian Motion, and Eigenvalue-Gap Bounds for Gaussian Perturbations
Oren Mangoubi, Nisheeth K. Vishnoi
We consider the problem of approximating a covariance matrix with a rank- matrix under -differential privacy. We present and analyze a complex…
Faster Sampling from Log-Concave Densities over Polytopes via Efficient Linear Solvers
Oren Mangoubi, Nisheeth K. Vishnoi
We consider the problem of sampling from a log-concave distribution constrained to a polytope , where $A\in \mathbb{R}^…
Singular Subspace Perturbation Bounds via Rectangular Random Matrix Diffusions
Peiyao Lai, Oren Mangoubi
Given a matrix with singular values , and a random matrix with iid entries for some…
Private Covariance Approximation and Eigenvalue-Gap Bounds for Complex Gaussian Perturbations
Oren Mangoubi, Nisheeth K. Vishnoi
We consider the problem of approximating a covariance matrix with a rank- matrix under -differential privacy. We present and analyze a complex…
Re-Analyze Gauss: Bounds for Private Matrix Approximation via Dyson Brownian Motion
Oren Mangoubi, Nisheeth K. Vishnoi
Given a symmetric matrix and a vector , we present new bounds on the Frobenius-distance utility of the Gaussian mechanism for approximating by a matrix whose spectrum is…
Private Matrix Approximation and Geometry of Unitary Orbits
Oren Mangoubi, Yikai Wu, Satyen Kale +2
Consider the following optimization problem: Given matrices and , maximize where varies over the unitary group . Th…
Sampling from Log-Concave Distributions over Polytopes via a Soft-Threshold Dikin Walk
Oren Mangoubi, Nisheeth K. Vishnoi
Given a Lipschitz or smooth convex function for a bounded polytope defined by inequalities, we consider the problem of sampli…
Sampling from Log-Concave Distributions with Infinity-Distance Guarantees
Oren Mangoubi, Nisheeth K. Vishnoi
For a -dimensional log-concave distribution constrained to a convex body , the problem of outputting samples from a distribution which is $\varep…
Sync-Switch: Hybrid Parameter Synchronization for Distributed Deep Learning
Shijian Li, Oren Mangoubi, Lijie Xu +1
Stochastic Gradient Descent (SGD) has become the de facto way to train deep neural networks in distributed clusters. A critical factor in determining the training throughput and mo…
A Convergent and Dimension-Independent Min-Max Optimization Algorithm
Vijay Keswani, Oren Mangoubi, Sushant Sachdeva +1
We study a variant of a recently introduced min-max optimization framework where the max-player is constrained to update its parameters in a greedy manner until it reaches a first-…
Greedy Adversarial Equilibrium: An Efficient Alternative to Nonconvex-Nonconcave Min-Max Optimization
Oren Mangoubi, Nisheeth K. Vishnoi
Min-max optimization of an objective function is an important model for robustness in an adversarial setting, with appl…
Faster polytope rounding, sampling, and volume computation via a sublinear "Ball Walk"
Oren Mangoubi, Nisheeth K. Vishnoi
We study the problem of "isotropically rounding" a polytope , that is, computing a linear transformation which makes the uniform distribution on the polytope…
Nonconvex sampling with the Metropolis-adjusted Langevin algorithm
Oren Mangoubi, Nisheeth K. Vishnoi
The Langevin Markov chain algorithms are widely deployed methods to sample from distributions in challenging high-dimensional and non-convex statistics and machine learning applica…
Online Sampling from Log-Concave Distributions
Holden Lee, Oren Mangoubi, Nisheeth K. Vishnoi
Given a sequence of convex functions , we study the problem of sampling from the Gibbs distribution for each epoch in…
Simple Conditions for Metastability of Continuous Markov Chains
Oren Mangoubi, Natesh S. Pillai, Aaron Smith
A family of Markov chains is said to exhibit with if its spectral gap (or some other…
Does Hamiltonian Monte Carlo mix faster than a random walk on multimodal densities?
Oren Mangoubi, Natesh S. Pillai, Aaron Smith
Hamiltonian Monte Carlo (HMC) is a very popular and generic collection of Markov chain Monte Carlo (MCMC) algorithms. One explanation for the popularity of HMC algorithms is their…
Dimensionally Tight Bounds for Second-Order Hamiltonian Monte Carlo
Oren Mangoubi, Nisheeth K. Vishnoi
Hamiltonian Monte Carlo (HMC) is a widely deployed method to sample from high-dimensional distributions in Statistics and Machine learning. HMC is known to run very efficiently in…
Convex Optimization with Unbounded Nonconvex Oracles using Simulated Annealing
Oren Mangoubi, Nisheeth K. Vishnoi
We consider the problem of minimizing a convex objective function when one can only evaluate its noisy approximation . Unless one assumes some structure on the noise,…
Rapid Mixing of Hamiltonian Monte Carlo on Strongly Log-Concave Distributions
Oren Mangoubi, Aaron Smith
We obtain several quantitative bounds on the mixing properties of the Hamiltonian Monte Carlo (HMC) algorithm for a strongly log-concave target distribution on …
Rapid Mixing of Geodesic Walks on Manifolds with Positive Curvature
Oren Mangoubi, Aaron Smith
We introduce a Markov chain for sampling from the uniform distribution on a Riemannian manifold , which we call the . We prove that the mixing…
Integral geometry for Markov chain Monte Carlo: overcoming the curse of search-subspace dimensionality
Oren Mangoubi, Alan Edelman
We introduce a method that uses the Cauchy-Crofton formula and a new curvature formula from integral geometry to reweight the sampling probabilities of Metropolis-within-Gibbs algo…