11 papers
Sharp dimensional analysis of midpoint methods for Langevin sampling
Fan Chen, Sinho Chewi, Jianfeng Lu +1
We study deterministic and randomized midpoint discretizations of Langevin dynamics for a target , where and . To achi…
High-accuracy simulation of Picard HMC, part I: Gaussian cloud correction
Fan Chen, Sinho Chewi, Jianfeng Lu +1
We study the problem of sampling from a continuous density on , where has a -Lipschitz gradient and satisfies a loga…
On the Two Faces of Adam in Separable Linear Classification
Chen Fan, Csaba Szepesvári
We consider the behavior of deterministic, full-batch, bias-corrected Adam in separable linear classification with softmax parametrization under log-loss. In this setting, under a…
Sharp Gaussian divergence and Bernstein-Markov inequalities
Fan Chen, Sinho Chewi, Jianfeng Lu +1
We prove two dimension-free estimates in Gaussian space. The first is an optimal Meyer-type inequality for the Gaussian divergence: for , \[ \|δV\|_{L^p(γ_d)} \leq \sqrt p\…
Smoothed Picard Hamiltonian Monte Carlo
Fan Chen, Sinho Chewi, Jianfeng Lu +1
We develop a new low-accuracy sampler, called smoothed Picard Hamiltonian Monte Carlo, which combines Gaussian smoothing, Picard iteration, and higher-order discretization. For a l…
Accelerated High-Accuracy Sampling from a Warm Start via the Proximal Bouncy Particle Sampler
Fan Chen, Sinho Chewi, Jianfeng Lu +1
We study the problem of sampling from on , where is -strongly convex and -smooth, and write . We desi…
Exact simulation of diffusions and improved algorithms for log-concave sampling
Fan Chen, Sinho Chewi, Alexander Rakhlin +1
We study exact simulation of diffusions via rejection sampling on path space using unbiased estimators of the density ratio obtained from Girsanov's theorem. When applied to the un…
High-accuracy log-concave sampling with stochastic queries
Fan Chen, Sinho Chewi, Constantinos Daskalakis +1
We show that high-accuracy guarantees for log-concave sampling -- that is, iteration and query complexities which scale as , where is the desired target…
High-accuracy sampling for diffusion models and log-concave distributions
Fan Chen, Sinho Chewi, Constantinos Daskalakis +1
We present algorithms for diffusion model sampling which obtain -error in steps, given access to -accurate score estimates in . Thi…
DiffEM: Learning from Corrupted Data with Diffusion Models via Expectation Maximization
Danial Hosseintabar, Fan Chen, Giannis Daras +2
Diffusion models have emerged as powerful generative priors for high-dimensional inverse problems, yet learning them when only corrupted or noisy observations are available remains…
Fast Convergence of Random Reshuffling under Over-Parameterization and the Polyak-Łojasiewicz Condition
Chen Fan, Christos Thrampoulidis, Mark Schmidt
Modern machine learning models are often over-parameterized and as a result they can interpolate the training data. Under such a scenario, we study the convergence properties of a…