9 papers · 1 filter
Sharp dimensional analysis of midpoint methods for Langevin sampling
Fan Chen, Sinho Chewi, Jianfeng Lu +1
We study deterministic and randomized midpoint discretizations of Langevin dynamics for a target , where and . To achi…
High-accuracy simulation of Picard HMC, part I: Gaussian cloud correction
Fan Chen, Sinho Chewi, Jianfeng Lu +1
We study the problem of sampling from a continuous density on , where has a -Lipschitz gradient and satisfies a loga…
On the Two Faces of Adam in Separable Linear Classification
Chen Fan, Csaba Szepesvári
We consider the behavior of deterministic, full-batch, bias-corrected Adam in separable linear classification with softmax parametrization under log-loss. In this setting, under a…
Sharp Gaussian divergence and Bernstein-Markov inequalities
Fan Chen, Sinho Chewi, Jianfeng Lu +1
We prove two dimension-free estimates in Gaussian space. The first is an optimal Meyer-type inequality for the Gaussian divergence: for , \[ \|δV\|_{L^p(γ_d)} \leq \sqrt p\…
Smoothed Picard Hamiltonian Monte Carlo
Fan Chen, Sinho Chewi, Jianfeng Lu +1
We develop a new low-accuracy sampler, called smoothed Picard Hamiltonian Monte Carlo, which combines Gaussian smoothing, Picard iteration, and higher-order discretization. For a l…
Accelerated High-Accuracy Sampling from a Warm Start via the Proximal Bouncy Particle Sampler
Fan Chen, Sinho Chewi, Jianfeng Lu +1
We study the problem of sampling from on , where is -strongly convex and -smooth, and write . We desi…
Exact simulation of diffusions and improved algorithms for log-concave sampling
Fan Chen, Sinho Chewi, Alexander Rakhlin +1
We study exact simulation of diffusions via rejection sampling on path space using unbiased estimators of the density ratio obtained from Girsanov's theorem. When applied to the un…
High-accuracy log-concave sampling with stochastic queries
Fan Chen, Sinho Chewi, Constantinos Daskalakis +1
We show that high-accuracy guarantees for log-concave sampling -- that is, iteration and query complexities which scale as , where is the desired target…
High-accuracy sampling for diffusion models and log-concave distributions
Fan Chen, Sinho Chewi, Constantinos Daskalakis +1
We present algorithms for diffusion model sampling which obtain -error in steps, given access to -accurate score estimates in . Thi…