19 citations · 74 across the 12 of their papers we have counts for
10 papers · 1 filter
Monte Carlo Variational Auto-Encoders
Achille Thin, Nikita Kotelevskii, Arnaud Doucet +3
Variational auto-encoders (VAE) are popular deep latent variable models which are trained by maximizing an Evidence Lower Bound (ELBO). To obtain tighter ELBO and hence better vari…
Tight High Probability Bounds for Linear Stochastic Approximation with Fixed Stepsize
Alain Durmus, Eric Moulines, Alexey Naumov +3
This paper provides a non-asymptotic analysis of linear stochastic approximation (LSA) algorithms with fixed stepsize. This family of methods arises in many machine learning tasks…
On Riemannian Stochastic Approximation Schemes with Fixed Step-Size
Alain Durmus, Pablo Jiménez, Éric Moulines +1
This paper studies fixed step-size stochastic approximation (SA) schemes, including stochastic gradient schemes, in a Riemannian framework. It is motivated by several applications,…
On the Stability of Random Matrix Product with Markovian Noise: Application to Linear Stochastic Approximation and TD Learning
Alain Durmus, Eric Moulines, Alexey Naumov +2
This paper studies the exponential stability of random matrix products driven by a general (possibly unbounded) state space Markov chain. It is a cornerstone in the analysis of sto…
Quantitative Propagation of Chaos for SGD in Wide Neural Networks
Valentin De Bortoli, Alain Durmus, Xavier Fontaine +1
In this paper, we investigate the limiting behavior of a continuous-time counterpart of the Stochastic Gradient Descent (SGD) algorithm applied to two-layer overparameterized neura…
MetFlow: A New Efficient Method for Bridging the Gap between Markov Chain Monte Carlo and Variational Inference
Achille Thin, Nikita Kotelevskii, Jean-Stanislas Denain +4
In this contribution, we propose a new computationally efficient method to combine Variational Inference (VI) with Markov Chain Monte Carlo (MCMC). This approach can be used with g…