3 papers
math.OC2026
Mathematical methods of reinforcement learning
Denis Belomestny, Alexander Gasnikov, Egor Gladin +5
Reinforcement learning (RL) is increasingly grounded in tools from probability, optimization, and operator theory. This survey organizes the mathematical structures that underpin t…
math.PR2025
Rosenthal-type inequalities for linear statistics of Markov chains
Alain Durmus, Eric Moulines, Alexey Naumov +2
In this paper, we establish novel concentration inequalities for additive functionals of geometrically ergodic Markov chains similar to Rosenthal inequalities for sums of independe…
math.ST2024
Theoretical guarantees for neural control variates in MCMC
Denis Belomestny, Artur Goldman, Alexey Naumov +1
In this paper, we propose a variance reduction approach for Markov chains based on additive control variates and the minimization of an appropriate estimate for the asymptotic vari…