12 citations · 17 across the 5 of their papers we have counts for
Showing 2020Show all
3 papers · 1 filter
math.PR2020
Bicausal Optimal Transport for Markov Chains via Dynamic Programming
Vrettos Moulos
In this paper we study the bicausal optimal transport problem for Markov chains, an optimal transport formulation suitable for stochastic processes which takes into consideration t…
math.ST2020★ 3 cited
Finite-Time Analysis of Round-Robin Kullback-Leibler Upper Confidence Bounds for Optimal Adaptive Allocation with Multiple Plays and Markovian Rewards
Vrettos Moulos
We study an extension of the classic stochastic multi-armed bandit problem which involves multiple plays and Markovian rewards in the rested bandits setting. In order to tackle thi…
math.ST2020
A Hoeffding Inequality for Finite State Markov Chains and its Applications to Markovian Bandits
Vrettos Moulos
This paper develops a Hoeffding inequality for the partial sums , where is an irreducible Markov chain on a finite state sp…