12 citations · 22 across the 13 of their papers we have counts for
3 papers · 1 filter
An Adaptive State Aggregation Algorithm for Markov Decision Processes
Guanting Chen, Johann Demetrio Gaebler, Matt Peng +2
Value iteration is a well-known method of solving Markov Decision Processes (MDPs) that is simple to implement and boasts strong theoretical convergence guarantees. However, the co…
Solving Linear Programs with Fast Online Learning Algorithms
Wenzhi Gao, Dongdong Ge, Chunlin Sun +1
This paper presents fast first-order methods for solving linear programs (LPs) approximately. We adapt online linear programming algorithms to offline LPs and obtain algorithms tha…
The Symmetry between Arms and Knapsacks: A Primal-Dual Approach for Bandits with Knapsacks
Xiaocheng Li, Chunlin Sun, Yinyu Ye
In this paper, we study the bandits with knapsacks (BwK) problem and develop a primal-dual based algorithm that achieves a problem-dependent logarithmic regret bound. The BwK probl…