2 papers
cs.IT2026
A Modularized Framework for Piecewise-Stationary Restless Bandits
Kuan-Ta Li, Chia-Chun Lin, Ping-Chun Hsieh +1
We study the piecewise-stationary restless multi-armed bandit (PS-RMAB) problem, where each arm evolves as a Markov chain but \emph{mean rewards may change across unknown segments}…
cs.LG2024
Diminishing Exploration: A Minimalist Approach to Piecewise Stationary Multi-Armed Bandits
Kuan-Ta Li, Ping-Chun Hsieh, Yu-Chih Huang
The piecewise-stationary bandit problem is an important variant of the multi-armed bandit problem that further considers abrupt changes in the reward distributions. The main theme…