139 citations · 493 across the 19 of their papers we have counts for
6 papers · 1 filter
Restless bandits with imperfect binary feedback: PCL-indexability analysis and computation
José Niño-Mora
We study restless bandits with binary latent states and imperfect binary feedback, motivated by opportunistic spectrum access with sensing errors. For the associated belief-state m…
A fast-pivoting algorithm for Whittle's restless bandit index
José Niño-Mora
The Whittle index for restless bandits (two-action semi-Markov decision processes) provides an intuitively appealing optimal policy for controlling a single generic project that ca…
Age of information cost minimization with no buffers, random arrivals and unreliable channels: A PCL-indexability analysis
José Niño-Mora
Over the last decade, the Age of Information has emerged as a key concept and metric for applications where the freshness of sensor-provided data is critical. Limited transmission…
Markovian restless bandits and index policies: A review
José Niño-Mora
The restless multi-armed bandit problem is a paradigmatic modeling framework for optimal dynamic priority allocation in stochastic models of wide-ranging applications that has been…
Multi-gear bandits, partial conservation laws, and indexability
José Niño-Mora
This paper considers what we propose to call multi-gear bandits, which are Markov decision processes modeling a generic dynamic and stochastic project fueled by a single resource a…
A belief-state restless bandit model for treatment adherence: Whittle indexability via partial conservation laws
José Niño-Mora, Ángel Pellitero García
We study clinically motivated capacity-constrained treatment-adherence outreach through a belief-state restless multi-armed bandit model, in which each patient is a partially obser…