most citedMarkovian restless bandits and index policies: A review

23 citations · 36 across the 7 of their papers we have counts for

collaborators

8 papers

math.OC2026

A belief-state restless bandit model for treatment adherence: Whittle indexability via partial conservation laws

José Niño-Mora, Ángel Pellitero García

We study clinically motivated capacity-constrained treatment-adherence outreach through a belief-state restless multi-armed bandit model, in which each patient is a partially obser…

cs.LG2026

Optimal Control of Fluid Restless Multi-armed Bandits: A Machine Learning Approach

Dimitris Bertsimas, Cheol Woo Kim, José Niño-Mora

We present a novel machine learning framework for the optimal control of fluid restless multi-armed bandit problems (FRMABPs) with state equations that are either affine or quadrat…

cs.LG2026

Restless bandits with imperfect binary feedback: PCL-indexability analysis and computation

José Niño-Mora

We study restless bandits with binary latent states and imperfect binary feedback, motivated by opportunistic spectrum access with sensing errors. For the associated belief-state m…

math.OC20267 cited

A fast-pivoting algorithm for Whittle's restless bandit index

José Niño-Mora

The Whittle index for restless bandits (two-action semi-Markov decision processes) provides an intuitively appealing optimal policy for controlling a single generic project that ca…

math.OC20261 cited

Age of information cost minimization with no buffers, random arrivals and unreliable channels: A PCL-indexability analysis

José Niño-Mora

Over the last decade, the Age of Information has emerged as a key concept and metric for applications where the freshness of sensor-provided data is critical. Limited transmission…

math.GM202623 cited

Markovian restless bandits and index policies: A review

José Niño-Mora

The restless multi-armed bandit problem is a paradigmatic modeling framework for optimal dynamic priority allocation in stochastic models of wide-ranging applications that has been…