139 citations · 369 across the 13 of their papers we have counts for
10 papers · 1 filter
A fast-pivoting algorithm for Whittle's restless bandit index
José Niño-Mora
The Whittle index for restless bandits (two-action semi-Markov decision processes) provides an intuitively appealing optimal policy for controlling a single generic project that ca…
Age of information cost minimization with no buffers, random arrivals and unreliable channels: A PCL-indexability analysis
José Niño-Mora
Over the last decade, the Age of Information has emerged as a key concept and metric for applications where the freshness of sensor-provided data is critical. Limited transmission…
Multi-gear bandits, partial conservation laws, and indexability
José Niño-Mora
This paper considers what we propose to call multi-gear bandits, which are Markov decision processes modeling a generic dynamic and stochastic project fueled by a single resource a…
A belief-state restless bandit model for treatment adherence: Whittle indexability via partial conservation laws
José Niño-Mora, Ángel Pellitero García
We study clinically motivated capacity-constrained treatment-adherence outreach through a belief-state restless multi-armed bandit model, in which each patient is a partially obser…
Multi-Action Restless Bandits with Weakly Coupled Constraints: Simultaneous Learning and Control
Jing Fu, Bill Moran, José Niño-Mora
We study a system with finitely many groups of multi-action bandit processes, each of which is a Markov decision process (MDP) with finite state and action spaces and potentially d…
Dynamic priority allocation via restless bandit marginal productivity indices
José Niño-Mora
This paper surveys recent work by the author on the theoretical and algorithmic aspects of restless bandit indexation as well as on its application to a variety of problems involvi…