activity
20152026
most citedDynamic priority allocation via restless bandit marginal productivity indices

139 citations · 493 across the 19 of their papers we have counts for

collaborators
Showing 2023Show all

5 papers · 1 filter

eess.SY2023★ 1 cited

Non-myopic Beam Scheduling for Multiple Smart Target Tracking in Phased Array Radar Network

Yuhang Hao, Zengfu Wang, José Niño-Mora +3

A smart target, also referred to as a reactive target, can take maneuvering motions to hinder radar tracking. We address beam scheduling for tracking multiple smart targets in phas…

math.OC2023★ 139 cited

Dynamic priority allocation via restless bandit marginal productivity indices

José Niño-Mora

This paper surveys recent work by the author on the theoretical and algorithmic aspects of restless bandit indexation as well as on its application to a variety of problems involvi…

math.OC2023★ 101 cited

Dynamic allocation indices for restless projects and queueing admission control: a polyhedral approach

José Niño-Mora

This paper develops a polyhedral approach to the design, analysis, and computation of dynamic allocation indices for scheduling binary-action (engage/rest) Markovian stochastic pro…

math.OC2023★ 29 cited

A faster index algorithm and a computational study for bandits with switching costs

José Niño-Mora

We address the intractable multi-armed bandit problem with switching costs, for which Asawa and Teneketzis introduced in [M. Asawa and D. Teneketzis. 1996. Multi-armed bandits with…

math.OC2023★ 40 cited

A fast-pivoting algorithm for the Gittins index and optimal stopping of a Markov chain

José Niño-Mora

This paper presents a new \emph{fast-pivoting} algorithm that computes the Gittins index values of an -state bandit -- in the discounted and undiscounted cases -- by perform…