48 citations · 60 across the 17 of their papers we have counts for
18 papers
Optimal local interventions in the two-dimensional Abelian sandpile model
Maike C. de Jongh, Richard J. Boucherie, M. N. M. van Lieshout
The Abelian sandpile model serves as a canonical example of self-organized criticality. This critical behavior manifests itself through large cascading events triggered by small pe…
Convergence of off-policy TD(0) with linear function approximation for reversible Markov chains
Maik Overmars, Jasper Goseling, Richard Boucherie
We study the convergence of off-policy TD(0) with linear function approximation when used to approximate the expected discounted reward in a Markov chain. It is well known that the…
Controlling the low-temperature Ising model using spatiotemporal Markov decision theory
M. C. de Jongh, Richard J. Boucherie, M. N. M. van Lieshout
We introduce the spatiotemporal Markov decision process (STMDP), a special type of Markov decision process that models sequential decision-making problems which are not only charac…
Constrained Markov decision processes for response-adaptive procedures in clinical trials with binary outcomes
Stef Baas, Aleida Braaksma, Richard J. Boucherie
A constrained Markov decision process (CMDP) approach is developed for response-adaptive procedures in clinical trials with binary outcomes. The resulting CMDP class of Bayesian re…
A stochastic programming approach for dynamic allocation of bed capacity and assignment of patients to collaborating hospitals during pandemic outbreaks
Stef Baas, Sander Dijkstra, Richard J. Boucherie +1
Sustaining regular and infectious care during an infectious outbreak requires adequate management support for capacity allocation for regular and infectious patients. During the CO…
A Sampling-Based Method for Gittins Index Approximation
Stef Baas, Richard J. Boucherie, Aleida Braaksma
A sampling-based method is introduced to approximate the Gittins index for a general family of alternative bandit processes. The approximation consists of a truncation of the optim…