2 papers
math.OC2025
Controlling the low-temperature Ising model using spatiotemporal Markov decision theory
M. C. de Jongh, Richard J. Boucherie, M. N. M. van Lieshout
We introduce the spatiotemporal Markov decision process (STMDP), a special type of Markov decision process that models sequential decision-making problems which are not only charac…
math.PR2024
A non-homogeneous Semi-Markov model for Interval Censoring
M. N. M. van Lieshout, R. L. Markwitz
Previous approaches to modelling interval-censored data have often relied on assumptions of homogeneity in the sense that the censoring mechanism, the underlying distribution of oc…