Showing 2025Show all
3 papers · 1 filter
math.PR2025
Stability of skill-based queues with deterministic waiting time thresholds
Sanne van Kempen, Elene Anton, Fiona Sloothaak
We consider skill-based queues where service is First--Come--First--Served, but some compatibility lines are only available once a customer's waiting time exceeds a threshold. For…
cs.LG2025
Asymptotically optimal reinforcement learning in Block Markov Decision Processes
Thomas van Vuren, Fiona Sloothaak, Maarten G. Wolf +1
The curse of dimensionality renders Reinforcement Learning (RL) impractical in many real-world settings with exponentially large state and action spaces. Yet, many environments exh…
cs.LG2025
Demonstration of effective UCB-based routing in skill-based queues on real-world data
Sanne van Kempen, Jaron Sanders, Fiona Sloothaak +1
This paper is about optimally controlling skill-based queueing systems such as data centers, cloud computing networks, and service systems. By means of a case study using a real-wo…