5 papers
Learning Adaptive SED for heterogeneous load balancing
Sanne van Kempen, Jaron Sanders, Fiona Sloothaak +1
We study a two-server load balancing system with heterogeneous service rates that are a priori unknown to the dispatcher. The goal is to route customers according to the Shortest--…
Stability of skill-based queues with deterministic waiting time thresholds
Sanne van Kempen, Elene Anton, Fiona Sloothaak
We consider skill-based queues where service is First--Come--First--Served, but some compatibility lines are only available once a customer's waiting time exceeds a threshold. For…
Asymptotically optimal reinforcement learning in Block Markov Decision Processes
Thomas van Vuren, Fiona Sloothaak, Maarten G. Wolf +1
The curse of dimensionality renders Reinforcement Learning (RL) impractical in many real-world settings with exponentially large state and action spaces. Yet, many environments exh…
Demonstration of effective UCB-based routing in skill-based queues on real-world data
Sanne van Kempen, Jaron Sanders, Fiona Sloothaak +1
This paper is about optimally controlling skill-based queueing systems such as data centers, cloud computing networks, and service systems. By means of a case study using a real-wo…
Learning payoffs while routing in skill-based queues
Sanne van Kempen, Jaron Sanders, Fiona Sloothaak +1
Motivated by applications in service systems, we consider queueing systems where each customer must be handled by a server with the right skill set. We focus on optimizing the rout…