611 citations · 855 across the 28 of their papers we have counts for
5 papers · 1 filter
Continuous-Time Markov Decisions based on Partial Exploration
Pranav Ashok, Yuliya Butkova, Holger Hermanns +1
We provide a framework for speeding up algorithms for time-bounded reachability analysis of continuous-time Markov decision processes. The principle is to find a small, but almost…
Multi-objective Robust Strategy Synthesis for Interval Markov Decision Processes
Ernst Moritz Hahn, Vahid Hashemi, Holger Hermanns +2
Interval Markov decision processes (IMDPs) generalise classical MDPs by having interval-valued transition probabilities. They provide a powerful modelling tool for probabilistic sy…
On the Control of Self-Balancing Unicycles
Felix Freiberger, Holger Hermanns
This paper discusses the problem of designing a self-balancing unicycle where pedals are used for both power generation and speed control. After developing the principal physical a…
Optimal Continuous Time Markov Decisions
Yuliya Butkova, Hassan Hatefi, Holger Hermanns +1
In the context of Markov decision processes running in continuous time, one of the most intriguing challenges is the efficient approximation of finite horizon reachability objectiv…
Recharging Probably Keeps Batteries Alive
Holger Hermanns, Jan Krčál, Gilles Nies
The kinetic battery model is a popular model of the dynamic behavior of a conventional battery, useful to predict or optimize the time until battery depletion. The model however la…