Showing cs.LOShow all
3 papers · 1 filter
cs.LO2025
Generalized Parameter Lifting: Finer Abstractions for Parametric Markov Chains
Linus Heck, Tim Quatmann, Jip Spel +2
Parametric Markov chains (pMCs) are Markov chains (MCs) with symbolic probabilities. A pMC encodes a family of MCs, where each member is obtained by replacing parameters with const…
cs.LO2021
Gradient-Descent for Randomized Controllers under Partial Observability
Linus Heck, Jip Spel, Sebastian Junges +2
Randomization is a powerful technique to create robust controllers, in particular in partially observable settings. The degrees of randomization have a significant impact on the sy…
cs.LO2019
Are Parametric Markov Chains Monotonic?
Jip Spel, Sebastian Junges, Joost-Pieter Katoen
This paper presents a simple algorithm to check whether reachability probabilities in parametric Markov chains are monotonic in (some of) the parameters. The idea is to construct -…