59 citations · 291 across the 45 of their papers we have counts for
11 papers · 1 filter
Robust Almost-Sure Reachability in Multi-Environment MDPs
Marck van der Vegt, Nils Jansen, Sebastian Junges
Multiple-environment MDPs (MEMDPs) capture finite sets of MDPs that share the states but differ in the transition dynamics. These models form a proper subclass of partially observa…
Parameter Synthesis in Markov Models: A Gentle Survey
Nils Jansen, Sebastian Junges, Joost-Pieter Katoen
This paper surveys the analysis of parametric Markov models whose transitions are labelled with functions over a finite set of parameters. These models are symbolic representations…
Sampling-Based Verification of CTMCs with Uncertain Rates
Thom S. Badings, Nils Jansen, Sebastian Junges +2
We employ uncertain parametric CTMCs with parametric transition rates and a prior on the parameter values. The prior encodes uncertainty about the actual transition rates, while th…
Scenario-Based Verification of Uncertain Parametric MDPs
Thom Badings, Murat Cubuktepe, Nils Jansen +3
We consider parametric Markov decision processes (pMDPs) that are augmented with unknown probability distributions over parameter values. The problem is to compute the probability…
Adaptive Shielding under Uncertainty
Stefan Pranger, Bettina Könighofer, Martin Tappler +3
This paper targets control problems that exhibit specific safety and performance requirements. In particular, the aim is to ensure that an agent, operating under uncertainty, will…
Scenario-Based Verification of Uncertain MDPs
Murat Cubuktepe, Nils Jansen, Sebastian Junges +2
We consider Markov decision processes (MDPs) in which the transition probabilities and rewards belong to an uncertainty set parametrized by a collection of random variables. The pr…
Shepherding Hordes of Markov Chains
Milan Ceska, Nils Jansen, Sebastian Junges +1
This paper considers large families of Markov chains (MCs) that are defined over a set of parameters with finite discrete domains. Such families occur in software product lines, pl…
Parameter Synthesis for Markov Models: Covering the Parameter Space
Sebastian Junges, Erika Ábrahám, Christian Hensel +4
Markov chain analysis is a key technique in formal verification. A practical obstacle is that all probabilities in Markov models need to be known. However, system quantities such a…
Permissive Finite-State Controllers of POMDPs using Parameter Synthesis
Sebastian Junges, Nils Jansen, Ralf Wimmer +4
We study finite-state controllers (FSCs) for partially observable Markov decision processes (POMDPs) that are provably correct with respect to given specifications. The key insight…
Sequential Convex Programming for the Efficient Verification of Parametric MDPs
Murat Cubuktepe, Nils Jansen, Sebastian Junges +4
Multi-objective verification problems of parametric Markov decision processes under optimality criteria can be naturally expressed as nonlinear programs. We observe that many of th…
Parameter Synthesis for Markov Models: Faster Than Ever
Tim Quatmann, Christian Dehnert, Nils Jansen +2
We propose a simple technique for verifying probabilistic models whose transition probabilities are parametric. The key is to replace parametric transitions by nondeterministic cho…