59 citations · 125 across the 34 of their papers we have counts for
5 papers · 1 filter
Under-Approximating Expected Total Rewards in POMDPs
Alexander Bork, Joost-Pieter Katoen, Tim Quatmann
We consider the problem: is the optimal expected total reward to reach a goal state in a partially observable Markov decision process (POMDP) below a given threshold? We tackle thi…
Bayesian Inference by Symbolic Model Checking
Bahare Salmani, Joost-Pieter Katoen
This paper applies probabilistic model checking techniques for discrete Markov chains to inference in Bayesian networks. We present a simple translation from Bayesian networks into…
Verification of indefinite-horizon POMDPs
Alexander Bork, Sebastian Junges, Joost-Pieter Katoen +1
The verification problem in MDPs asks whether, for any policy resolving the nondeterminism, the probability that something bad happens is bounded by some given threshold. This veri…
The Partially Observable Games We Play for Cyber Deception
Mohamadreza Ahmadi, Murat Cubuktepe, Nils Jansen +3
Progressively intricate cyber infiltration mechanisms have made conventional means of defense, such as firewalls and malware detectors, incompetent. These sophisticated infiltratio…
Synthesis in pMDPs: A Tale of 1001 Parameters
Murat Cubuktepe, Nils Jansen, Sebastian Junges +2
This paper considers parametric Markov decision processes (pMDPs) whose transitions are equipped with affine functions over a finite set of parameters. The synthesis problem is to…