59 citations · 291 across the 45 of their papers we have counts for
6 papers · 1 filter
The Partially Observable Games We Play for Cyber Deception
Mohamadreza Ahmadi, Murat Cubuktepe, Nils Jansen +3
Progressively intricate cyber infiltration mechanisms have made conventional means of defense, such as firewalls and malware detectors, incompetent. These sophisticated infiltratio…
Structured Synthesis for Probabilistic Systems
Nils Jansen, Laura Humphrey, Jana Tumova +1
We introduce the concept of structured synthesis for Markov decision processes where the structure is induced from finitely many pre-specified options for a system configuration. T…
Verification of Uncertain POMDPs Using Barrier Certificates
Mohamadreza Ahmadi, Murat Cubuktepe, Nils Jansen +1
We consider a class of partially observable Markov decision processes (POMDPs) with uncertain transition and/or observation probabilities. The uncertainty takes the form of probabi…
Safe Reinforcement Learning via Probabilistic Shields
Nils Jansen, Bettina Könighofer, Sebastian Junges +2
This paper targets the efficient construction of a safety shield for decision making in scenarios that incorporate uncertainty. Markov decision processes (MDPs) are prominent model…
Synthesis in pMDPs: A Tale of 1001 Parameters
Murat Cubuktepe, Nils Jansen, Sebastian Junges +2
This paper considers parametric Markov decision processes (pMDPs) whose transitions are equipped with affine functions over a finite set of parameters. The synthesis problem is to…
Human-in-the-Loop Synthesis for Partially Observable Markov Decision Processes
Steven Carr, Nils Jansen, Ralf Wimmer +2
We study planning problems where autonomous agents operate inside environments that are subject to uncertainties and not fully observable. Partially observable Markov decision proc…