activity
20242026
most citedFast Computation of Conditional Probabilities in MDPs and Markov Chain Families

1 citations · 2 across the 8 of their papers we have counts for

collaborators
Showing cs.LOShow all

7 papers · 1 filter

cs.LO20261 cited

Fast Computation of Conditional Probabilities in MDPs and Markov Chain Families

Milan Češka, Sebastian Junges, Luko van der Maas +2

Computing optimal conditional reachability probabilities in Markov decision processes (MDPs) is tractable by a reduction to reachability probabilities. Yet, this reduction yields c…

cs.LO2026

Shields to Guarantee Probabilistic Safety in MDPs

Linus Heck, Filip Macák, Roman Andriushchenko +2

Shielding is a prominent model-based technique to ensure safety of autonomous agents. Classical shielding aims to ensure that nothing bad ever happens and comes with strong guarant…

cs.LO2025

Constrained and Robust Policy Synthesis with Satisfiability-Modulo-Probabilistic-Model-Checking

Linus Heck, Filip Macák, Milan Češka +1

The ability to compute reward-optimal policies for given and known finite Markov decision processes (MDPs) underpins a variety of applications across planning, controller synthesis…

cs.LO2025

Decentralized Planning Using Probabilistic Hyperproperties

Francesco Pontiggia, Filip Macák, Roman Andriushchenko +2

Multi-agent planning under stochastic dynamics is usually formalised using decentralized (partially observable) Markov decision processes ( MDPs) and reachability or expected rewar…

cs.LO2025

Small Decision Trees for MDPs with Deductive Synthesis

Roman Andriushchenko, Milan Češka, Sebastian Junges +1

Markov decision processes (MDPs) describe sequential decision-making processes; MDP policies return for every state in that process an advised action. Classical algorithms can effi…

cs.LO2024

Policies Grow on Trees: Model Checking Families of MDPs

Roman Andriushchenko, Milan Češka, Sebastian Junges +1

Markov decision processes (MDPs) provide a fundamental model for sequential decision making under process uncertainty. A classical synthesis task is to compute for a given MDP a wi…