Showing 2025Show all
2 papers · 1 filter
cs.GT2025
Taming Infinity one Chunk at a Time: Concisely Represented Strategies in One-Counter MDPs
Michal Ajdarów, James C. A. Main, Petr Novotný +1
Markov decision processes (MDPs) are a canonical model to reason about decision making within a stochastic environment. We study a fundamental class of infinite MDPs: one-counter M…
cs.FL2025
Efficient Analysis of Polynomial Asymptotic Estimates for VASS MDPs
Michal Ajdarów
Markov decision process over vector addition system with states (VASS MDP) is a finite state model combining non-deterministic and probabilistic behavior, augmented with non-negati…