4 papers
Memory-Dependent Interval Markov Chain Abstractions of Stochastic Dynamics
Menno van Zutphen, Adrien Banse, Domagoj Herceg +2
Finite-state interval Markov-chain (IMC) abstractions provide sound verification and performance bounds for continuous-state stochastic systems by enclosing cell-to-cell transition…
Tempering the Bayes Filter towards Improved Model-Based Estimation
Menno van Zutphen, Domagoj Herceg, Giannis Delimpaltadakis +1
Model-based filtering is often carried out while subject to an imperfect model, as learning partially-observable stochastic systems remains a challenge. Recent work on Bayesian inf…
Beyond KL-divergence: Risk Aware Control Through Cross Entropy and Adversarial Entropy Regularization
Menno van Zutphen, Domagoj Herceg, Duarte J. Antunes
While the idea of robust dynamic programming (DP) is compelling for systems affected by uncertainty, addressing worst-case disturbances generally results in excessive conservatism.…
Predictable Interval MDPs through Entropy Regularization
Menno van Zutphen, Giannis Delimpaltadakis, Maurice Heemels +1
Regularization of control policies using entropy can be instrumental in adjusting predictability of real-world systems. Applications benefiting from such approaches range from, e.g…