129 citations · 368 across the 70 of their papers we have counts for
7 papers · 1 filter
From Dissipativity Theory to Compositional Construction of Finite Markov Decision Processes
Abolfazl Lavaei, Sadegh Soudjani, Majid Zamani
This paper is concerned with a compositional approach for constructing finite Markov decision processes of interconnected discrete-time stochastic control systems. The proposed app…
Temporal logic control of general Markov decision processes by approximate policy refinement
Sofie Haesaert, Sadegh Soudjani, Alessandro Abate
The formal verification and controller synthesis for Markov decision processes that evolve over uncountable state spaces are computationally hard and thus generally rely on the use…
Compositional Abstractions of Interconnected Discrete-Time Stochastic Control Systems
Abolfazl Lavaei, Sadegh Esmaeil Zadeh Soudjani, Rupak Majumdar +1
This paper is concerned with a compositional approach for constructing abstractions of interconnected discrete-time stochastic control systems. The abstraction framework is based o…
Compositional Construction of Finite State Abstractions for Stochastic Control Systems
Kaushik Mallik, Sadegh Esmaeil Zadeh Soudjani, Anne-Kathrin Schmuck +1
Controller synthesis techniques for continuous systems with respect to temporal logic specifications typically use a finite-state symbolic abstraction of the system. Constructing t…
Multilevel Monte Carlo Method for Statistical Model Checking of Hybrid Systems
Sadegh Esmaeil Zadeh Soudjani, Rupak Majumdar, Tigran Nagapetyan
We study statistical model checking of continuous-time stochastic hybrid systems. The challenge in applying statistical model checking to these systems is that one cannot simulate…
Shrinking Horizon Model Predictive Control with Signal Temporal Logic Constraints under Stochastic Disturbances
Samira S. Farahani, Rupak Majumdar, Vinayak Prabhu +1
We present Shrinking Horizon Model Predictive Control (SHMPC) for discrete-time linear systems with Signal Temporal Logic (STL) specification constraints under stochastic disturban…
The Robot Routing Problem for Collecting Aggregate Stochastic Rewards
Rayna Dimitrova, Ivan Gavran, Rupak Majumdar +2
We propose a new model for formalizing reward collection problems on graphs with dynamically generated rewards which may appear and disappear based on a stochastic model. The *robo…