497 citations · 2.1k across the 297 of their papers we have counts for
7 papers · 2 filters
On the Detection of Markov Decision Processes
Xiaoming Duan, Yagiz Savas, Rui Yan +2
We study the detection problem for a finite set of Markov decision processes (MDPs) where the MDPs have the same state and action spaces but possibly different probabilistic transi…
Proportional-Integral Projected Gradient Method for Infeasibility Detection in Conic Optimization
Yue Yu, Ufuk Topcu
A constrained optimization problem is primal infeasible if its constraints cannot be satisfied, and dual infeasible if the constraints of its dual problem cannot be satisfied. We p…
Proportional-Integral Projected Gradient Method for Conic Optimization
Yue Yu, Purnanand Elango, Ufuk Topcu +1
Conic optimization is the minimization of a differentiable convex objective function subject to conic constraints. We propose a novel primal-dual first-order method for conic optim…
Convex Optimization for Parameter Synthesis in MDPs
Murat Cubuktepe, Nils Jansen, Sebastian Junges +2
Probabilistic model checking aims to prove whether a Markov decision process (MDP) satisfies a temporal logic specification. The underlying methods rely on an often unrealistic ass…
Entropy Maximization for Partially Observable Markov Decision Processes
Yagiz Savas, Michael Hibbard, Bo Wu +2
We study the problem of synthesizing a controller that maximizes the entropy of a partially observable Markov decision process (POMDP) subject to a constraint on the expected total…
On Minimizing Total Discounted Cost in MDPs Subject to Reachability Constraints
Yagiz Savas, Christos K. Verginis, Michael Hibbard +1
We study the synthesis of a policy in a Markov decision process (MDP) following which an agent reaches a target state in the MDP while minimizing its total discounted cost. The pro…