3 papers
math.OC2025
Quantizer Design for Finite Model Approximations, Model Learning, and Quantized Q-Learning for MDPs with Unbounded Spaces
Osman Bicer, Ali D. Kara, Serdar Yuksel
In this paper, for Markov decision processes (MDPs) with unbounded state spaces we present refined upper bounds presented in [Kara et. al. JMLR'23] on finite model approximation er…
math.OC2025
Sensitivity of Filter Kernels and Robustness Bounds to Transition and Measurement Kernel Perturbations in Partially Observable Stochastic Control
Yunus Emre Demirci, Ali Devran Kara, Serdar Yüksel
Studying the stability of partially observed Markov decision processes (POMDPs) with respect to perturbations in either transition or observation kernels is a significant problem.…
math.OC2025
Learning POMDPs with Linear Function Approximation and Finite Memory
Ali Devran Kara
We study reinforcement learning with linear function approximation and finite-memory approximations for partially observed Markov decision processes (POMDPs). We first present an a…