3 papers
math.OC2026
Robust Markov Decision Processes on Continuous State Spaces
Mengmeng Li, Yifan Hu, Daniel Kuhn +1
We study infinite-horizon robust Markov decision processes (MDPs) on continuous state spaces with structured rectangular ambiguity set. The proposed ambiguity set falls within the…
math.OC2026
Multistage Conditional Compositional Optimization
Buse Åen, Yifan Hu, Daniel Kuhn
We introduce Multistage Conditional Compositional Optimization (MCCO) as a new paradigm for decision-making under uncertainty that combines aspects of multistage stochastic program…
math.OC2026
Landscape of Policy Optimization for Finite Horizon MDPs with General State and Action
Xin Chen, Yifan Hu, Minda Zhao
Policy gradient methods are widely used in reinforcement learning. Yet, the nonconvexity of policy optimization poses significant challenges in understanding the global convergence…