4 papers
Steady-State Approximation Error of Heterogeneous Mean-Field Models
Lei Ying
This paper studies heterogeneous mean-field models in which agent parameters are sampled from a population distribution. We establish an bound on the steady-state mean-squ…
On the Global Convergence of Risk-Averse Natural Policy Gradient Methods with Expected Conditional Risk Measures
Xian Yu, Lei Ying
Risk-sensitive reinforcement learning (RL) has become a popular tool for controlling the risk of uncertain outcomes and ensuring reliable performance in highly stochastic sequentia…
Achieving Optimality Gap in Restless Bandits through Gaussian Approximation
Chen Yan, Weina Wang, Lei Ying
We study the finite-horizon Restless Multi-Armed Bandit (RMAB) problem with homogeneous arms. Prior work has shown that when an RMAB satisfies a non-degeneracy condition, Linea…
Policy Gradient Methods for Risk-Sensitive Distributional Reinforcement Learning with Provable Convergence
Minheng Xiao, Xian Yu, Lei Ying
Risk-sensitive reinforcement learning (RL) is crucial for maintaining reliable performance in high-stakes applications. While traditional RL methods aim to learn a point estimate o…