3 papers
math.OC2026
Fast Two-Time-Scale Stochastic Gradient Method with Applications in Reinforcement Learning
Sihan Zeng, Thinh T. Doan
Two-time-scale optimization is a framework introduced in Zeng et al. (2024) that abstracts a range of policy evaluation and policy optimization problems in reinforcement learning (…
cs.LG2025
Nonasymptotic CLT and Error Bounds for Two-Time-Scale Stochastic Approximation
Seo Taek Kong, Sihan Zeng, Thinh T. Doan +1
We consider linear two-time-scale stochastic approximation algorithms driven by martingale noise. Recent applications in machine learning motivate the need to understand finite-tim…
cs.LG2025
Accelerating Multi-Task Temporal Difference Learning under Low-Rank Representation
Yitao Bai, Sihan Zeng, Justin Romberg +1
We study policy evaluation problems in multi-task reinforcement learning (RL) under a low-rank representation setting. In this setting, we are given learning tasks where the co…