4 papers
The Limits of Transfer Reinforcement Learning with Latent Low-rank Structure
Tyler Sam, Yudong Chen, Christina Lee Yu
Many reinforcement learning (RL) algorithms are too costly to use in practice due to the large sizes of the problem's state and action space. To resolve this issue, we study…
Entry-Specific Bounds for Low-Rank Matrix Completion under Highly Non-Uniform Sampling
Xumei Xi, Christina Lee Yu, Yudong Chen
Low-rank matrix completion concerns the problem of estimating unobserved entries in a matrix using a sparse set of observed entries. We consider the non-uniform setting where the o…
The SMART approach to instance-optimal online learning
Siddhartha Banerjee, Alankrita Bhatt, Christina Lee Yu
We devise an online learning algorithm -- titled Switching via Monotone Adapted Regret Traces (SMART) -- that adapts to the data and achieves regret that is instance optimal, i.e.,…
Matrix Estimation for Offline Reinforcement Learning with Low-Rank Structure
Xumei Xi, Christina Lee Yu, Yudong Chen
We consider offline Reinforcement Learning (RL), where the agent does not interact with the environment and must rely on offline data collected using a behavior policy. Previous wo…