3 citations · 5 across the 3 of their papers we have counts for
8 papers
Explaining Off-Policy Actor-Critic From A Bias-Variance Perspective
Ting-Han Fan, Peter J. Ramadge
Off-policy Actor-Critic algorithms have demonstrated phenomenal experimental performance but still require better explanations. To this end, we show its policy evaluation error on…
Safe Reinforcement Learning with Natural Language Constraints
Tsung-Yen Yang, Michael Hu, Yinlam Chow +2
While safe reinforcement learning (RL) holds great promise for many practical applications like robotics or autonomous cars, current approaches require specifying constraints in ma…
A Contraction Approach to Model-based Reinforcement Learning
Ting-Han Fan, Peter J. Ramadge
Despite its experimental success, Model-based Reinforcement Learning still lacks a complete theoretical understanding. To this end, we analyze the error in the cumulative reward us…
The Landscape of Matrix Factorization Revisited
Hossein Valavi, Sulin Liu, Peter J. Ramadge
We revisit the landscape of the simple matrix factorization problem. For low-rank matrix factorization, prior work has shown that there exist infinitely many critical points all of…
Model Imitation for Model-Based Reinforcement Learning
Yueh-Hua Wu, Ting-Han Fan, Peter J. Ramadge +1
Model-based reinforcement learning (MBRL) aims to learn a dynamic model to reduce the number of interactions with real-world environments. However, due to estimation error, rollout…
Contact Surface Area: A Novel Signal for Heart Rate Estimation in Smartphone Videos
Sara Fridovich-Keil, Peter J. Ramadge
We consider the problem of smartphone video-based heart rate estimation, which typically relies on measuring the green color intensity of the user's skin. We describe a novel signa…