4 papers
ROGUE: Misaligned Agent Behavior Arising from Ordinary Computer Use
Jeremy Tien, Abishek Anand, Yu-Rou Tuan +3
As AI agents are increasingly deployed in real personal and corporate settings (email accounts, development workflows, company databases, etc.), safety considerations surrounding t…
Behavior-Aware Auxiliary Corrections for Off-Policy Temporal-Difference Prediction
Xingguo Chen, Zhiang He, Yuchen Shen +4
Temporal-difference learning with function approximation can be unstable under off-policy sampling. TDC stabilizes off-policy TD through an auxiliary covariance correction, and TDR…
Behavior-Induced Mirror-Prox Temporal-Difference Learning for Faster Off-Policy Prediction
Xingguo Chen, Yuchen Shen, Shangdong Yang +3
Gradient temporal-difference methods provide stable off-policy prediction with linear function approximation, but their practical performance is strongly affected by the geometry i…
ProTransformer: Robustify Transformers via Plug-and-Play Paradigm
Zhichao Hou, Weizhi Gao, Yuchen Shen +2
Transformer-based architectures have dominated various areas of machine learning in recent years. In this paper, we introduce a novel robust attention mechanism designed to enhance…