19 citations · 34 across the 7 of their papers we have counts for
3 papers · 1 filter
Beyond Semantic Manipulation: Token-Space Attacks on Reward Models
Yuheng Zhang, Mingyue Huo, Minghao Zhu +2
Reward models (RMs) are widely used as optimization targets in reinforcement learning from human feedback (RLHF), yet they remain vulnerable to reward hacking. Existing attacks mai…
Math Operation Embeddings for Open-ended Solution Analysis and Feedback
Mengxue Zhang, Zichao Wang, Richard Baraniuk +1
Feedback on student answers and even during intermediate steps in their solutions to open-ended questions is an important element in math education. Such feedback can help students…
Evaluating the Performance of Reinforcement Learning Algorithms
Scott M. Jordan, Yash Chandak, Daniel Cohen +2
Performance evaluations are critical for quantifying algorithmic advances in reinforcement learning. Recent reproducibility analyses have shown that reported performance results ar…