1 citations · 1 across the 6 of their papers we have counts for
Showing 2026Show all
3 papers · 1 filter
cs.LG2026
Generalization Hacking: Models Can Game Reinforcement Learning by Preventing Behavioral Generalization
Frank Xiao, Mary Phuong
Model post-training, and in particular reinforcement learning (RL), is one of the primary mechanisms by which developers can shape models' values and behaviors. However, as models…
cs.LG2026
Bootstrapped Monitoring: Leveraging Transparent Reasoning to Oversee Stronger AI Agents
Frank Xiao, Mary Phuong
Trusted monitoring is a cornerstone of AI control. However, as frontier models grow more capable, the increasing capabilities gap between trusted and untrusted models may render tr…
cs.LG2026
Probe-Based Data Attribution: Discovering and Mitigating Undesirable Behaviors in LLM Post-Training
Frank Xiao, Santiago Aranguri
We propose probe-based data attribution, a method that traces behavioral changes in post-trained language models to responsible training datapoints. By computing activation-differe…