1 citations · 1 across the 5 of their papers we have counts for
3 papers · 1 filter
How to post-train on a surrogate: Envelope sampling mitigates reward hacking
Sanjit Dandapanthula, Shuvom Sadhuka, Samir Khan +3
Large language models (LLMs) are commonly post-trained against LLM judges and other cheap surrogates because the true reward, such as human preference, is too expensive to query at…
Expert Routing with Synthetic Data for Continual Learning
Yewon Byun, Sanket Vaibhav Mehta, Saurabh Garg +4
In many real-world settings, regulations and economic incentives permit the sharing of models but not data across institutional boundaries. In such scenarios, practitioners might h…
Auditing Fairness under Unobserved Confounding
Yewon Byun, Dylan Sam, Michael Oberst +2
Many definitions of fairness or inequity involve unobservable causal quantities that cannot be directly estimated without strong assumptions. For instance, it is particularly diffi…