6 citations · 13 across the 6 of their papers we have counts for
Showing 2024Show all
2 papers · 1 filter
cs.CL2024
Towards Minimal Targeted Updates of Language Models with Targeted Negative Training
Lily H. Zhang, Rajesh Ranganath, Arya Tafvizi
Generative models of language exhibit impressive capabilities but still place non-negligible probability mass over undesirable outputs. In this work, we address the task of updatin…
cs.LG2024
Preference Learning Algorithms Do Not Learn Preference Rankings
Angelica Chen, Sadhika Malladi, Lily H. Zhang +4
Preference learning algorithms (e.g., RLHF and DPO) are frequently used to steer LLMs to produce generations that are more preferred by humans, but our understanding of their inner…