Diff Mining: Logit Differences Reveal Finetuning Objectives

Greg Kocher, Robert West, Clément Dumas +1

Finetuning has become the gold standard for refining existing behaviors and inducing new ones in language models, yet it often remains unclear exactly which behaviors emerge during…