Gradients Must Earn Their Influence: Unifying SFT with Generalized Entropic Objectives

Zecheng Wang, Deyuan Liu, Chunshan Li +5

Standard negative log-likelihood (NLL) for Supervised Fine-Tuning (SFT) applies uniform token-level weighting. This rigidity creates a two-fold failure mode: (i) overemphasizing lo…