Supervised Fine-Tuning Needs to Unlock the Potential of Token Priority

Zhanming Shen, Zeyu Qin, Jiaqi Hu +7

The transition from fitting empirical data to achieving true human utility is fundamentally constrained by a granularity mismatch, where fine-grained autoregressive generation is o…