Weight-Space Geometry of Offline Reasoning Training

Aleksandr Nikolich, Igor Kiselev, Vladimir Platonov +1

Offline reinforcement-learning losses (RFT, RIFT, DFT, Offline GRPO, DPO) are widely used to distill reasoning from large teachers into smaller students, and are typically compared…