Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
Learngene Search Across Multiple Datasets for Building Variable-Sized Models
Boyu Shi, Junbo Zhou, Chang Liu +3
Deep learning methods are widely used under diverse resource constraints, resulting in models of varying sizes, such as the Vision Transformer (ViT) series. Deploying these models…
cs.LG2026
Towards On-Policy SFT: Distribution Discriminant Theory and its Applications in LLM Training
Miaosen Zhang, Yishan Liu, Shuxia Lin +8
Supervised fine-tuning (SFT) is computationally efficient but often yields inferior generalization compared to reinforcement learning (RL). This gap is primarily driven by RL's use…