Showing 2026Show all
2 papers · 1 filter
cs.AI2026
ReDraft, Don't Just Distill: Reference-Driven Revision for Continual VLLM Post-Training
Zhihao Zhang, Mingqi Wu, Qiaole Dong +15
Continual post-training of large multimodal models should add new capabilities while preserving those from pre-training, and the two goals pull in opposite directions. SFT gives ex…
stat.ML2026
Why Self-Training Helps and Hurts: Denoising vs. Signal Forgetting
Mingqi Wu, Archer Y. Yang, Qiang Sun
Iterative self-training (self-distillation) repeatedly refits a model on pseudo-labels generated by its own predictions. We study this procedure in overparameterized linear regress…