ReDraft, Don't Just Distill: Reference-Driven Revision for Continual VLLM Post-Training

Zhihao Zhang, Mingqi Wu, Qiaole Dong +15

Continual post-training of large multimodal models should add new capabilities while preserving those from pre-training, and the two goals pull in opposite directions. SFT gives ex…