4 papers
Divergence-Routed On-Policy Distillation for Language Models
Tiantian Peng, Guannan Lv, Hongyang Li +5
On-policy distillation (OPD) transfers knowledge from a teacher model to a student along student-generated trajectories, typically by minimizing the reverse Kullback-Leibler (RKL)…
Reasoning Portability: Guiding Continual Learning for MLLMs in the RLVR Era
Qiuhe Hong, Yuyang Liu, Shuo Yang +3
Vision-Language Models in Continual Learning (VLM-CL) aim to continuously adapt to new multimodal tasks while retaining prior knowledge. The emerging paradigm that couples Multimod…
Continual Learning for VLMs: A Survey and Taxonomy Beyond Forgetting
Yuyang Liu, Qiuhe Hong, Linlan Huang +6
Vision-language models (VLMs), spanning predictive architectures to generative Multimodal Large Language Models (MLLMs), have revolutionized artificial intelligence through powerfu…
Stabilizing the Modality Gap: Null-Space Projected Continual Learning for Vision-Language Models
Tiantian Peng, Yuyang Liu, Shuo Yang +2
The modality gap is intrinsic to multimodal alignment, where embeddings from different modalities remain partially separated in a shared representation space. In continual learning…