2.2k citations · 3.2k across the 79 of their papers we have counts for
Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
LoOPSD: On-Policy Self-Distillation with Looped Teachers
Wei Fan, Qingyue Yang, Chao-Hong Tan +6
On-policy self-distillation improves a model using guidance from the model itself, but it still requires a teacher that provides more useful predictions than the student. Existing…
cs.LG2026
FGGM: Fisher-Guided Gradient Masking for Continual Learning
Chao-Hong Tan, Qian Chen, Wen Wang +6
Catastrophic forgetting impairs the continuous learning of large language models. We propose Fisher-Guided Gradient Masking (FGGM), a framework that mitigates this by strategically…