Showing cs.LGShow all
3 papers · 1 filter
cs.LG2026
Denser Better: Limits of On-Policy Self-Distillation for Continual Post-Training
Meng Wang, Haohan Zhao, Wenzhuo Liu +7
Continual post-training enables foundation models to acquire new knowledge while preserving existing capabilities. Recent work suggests that on-policy learning can mitigate forgett…
cs.LG2025
Semi-parametric Memory Consolidation: Towards Brain-like Deep Continual Learning
Geng Liu, Fei Zhu, Rong Feng +4
Humans and most animals inherently possess a distinctive capacity to continually acquire novel experiences and accumulate worldly knowledge over time. This ability, termed continua…
cs.LG2025
Pareto Continual Learning: Preference-Conditioned Learning and Adaption for Dynamic Stability-Plasticity Trade-off
Song Lai, Zhe Zhao, Fei Zhu +3
Continual learning aims to learn multiple tasks sequentially. A key challenge in continual learning is balancing between two objectives: retaining knowledge from old tasks (stabili…