1 citations · 1 across the 8 of their papers we have counts for
4 papers · 1 filter
Denser Better: Limits of On-Policy Self-Distillation for Continual Post-Training
Meng Wang, Haohan Zhao, Wenzhuo Liu +7
Continual post-training enables foundation models to acquire new knowledge while preserving existing capabilities. Recent work suggests that on-policy learning can mitigate forgett…
Semi-parametric Memory Consolidation: Towards Brain-like Deep Continual Learning
Geng Liu, Fei Zhu, Rong Feng +4
Humans and most animals inherently possess a distinctive capacity to continually acquire novel experiences and accumulate worldly knowledge over time. This ability, termed continua…
TrustLoRA: Low-Rank Adaptation for Failure Detection under Out-of-distribution Data
Fei Zhu, Zhaoxiang Zhang
Reliable prediction is an essential requirement for deep neural models that are deployed in open environments, where both covariate and semantic out-of-distribution (OOD) data aris…
Global Convergence of Continual Learning on Non-IID Data
Fei Zhu, Yujing Liu, Wenzhuo Liu +1
Continual learning, which aims to learn multiple tasks sequentially, has gained extensive attention. However, most existing work focuses on empirical studies, and the theoretical a…