66 citations · 132 across the 26 of their papers we have counts for
Showing 2024Show all
3 papers · 1 filter
cs.LG2024
SAFE: Slow and Fast Parameter-Efficient Tuning for Continual Learning with Pre-Trained Models
Linglan Zhao, Xuerui Zhang, Ke Yan +2
Continual learning aims to incrementally acquire new concepts in data streams while resisting forgetting previous knowledge. With the rise of powerful pre-trained models (PTMs), th…
cs.LG2024★ 1 cited
Investigating the Impact of Model Complexity in Large Language Models
Jing Luo, Huiyuan Wang, Weiran Huang
Large Language Models (LLMs) based on the pre-trained fine-tuning paradigm have become pivotal in solving natural language processing tasks, consistently achieving state-of-the-art…
cs.LG2024★ 7 cited
A Statistical Theory of Regularization-Based Continual Learning
Xuyang Zhao, Huiyuan Wang, Weiran Huang +1
We provide a statistical analysis of regularization-based continual learning on a sequence of linear regression tasks, with emphasis on how different regularization terms affect th…