3 citations · 3 across the 2 of their papers we have counts for
3 papers
cs.LG2025
Continual Gradient Low-Rank Projection Fine-Tuning for LLMs
Chenxu Wang, Yilin Lyu, Zicheng Sun +1
Continual fine-tuning of Large Language Models (LLMs) is hampered by the trade-off between efficiency and expressiveness. Low-Rank Adaptation (LoRA) offers efficiency but constrain…
stat.ML2024
Nonstationary Sparse Spectral Permanental Process
Zicheng Sun, Yixuan Zhang, Zenan Ling +2
Existing permanental processes often impose constraints on kernel types or stationarity, limiting the model's expressiveness. To overcome these limitations, we propose a novel appr…
cs.LG2023★ 3 cited
Overcoming Recency Bias of Normalization Statistics in Continual Learning: Balance and Adaptation
Yilin Lyu, Liyuan Wang, Xingxing Zhang +4
Continual learning entails learning a sequence of tasks and balancing their knowledge appropriately. With limited access to old training samples, much of the current work in deep n…