1 citations · 1 across the 6 of their papers we have counts for
4 papers · 1 filter
Exploring the Impact of Parameter Update Magnitude on Forgetting and Generalization of Continual Learning
JinLi He, Liang Bai, Xian Yang
The magnitude of parameter updates are considered a key factor in continual learning. However, most existing studies focus on designing diverse update strategies, while a theoretic…
Understanding the Role of Rehearsal Scale in Continual Learning under Varying Model Capacities
JinLi He, Liang Bai, Xian Yang
Rehearsal is one of the key techniques for mitigating catastrophic forgetting and has been widely adopted in continual learning algorithms due to its simplicity and practicality. H…
Bipartite Graph Attention-based Clustering for Large-scale scRNA-seq Data
Zhuomin Liang, Liang Bai, Xian Yang
scRNA-seq clustering is a critical task for analyzing single-cell RNA sequencing (scRNA-seq) data, as it groups cells with similar gene expression profiles. Transformers, as powerf…
C-LoRA: Continual Low-Rank Adaptation for Pre-trained Models
Xin Zhang, Liang Bai, Xian Yang +1
Low-Rank Adaptation (LoRA) is an efficient fine-tuning method that has been extensively applied in areas such as natural language processing and computer vision. Existing LoRA fine…