4 papers
Energy-Structured Low-Rank Adaptation for Continual Learning
Longhua Li, Lei Qi, Qi Tian +1
While orthogonal subspace methods try to mitigate task interference in Continual Learning (CL), they often suffer from energy diffusion across the basis, hindering knowledge compac…
Essential Subspace Merging for Multi-Task Learning
Longhua Li, Lei Qi, Xin Geng +1
Model merging aims to enable multi-task learning by integrating the capabilities of multiple models fine-tuned from the same pre-trained checkpoint into a single model. Its core ch…
Stratified Knowledge-Density Super-Network for Scalable Vision Transformers
Longhua Li, Lei Qi, Xin Geng
Training and deploying multiple vision transformer (ViT) models for different resource constraints is costly and inefficient. To address this, we propose transforming a pre-trained…
One-Shot Knowledge Transfer for Scalable Person Re-Identification
Longhua Li, Lei Qi, Xin Geng
Edge computing in person re-identification (ReID) is crucial for reducing the load on central cloud servers and ensuring user privacy. Conventional compression methods for obtainin…