4 papers
Unlabeled Data vs. Pre-trained Knowledge: Rethinking SSL in the Era of Large Models
Song-Lin Lv, Rui Zhu, Tong Wei +2
Semi-supervised learning (SSL) alleviates the cost of data labeling process by exploiting unlabeled data and has achieved promising results. Meanwhile, with the development of larg…
Memory-Efficient Fine-Tuning via Low-Rank Activation Compression
Jiang-Xin Shi, Wen-Da Wei, Jin-Fei Qi +3
The parameter-efficient fine-tuning paradigm has garnered significant attention with the advancement of foundation models. Although numerous methods have been proposed to reduce th…
LIFT+: Lightweight Fine-Tuning for Long-Tail Learning
Jiang-Xin Shi, Tong Wei, Yu-Feng Li
The fine-tuning paradigm has emerged as a prominent approach for addressing long-tail learning tasks in the era of foundation models. However, the impact of fine-tuning strategies…
Vision-Language Models are Strong Noisy Label Detectors
Tong Wei, Hao-Tian Li, Chun-Shu Li +3
Recent research on fine-tuning vision-language models has demonstrated impressive performance in various downstream tasks. However, the challenge of obtaining accurately labeled da…