3 papers
cs.LG2026
Understanding the Robustness of Distributed Self-Supervised Learning Frameworks Against Non-IID Data
Xuanyu Chen, Nan Yang, Shuai Wang +1
Recent research has introduced distributed self-supervised learning (D-SSL) approaches to leverage vast amounts of unlabeled decentralized data. However, D-SSL faces the critical c…
cs.LG2025
Scaling Law Analysis in Federated Learning: How to Select the Optimal Model Size?
Xuanyu Chen, Nan Yang, Shuai Wang +1
The recent success of large language models (LLMs) has sparked a growing interest in training large-scale models. As the model size continues to scale, concerns are growing about t…
cs.LG2025
Memory-Efficient Fine-Tuning via Low-Rank Activation Compression
Jiang-Xin Shi, Wen-Da Wei, Jin-Fei Qi +3
The parameter-efficient fine-tuning paradigm has garnered significant attention with the advancement of foundation models. Although numerous methods have been proposed to reduce th…