4 papers
Provable Sparse Inversion and Token Relabel Enhanced One-shot Federated Learning with ViTs
Li Shen, Xiaolei Hao, Qinglun Li +3
One-Shot Federated Learning, where a central server learns a global model in a single communication round, has emerged as a promising paradigm. However, under extremely non-IID set…
PACE: Parameter Change for Unsupervised Environment Design
Fang Yuan, Quanjun Yin, Siqi Shen +5
Unsupervised Environment Design (UED) offers a promising paradigm for improving reinforcement learning generalization by adaptively shaping training environments, but it requires r…
A Unified Generalization Framework for Model Merging: Trade-offs, Non-Linearity, and Scaling Laws
Qinglun Li, Anke Tang, Miao Zhang +3
Model merging efficiently aggregates capabilities from multiple fine-tuned models into a single one, operating purely in parameter space without original data or expensive re-compu…
Unveiling the Power of Multiple Gossip Steps: A Stability-Based Generalization Analysis in Decentralized Training
Qinglun Li, Yingqi Liu, Miao Zhang +3
Decentralized training removes the centralized server, making it a communication-efficient approach that can significantly improve training efficiency, but it often suffers from de…