Federated Foundation Models Fine-Tuning with Heterogeneous Compressed Clients

Shengkun Zhu, Jinshan Zeng, Zhihua Allen-Zhao +5

Federated learning of foundation models faces a fundamental resource-asymmetry challenge: the institutions holding the most valuable domain-specific data cannot host billion-parame…