Privately Customizing Prefinetuning to Better Match User Data in Federated Learning

Charlie Hou, Hongyuan Zhan, Akshat Shrivastava +4

In Federated Learning (FL), accessing private client data incurs communication and privacy costs. As a result, FL deployments commonly prefinetune pretrained foundation models on a…