Federated Learning While Providing Model as a Service: Joint Training and Inference Optimization

Pengchao Han, Shiqiang Wang, Yang Jiao +1

While providing machine learning model as a service to process users' inference requests, online applications can periodically upgrade the model utilizing newly collected data. Fed…