Elastic Model Aggregation with Parameter Service

Juncheng Gu, Mosharaf Chowdhury, Kang G. Shin +1

Model aggregation, the process that updates model parameters, is an important step for model convergence in distributed deep learning (DDL). However, the parameter server (PS), a p…