Showing cs.LGShow all
2 papers · 1 filter
cs.LG2023
SparDL: Distributed Deep Learning Training with Efficient Sparse Communication
Minjun Zhao, Yichen Yin, Yuren Mao +3
Top-k sparsification has recently been widely used to reduce the communication volume in distributed deep learning. However, due to the Sparse Gradient Accumulation (SGA) dilemma,…
cs.LG2021
Finding Materialized Models for Model Reuse
Minjun Zhao, Lu Chen, Keyu Yang +2
Materialized model query aims to find the most appropriate materialized model as the initial model for model reuse. It is the precondition of model reuse, and has recently attracte…