67 citations · 82 across the 8 of their papers we have counts for
Showing 2021Show all
2 papers · 1 filter
cs.LG2021★ 6 cited
EmbRace: Accelerating Sparse Communication for Distributed Training of NLP Neural Networks
Shengwei Li, Zhiquan Lai, Dongsheng Li +3
Distributed data-parallel training has been widely adopted for deep neural network (DNN) models. Although current deep learning (DL) frameworks scale well for dense models like ima…
cs.LG2021★ 1 cited
Hierarchical Adaptive Pooling by Capturing High-order Dependency for Graph Representation Learning
Ning Liu, Songlei Jian, Dongsheng Li +3
Graph neural networks (GNN) have been proven to be mature enough for handling graph-structured data on node-level graph representation learning tasks. However, the graph pooling te…