661 citations · 701 across the 9 of their papers we have counts for
4 papers · 1 filter
BiFeat: Supercharge GNN Training via Graph Feature Quantization
Yuxin Ma, Ping Gong, Jun Yi +4
Graph Neural Networks (GNNs) is a promising approach for applications with nonEuclidean data. However, training GNNs on large scale graphs with hundreds of millions nodes is both r…
EPNAS: Efficient Progressive Neural Architecture Search
Yanqi Zhou, Peng Wang, Sercan Arik +4
In this paper, we propose Efficient Progressive Neural Architecture Search (EPNAS), a neural architecture search (NAS) that efficiently handles large search space through a novel p…
LEASGD: an Efficient and Privacy-Preserving Decentralized Algorithm for Distributed Learning
Hsin-Pai Cheng, Patrick Yu, Haojing Hu +4
Distributed learning systems have enabled training large-scale models over large amount of data in significantly shorter time. In this paper, we focus on decentralized distributed…
TernGrad: Ternary Gradients to Reduce Communication in Distributed Deep Learning
Wei Wen, Cong Xu, Feng Yan +4
High network communication cost for synchronizing gradients and parameters is the well-known bottleneck of distributed training. In this work, we propose TernGrad that uses ternary…