306 citations · 315 across the 3 of their papers we have counts for
3 papers
cs.DB2026
HierarchicalKV: A GPU Hash Table with Cache Semantics for Continuous Online Embedding Storage
Haidong Rong, Jiashu Yao, Matthias Langer +12
Traditional GPU hash tables preserve every inserted key -- a dictionary assumption that wastes scarce High Bandwidth Memory (HBM) when embedding tables routinely exceed single-GPU…
cs.LG2019★ 9 cited
Distributed Equivalent Substitution Training for Large-Scale Recommender Systems
Haidong Rong, Yangzihao Wang, Feihu Zhou +8
We present Distributed Equivalent Substitution (DES) training, a novel distributed training framework for large-scale recommender systems with dynamic sparse features. DES introduc…
cs.LG2018★ 306 cited
Highly Scalable Deep Learning Training System with Mixed-Precision: Training ImageNet in Four Minutes
Xianyan Jia, Shutao Song, Wei He +11
Synchronized stochastic gradient descent (SGD) optimizers with data parallelism are widely used in training large-scale deep neural networks. Although using larger mini-batch sizes…