activity
20192022
most citedOptimizing Network Performance for Distributed DNN Training on GPU Clusters: ImageNet/AlexNet Training in 1.5 Minutes

48 citations · 52 across the 4 of their papers we have counts for

collaborators

5 papers

cs.DC2022★ 1 cited

CuPBoP: CUDA for Parallelized and Broad-range Processors

Ruobing Han, Jun Chen, Bhanu Garg +3

CUDA is one of the most popular choices for GPU programming, but it can only be executed on NVIDIA GPUs. Executing CUDA on non-NVIDIA devices not only benefits the hardware communi…

cs.DC2021

COX: CUDA on X86 by Exposing Warp-Level Functions to CPUs

Ruobing Han, Jaewon Lee, Jaewoong Sim +1

As CUDA programs become the de facto program among data parallel applications such as high-performance computing or machine learning applications, running CUDA on other platforms h…

cs.PL2021★ 3 cited

Supporting CUDA for an extended RISC-V GPU architecture

Ruobing Han, Blaise Tine, Jaewon Lee +2

With the rapid development of scientific computation, more and more researchers and developers are committed to implementing various workloads/operations on different devices. Amon…

cs.DC2019

Auto-Precision Scaling for Distributed Deep Learning

Ruobing Han, James Demmel, Yang You

It has been reported that the communication cost for synchronizing gradients can be a bottleneck, which limits the scalability of distributed deep learning. Using low-precision gra…

cs.DC2019★ 48 cited

Optimizing Network Performance for Distributed DNN Training on GPU Clusters: ImageNet/AlexNet Training in 1.5 Minutes

Peng Sun, Wansen Feng, Ruobing Han +2

It is important to scale out deep neural network (DNN) training for reducing model training time. The high communication overhead is one of the major performance bottlenecks for di…