433 citations · 1.2k across the 21 of their papers we have counts for
21 papers
Stochastic Performance Analysis of Phase Decomposition in Hyperledger Fabric
Canhui Wang, Xiaowen Chu
Hyperledger Fabric is one of the most popular permissioned blockchain platforms. Although many existing works on the overall system performance of Hyperledger Fabric are available,…
FusionAI: Decentralized Training and Deploying LLMs with Massive Consumer-Level GPUs
Zhenheng Tang, Yuxin Wang, Xin He +8
The rapid growth of memory and computation requirements of large language models (LLMs) has outpaced the development of hardware, hindering people who lack large-scale high-end GPU…
Evidence for Nonlinear Gluon Effects in QCD and their Dependence at STAR
STAR Collaboration, M. S. Abdallah, B. E. Aboona +382
The STAR Collaboration reports measurements of back-to-back azimuthal correlations of di-s produced at forward pseudorapidities () in +, Al, and Au co…
Communication-Efficient Distributed Deep Learning: A Comprehensive Survey
Zhenheng Tang, Shaohuai Shi, Wei Wang +2
Distributed deep learning (DL) has become prevalent in recent years to reduce training time by leveraging multiple computing devices (e.g., GPUs/TPUs) due to larger models and data…
Measurement and Analysis of the Bitcoin Networks: A View from Mining Pools
Canhui Wang, Xiaowen Chu, Qin Yang
Mining pools, the main components of the Bitcoin network, dominate the computing resources and play essential roles in network security and performance aspects. Although many exist…
GPU Accelerated Keccak (SHA3) Algorithm
Canhui Wang, Xiaowen Chu
Hash functions like SHA-1 or MD5 are one of the most important cryptographic primitives, especially in the field of information integrity. Considering the fact that increasing meth…
GPU Accelerated AES Algorithm
Canhui Wang, Xiaowen Chu
It has been widely accepted that Graphics Processing Units (GPU) is one of promising schemes for encryption acceleration, in particular, the support of complex mathematical calcula…
A Distributed Synchronous SGD Algorithm with Global Top- Sparsification for Low Bandwidth Networks
Shaohuai Shi, Qiang Wang, Kaiyong Zhao +4
Distributed synchronous stochastic gradient descent (S-SGD) has been widely used in training large-scale deep neural networks (DNNs), but it typically requires very high communicat…
Highly Scalable Deep Learning Training System with Mixed-Precision: Training ImageNet in Four Minutes
Xianyan Jia, Shutao Song, Wei He +11
Synchronized stochastic gradient descent (SGD) optimizers with data parallelism are widely used in training large-scale deep neural networks. Although using larger mini-batch sizes…
A DAG Model of Synchronous Stochastic Gradient Descent in Distributed Deep Learning
Shaohuai Shi, Qiang Wang, Xiaowen Chu +1
With huge amounts of training data, deep learning has made great breakthroughs in many artificial intelligence (AI) applications. However, such large-scale data sets present comput…
Performance Evaluation of Deep Learning Tools in Docker Containers
Pengfei Xu, Shaohuai Shi, Xiaowen Chu
With the success of deep learning techniques in a broad range of application domains, many deep learning software frameworks have been developed and are being updated frequently to…
Performance Modeling and Evaluation of Distributed Deep Learning Frameworks on GPUs
Shaohuai Shi, Qiang Wang, Xiaowen Chu
Deep learning frameworks have been widely deployed on GPU servers for deep learning applications in both academia and industry. In training deep neural networks (DNNs), there are m…
Speeding up Convolutional Neural Networks By Exploiting the Sparsity of Rectifier Units
Shaohuai Shi, Xiaowen Chu
Rectifier neuron units (ReLUs) have been widely used in deep convolutional networks. An ReLU converts negative values to zeros, and does not change positive values, which leads to…
Supervised Learning Based Algorithm Selection for Deep Neural Networks
Shaohuai Shi, Pengfei Xu, Xiaowen Chu
Many recent deep learning platforms rely on third-party libraries (such as cuBLAS) to utilize the computing power of modern hardware accelerators (such as GPUs). However, we observ…
GPGPU Performance Estimation with Core and Memory Frequency Scaling
Qiang Wang, Xiaowen Chu
Graphics Processing Units (GPUs) support dynamic voltage and frequency scaling (DVFS) in order to balance computational performance and energy consumption. However, there still lac…
Benchmarking State-of-the-Art Deep Learning Software Tools
Shaohuai Shi, Qiang Wang, Pengfei Xu +1
Deep learning has been shown as a successful machine learning method for a variety of tasks, and its popularity results in numerous open-source deep learning software tools. Traini…
Dissecting GPU Memory Hierarchy through Microbenchmarking
Xinxin Mei, Xiaowen Chu
Memory access efficiency is a key factor in fully utilizing the computational power of graphics processing units (GPUs). However, many details of the GPU memory hierarchy are not r…
Efficient Channel-Hopping Rendezvous Algorithm Based on Available Channel Set
Lu Yu, Hai Liu, Yiu-Wing Leung +2
In cognitive radio networks, rendezvous is a fundamental operation by which two cognitive users establish a communication link on a commonly-available channel for communications. S…
ZOS: A Fast Rendezvous Algorithm Based on Set of Available Channels for Cognitive Radios
Zhiyong Lin, Hai Liu, Lu Yu +2
Most of existing rendezvous algorithms generate channel-hopping sequences based on the whole channel set. They are inefficient when the set of available channels is a small subset…
Autonomous Vehicle Public Transportation System: Scheduling and Admission Control
Albert Y. S. Lam, Yiu-Wing Leung, Xiaowen Chu
Technology of autonomous vehicles (AVs) is getting mature and many AVs will appear on the roads in the near future. AVs become connected with the support of various vehicular commu…
Electric Vehicle Charging Station Placement: Formulation, Complexity, and Solutions
Albert Y. S. Lam, Yiu-Wing Leung, Xiaowen Chu
To enhance environmental sustainability, many countries will electrify their transportation systems in their future smart city plans. So the number of electric vehicles (EVs) runni…