9 citations · 14 across the 8 of their papers we have counts for
8 papers
UCCL-Zip: Lossless Compression Supercharged GPU Communication
Shuang Ma, Chon Lam Lao, Zhiying Xu +8
The rapid growth of large language models (LLMs) has made GPU communication a critical bottleneck. While prior work reduces communication volume via quantization or lossy compressi…
ByteComp: Revisiting Gradient Compression in Distributed Training
Zhuang Wang, Haibin Lin, Yibo Zhu +1
Gradient compression (GC) is a promising approach to addressing the communication bottleneck in distributed deep learning (DDL). However, it is challenging to find the optimal comp…
MXDAG: A Hybrid Abstraction for Cluster Applications
Weitao Wang, Sushovan Das, Xinyu Crystal Wu +3
Distributed applications, such as database queries and distributed training, consist of both compute and network tasks. DAG-based abstraction primarily targets compute tasks and ha…
Efficient and Less Centralized Federated Learning
Li Chou, Zichang Liu, Zhuang Wang +1
With the rapid growth in mobile computing, massive amounts of data and computing resources are now located at the edge. To this end, Federated learning (FL) is becoming a widely ad…
Shufflecast: An Optical, Data-rate Agnostic and Low-Power Multicast Architecture for Next-Generation Compute Clusters
Sushovan Das, Afsaneh Rahbar, Xinyu Crystal Wu +4
An optical circuit-switched network core has the potential to overcome the inherent challenges of a conventional electrical packet-switched core of today's compute clusters. As opt…
MergeComp: A Compression Scheduler for Scalable Communication-Efficient Distributed Training
Zhuang Wang, Xinyu Wu, T. S. Eugene Ng
Large-scale distributed training is increasingly becoming communication bound. Many gradient compression algorithms have been proposed to reduce the communication overhead and impr…
Delay-Energy Joint Optimization for Task Offloading in Mobile Edge Computing
Zhuang Wang, Weifa Liang, Meitian Huang +1
Mobile-edge computing (MEC) has been envisioned as a promising paradigm to meet ever-increasing resource demands of mobile users, prolong battery lives of mobile devices, and short…
Fair Packet Scheduling in Network on Chip
Zhuang Wang, Xiao Lv, Mingyu Yan +2
Interconnection networks of parallel systems are used for servicing traf- fic generated by different applications, often belonging to different users. When multiple traffic flows c…