119 citations · 884 across the 130 of their papers we have counts for
6 papers · 1 filter
Prediction-Assisted Online Distributed Deep Learning Workload Scheduling in GPU Clusters
Ziyue Luo, Jia Liu, Myungjin Lee +1
The recent explosive growth of deep learning (DL) models has necessitated a compelling need for efficient job scheduling for distributed deep learning training with mixed paralleli…
Fundamental Limits of Approximate Gradient Coding
Sinong Wang, Jiashang Liu, Ness Shroff
It has been established that when the gradient coding problem is distributed among servers, the computation load (number of stored data partitions) of each worker is at least $…
Flexible Load Balancing with Multi-dimensional State-space Collapse: Throughput and Heavy-traffic Delay Optimality
Xingyu Zhou, Jian Tan, Ness Shroff
Heavy traffic analysis for load balancing policies has relied heavily on the condition of state-space collapse onto a single-dimensional line in previous works. In this paper, via…
Coded Sparse Matrix Multiplication
Sinong Wang, Jiashang Liu, Ness Shroff
In a large-scale and distributed matrix multiplication problem , where , the coded computation plays an important role to effectively…
Designing Low-Complexity Heavy-Traffic Delay-Optimal Load Balancing Schemes: Theory to Algorithms
Xingyu Zhou, Fei Wu, Jian Tan +2
We establish a unified analytical framework for load balancing systems, which allows us to construct a general class of policies that are both throughput optimal and heavy-traf…
Provably Delay Efficient Data Retrieving in Storage Clouds
Yin Sun, Zizhan Zheng, C. Emre Koksal +2
One key requirement for storage clouds is to be able to retrieve data quickly. Recent system measurements have shown that the data retrieving delay in storage clouds is highly vari…