6 citations · 42 across the 15 of their papers we have counts for
6 papers · 1 filter
Demystifying Why Local Aggregation Helps: Convergence Analysis of Hierarchical SGD
Jiayi Wang, Shiqiang Wang, Rong-Rong Chen +1
Hierarchical SGD (H-SGD) has emerged as a new distributed SGD algorithm for multi-level communication networks. In H-SGD, before each global aggregation, workers send their updated…
FLCD: A Flexible Low Complexity Design of Coded Distributed Computing
Nicholas Woolsey, Xingyue Wang, Rong-Rong Chen +1
We propose a flexible low complexity design (FLCD) of coded distributed computing (CDC) with empirical evaluation on Amazon Elastic Compute Cloud (Amazon EC2). CDC can expedite Map…
Coded Elastic Computing on Machines with Heterogeneous Storage and Computation Speed
Nicholas Woolsey, Rong-Rong Chen, Mingyue Ji
We study the optimal design of heterogeneous Coded Elastic Computing (CEC) where machines have varying computation speeds and storage. CEC introduced by Yang et al. in 2018 is a fr…
A Combinatorial Design for Cascaded Coded Distributed Computing on General Networks
Nicholas Woolsey, Rong-Rong Chen, Mingyue Ji
Coding theoretic approached have been developed to significantly reduce the communication load in modern distributed computing system. In particular, coded distributed computing (C…
A New Combinatorial Coded Design for Heterogeneous Distributed Computing
Nicholas Woolsey, Rong-Rong Chen, Mingyue Ji
Coded Distributed Computing (CDC) introduced by Li et al. in 2015 offers an efficient approach to trade computing power to reduce the communication load in general distributed comp…
Heterogeneous Computation Assignments in Coded Elastic Computing
Nicholas Woolsey, Rong-Rong Chen, Mingyue Ji
We study the optimal design of a heterogeneous coded elastic computing (CEC) network where machines have varying relative computation speeds. CEC introduced by Yang {\it et al.} is…