587 citations · 2.1k across the 58 of their papers we have counts for
1 paper · 1 filter
Nihar Shah, Ben Blier
Distributed training across a wide area network (WAN) is challenging, as continuous parameter exchange by islands of compute is constrained by limited bandwidth, high latency, and…