27 citations · 78 across the 12 of their papers we have counts for
Showing 2022Show all
3 papers · 1 filter
cs.LG2022★ 1 cited
Accelerating Parallel Stochastic Gradient Descent via Non-blocking Mini-batches
Haoze He, Parijat Dube
SOTA decentralized SGD algorithms can overcome the bandwidth bottleneck at the parameter server by using communication collectives like Ring All-Reduce for synchronization. While t…
cs.LG2022
RCD-SGD: Resource-Constrained Distributed SGD in Heterogeneous Environment via Submodular Partitioning
Haoze He, Parijat Dube
The convergence of SGD based distributed training algorithms is tied to the data distribution across workers. Standard partitioning techniques try to achieve equal-sized partitions…
cs.LG2022
G2L: A Geometric Approach for Generating Pseudo-labels that Improve Transfer Learning
John R. Kender, Bishwaranjan Bhattacharjee, Parijat Dube +1
Transfer learning is a deep-learning technique that ameliorates the problem of learning when human-annotated labels are expensive and limited. In place of such labels, it uses inst…