145 citations · 172 across the 5 of their papers we have counts for
Showing 2018 · cs.DCShow all
2 papers · 2 filters
cs.DC2018★ 145 cited
Supporting Very Large Models using Automatic Dataflow Graph Partitioning
Minjie Wang, Chien-chin Huang, Jinyang Li
This paper presents Tofu, a system that partitions very large DNN models across multiple GPU devices to reduce per-GPU memory footprint. Tofu is designed to partition a dataflow gr…
cs.DC2018★ 13 cited
Unifying Data, Model and Hybrid Parallelism in Deep Learning via Tensor Tiling
Minjie Wang, Chien-chin Huang, Jinyang Li
Deep learning systems have become vital tools across many fields, but the increasing model sizes mean that training must be accelerated to maintain such systems' utility. Current s…