PipeOrgan: Efficient Inter-operation Pipelining with Flexible Spatial Organization and Interconnects

Raveesh Garg, Hyoukjun Kwon, Eric Qin +3

Because of the recent trends in Deep Neural Networks (DNN) models being memory-bound, inter-operator pipelining for DNN accelerators is emerging as a promising optimization. Inter-…