DPU or GPU for Accelerating Neural Networks Inference -- Why not both? Split CNN Inference

Ali Emre Oztas, Mahir Demir, James Garside +1

Video and image streaming on edge devices requires low latency. To address this, Neural Networks (NNs) are widely used, and prior work mainly focuses on accelerating them with sing…