Pipeline Parallelism for Inference on Heterogeneous Edge Computing

Yang Hu, Connor Imes, Xuanang Zhao +4

Deep neural networks with large model sizes achieve state-of-the-art results for tasks in computer vision (CV) and natural language processing (NLP). However, these large-scale mod…