Cooperative Inference with Interleaved Operator Partitioning for CNNs

Zhibang Liu, Chaonong Xu, Zhizhuo Liu +3

Deploying deep learning models on Internet of Things (IoT) devices often faces challenges due to limited memory resources and computing capabilities. Cooperative inference is an im…