Pareto-Optimal Bit Allocation for Collaborative Intelligence

Abstract

In recent studies, collaborative intelligence (CI) has emerged as a promising framework for deployment of Artificial Intelligence (AI)-based services on mobile/edge devices. In CI, the AI model (a deep neural network) is split between the edge and the cloud, and intermediate features are sent from the edge sub-model to the cloud sub-model. In this paper, we study bit allocation for feature coding in multi-stream CI systems. We model task distortion as a function of rate using convex surfaces similar to those found in distortion-rate theory. Using such models, we are able to provide closed-form bit allocation solutions for single-task systems and scalarized multi-task systems. Moreover, we provide analytical characterization of the full Pareto set for 2-stream k-task systems, and bounds on the Pareto set for 3-stream 2-task systems. Analytical results are examined on a variety of DNN models from the literature to demonstrate wide applicability of the results

References in corpus (2)

• Very Deep Convolutional Networks for Large-Scale Image Recognition
• Lightweight compression of neural network feature tensors for collaborative intelligence

Cited by in corpus (7)

• Scalable Image Coding for Humans and Machines
• Edge-Cloud Collaborative Computing on Distributed Intelligence and Model Optimization: A Survey
• Video Coding for Machine: Compact Visual Representation Compression for Intelligent Collaborative Analytics
• Semantic Edge Computing and Semantic Communications in 6G Networks: A Unifying Survey and Research Challenges
• ACE: Towards Application-Centric Edge-Cloud Collaborative Intelligence
• Analysis of Latent-Space Motion for Collaborative Intelligence
• DFTS2: Simulating Deep Feature Transmission Over Packet Loss Channels