Communication-Efficient Separable Neural Network for Distributed Inference on Edge Devices

Jun-Liang Lin, Sheng-De Wang

The inference of Neural Networks is usually restricted by the resources (e.g., computing power, memory, bandwidth) on edge devices. In addition to improving the hardware design and…