Decentralized Low-Latency Collaborative Inference via Ensembles on the Edge

May Malka, Erez Farhan, Hai Morgenstern +1

The success of deep neural networks (DNNs) is heavily dependent on computational resources. While DNNs are often employed on cloud servers, there is a growing need to operate DNNs…