Early-Exit meets Model-Distributed Inference at Edge Networks

Marco Colocrese, Erdem Koyuncu, Hulya Seferoglu

Distributed inference techniques can be broadly classified into data-distributed and model-distributed schemes. In data-distributed inference (DDI), each worker carries the entire…