Communication-Aware Model Distributed Inference via Latent Representation Compression

Peyman Gholami, Theodoros-Thirimachos Davarakis, Teng Li +9

We study optimization of distributed model inference over resource-constrained edge resources. We propose a framework that optimizes the trade-off between model accuracy and commun…