SQUAD: Scalable Quorum Adaptive Decisions via ensemble of early exit neural networks

Matteo Gambella, Fabrizio Pittorino, Giuliano Casale +1

Early-exit neural networks have become popular for reducing inference latency by allowing intermediate predictions when sufficient confidence is achieved. However, standard approac…