PTEENet: Post-Trained Early-Exit Neural Networks Augmentation for Inference Cost Optimization

Assaf Lahiany, Yehudit Aperstein

For many practical applications, a high computational cost of inference over deep network architectures might be unacceptable. A small degradation in the overall inference accuracy…