Adaptive Deep Neural Network Inference Optimization with EENet

Fatih Ilhan, Ka-Ho Chow, Sihao Hu +9

Well-trained deep neural networks (DNNs) treat all test samples equally during prediction. Adaptive DNN inference with early exiting leverages the observation that some test exampl…