Leveraging Stochastic Depth Training for Adaptive Inference

Guilherme Korol, Antonio Carlos Schneider Beck, Jeronimo Castrillon

Dynamic DNN optimization techniques such as layer-skipping offer increased adaptability and efficiency gains but can lead to i) a larger memory footprint as in decision gates, ii)…