Adaptive Inference: Theoretical Limits and Unexplored Opportunities

Soheil Hor, Ying Qian, Mert Pilanci +1

This paper introduces the first theoretical framework for quantifying the efficiency and performance gain opportunity size of adaptive inference algorithms. We provide new approxim…