BitSkip: An Empirical Analysis of Quantization and Early Exit Composition in Transformers

Ramshankar Bhuvaneswaran, Handan Liu

The pursuit of efficient Large Language Models (LLMs) has led to increasingly complex techniques like extreme quantization and dynamic routing. While individual benefits of these m…