Oh! We Freeze: Improving Quantized Knowledge Distillation via Signal Propagation Analysis for Large Language Models

Kartikeya Bhardwaj, Nilesh Prasad Pandey, Sweta Priyadarshi +3

Large generative models such as large language models (LLMs) and diffusion models have revolutionized the fields of NLP and computer vision respectively. However, their slow infere…