Interpreting the Effects of Quantization on LLMs

Manpreet Singh, Hassan Sajjad

Quantization offers a practical solution to deploy LLMs in resource-constraint environments. However, its impact on internal representations remains understudied, raising questions…