Accuracy is Not All You Need

Abhinav Dutta, Sanjeev Krishnan, Nipun Kwatra +1

When Large Language Models (LLMs) are compressed using techniques such as quantization, the predominant way to demonstrate the validity of such techniques is by measuring the model…