CPTQuant - A Novel Mixed Precision Post-Training Quantization Techniques for Large Language Models

Amitash Nanda, Sree Bhargavi Balija, Debashis Sahoo

Large language models have transformed the comprehension and generation of natural language tasks, but they come with substantial memory and computational requirements. Quantizatio…