2 citations · 2 across the 10 of their papers we have counts for
3 papers · 1 filter
AdpQ: A Zero-shot Calibration Free Adaptive Post Training Quantization Method for LLMs
Alireza Ghaffari, Sharareh Younesian, Vahid Partovi Nia +2
The ever-growing computational complexity of Large Language Models (LLMs) necessitates efficient deployment strategies. The current state-of-the-art approaches for Post-training Qu…
OAC: Output-adaptive Calibration for Accurate Post-training Quantization
Ali Edalati, Alireza Ghaffari, Mahsa Ghazvini Nejad +4
Deployment of Large Language Models (LLMs) has major computational costs, due to their rapidly expanding size. Compression of LLMs reduces the memory footprint, latency, and energy…
Mitigating Outlier Activations in Low-Precision Fine-Tuning of Language Models
Alireza Ghaffari, Justin Yu, Mahsa Ghazvini Nejad +3
Low-precision fine-tuning of language models has gained prominence as a cost-effective and energy-efficient approach to deploying large-scale models in various applications. Howeve…