Not All Frames Are Equal:Difference-Aware Quantization for Ultra-Low-Bit ASR

Woori Jeon, Jungmin So

Post-training quantization (PTQ) methods such as GPTQ and AWQ compress large language models effectively, but applying them to automatic speech recognition (ASR) at ultra-low bit-w…