6 citations · 19 across the 34 of their papers we have counts for
Showing 2023Show all
2 papers · 1 filter
cs.LG2023
RobustMQ: Benchmarking Robustness of Quantized Models
Yisong Xiao, Aishan Liu, Tianyuan Zhang +3
Quantization has emerged as an essential technique for deploying deep neural networks (DNNs) on devices with limited resources. However, quantized models exhibit vulnerabilities wh…
cs.CL2023★ 6 cited
Outlier Suppression+: Accurate quantization of large language models by equivalent and optimal shifting and scaling
Xiuying Wei, Yunchen Zhang, Yuhang Li +4
Post-training quantization~(PTQ) of transformer language models faces significant challenges due to the existence of detrimental outliers in activations. We observe that these outl…