21 citations · 31 across the 3 of their papers we have counts for
3 papers
cs.CL2023★ 6 cited
Outlier Suppression+: Accurate quantization of large language models by equivalent and optimal shifting and scaling
Xiuying Wei, Yunchen Zhang, Yuhang Li +4
Post-training quantization~(PTQ) of transformer language models faces significant challenges due to the existence of detrimental outliers in activations. We observe that these outl…
cs.LG2022★ 4 cited
PIM-QAT: Neural Network Quantization for Processing-In-Memory (PIM) Systems
Qing Jin, Zhiyu Chen, Jian Ren +3
Processing-in-memory (PIM), an increasingly studied neuromorphic hardware, promises orders of energy and throughput improvements for deep learning inference. Leveraging the massive…
cs.CV2022★ 21 cited
F8Net: Fixed-Point 8-bit Only Multiplication for Network Quantization
Qing Jin, Jian Ren, Richard Zhuang +6
Neural network quantization is a promising compression technique to reduce memory footprint and save energy consumption, potentially leading to real-time inference. However, there…