4 papers · 1 filter
MGRQ: Post-Training Quantization For Vision Transformer With Mixed Granularity Reconstruction
Lianwei Yang, Zhikai Li, Junrui Xiao +2
Post-training quantization (PTQ) efficiently compresses vision models, but unfortunately, it accompanies a certain degree of accuracy degradation. Reconstruction methods aim to enh…
EDA-DM: Enhanced Distribution Alignment for Post-Training Quantization of Diffusion Models
Xuewen Liu, Zhikai Li, Junrui Xiao +3
Diffusion models have achieved great success in image generation tasks. However, the lengthy denoising process and complex neural networks hinder their low-latency applications in…
Patch-wise Mixed-Precision Quantization of Vision Transformer
Junrui Xiao, Zhikai Li, Lianwei Yang +1
As emerging hardware begins to support mixed bit-width arithmetic computation, mixed-precision quantization is widely used to reduce the complexity of neural networks. However, Vis…
BinaryViT: Towards Efficient and Accurate Binary Vision Transformers
Junrui Xiao, Zhikai Li, Lianwei Yang +1
Vision Transformers (ViTs) have emerged as the fundamental architecture for most computer vision fields, but the considerable memory and computation costs hinders their application…