77 citations · 368 across the 31 of their papers we have counts for
5 papers · 1 filter
CSQ: Growing Mixed-Precision Quantization Scheme with Bi-level Continuous Sparsification
Lirui Xiao, Huanrui Yang, Zhen Dong +3
Mixed-precision quantization has been widely applied on deep neural networks (DNNs) as it leads to significantly better efficiency-accuracy tradeoffs compared to uniform quantizati…
NoisyQuant: Noisy Bias-Enhanced Post-Training Activation Quantization for Vision Transformers
Yijiang Liu, Huanrui Yang, Zhen Dong +3
The complicated architecture and high training cost of vision transformers urge the exploration of post-training quantization. However, the heavy-tailed distribution of vision tran…
Analysis of Quantization on MLP-based Vision Models
Lingran Zhao, Zhen Dong, Kurt Keutzer
Quantization is wildly taken as a model compression technique, which obtains efficient models by converting floating-point weights and activations in the neural network into lower-…
Domain-Adaptive Text Classification with Structured Knowledge from Unlabeled Data
Tian Li, Xiang Chen, Zhen Dong +4
Domain adaptive text classification is a challenging problem for the large-scale pretrained language models because they often require expensive additional labeled data to adapt to…
UnrealNAS: Can We Search Neural Architectures with Unreal Data?
Zhen Dong, Kaicheng Zhou, Guohao Li +5
Neural architecture search (NAS) has shown great success in the automatic design of deep neural networks (DNNs). However, the best way to use data to search network architectures i…