16 citations · 27 across the 3 of their papers we have counts for
3 papers
cs.LG2023★ 16 cited
Dropout Reduces Underfitting
Zhuang Liu, Zhiqiu Xu, Joseph Jin +2
Introduced by Hinton et al. in 2012, dropout has stood the test of time as a regularizer for preventing overfitting in neural networks. In this study, we demonstrate that dropout c…
cs.LG2022★ 8 cited
SDQ: Stochastic Differentiable Quantization with Mixed Precision
Xijie Huang, Zhiqiang Shen, Shichao Li +5
In order to deploy deep models in a computationally efficient manner, model quantization approaches have been frequently used. In addition, as new hardware that supports mixed bitw…
cs.CV2022★ 3 cited
Vision Transformer Slimming: Multi-Dimension Searching in Continuous Optimization Space
Arnav Chavan, Zhiqiang Shen, Zhuang Liu +3
This paper explores the feasibility of finding an optimal sub-model from a vision transformer and introduces a pure vision transformer slimming (ViT-Slim) framework. It can search…