2 citations · 2 across the 3 of their papers we have counts for
3 papers
cs.CV2022
Learning Low-Rank Representations for Model Compression
Zezhou Zhu, Yucong Zhou, Zhao Zhong
Vector Quantization (VQ) is an appealing model compression method to obtain a tiny model with less accuracy loss. While methods to obtain better codebooks and codes under fixed clu…
cs.CV2021
Learning specialized activation functions with the Piecewise Linear Unit
Yucong Zhou, Zezhou Zhu, Zhao Zhong
The choice of activation functions is crucial for modern deep neural networks. Popular hand-designed activation functions like Rectified Linear Unit(ReLU) and its variants show pro…
cs.LG2021★ 2 cited
FixNorm: Dissecting Weight Decay for Training Deep Neural Networks
Yucong Zhou, Yunxiao Sun, Zhao Zhong
Weight decay is a widely used technique for training Deep Neural Networks(DNN). It greatly affects generalization performance but the underlying mechanisms are not fully understood…