1 citations · 2 across the 4 of their papers we have counts for
Showing cs.LGShow all
3 papers · 1 filter
cs.LG2022
A Fast Transformer-based General-Purpose Lossless Compressor
Yu Mao, Yufei Cui, Tei-Wei Kuo +1
Deep-learning-based compressor has received interests recently due to much improved compression ratio. However, modern approaches suffer from long execution time. To ease this prob…
cs.LG2021★ 1 cited
Weight Rescaling: Effective and Robust Regularization for Deep Neural Networks with Batch Normalization
Ziquan Liu, Yufei Cui, Jia Wan +2
Weight decay is often used to ensure good generalization in the training practice of deep neural networks with batch normalization (BN-DNNs), where some convolution layers are inva…
cs.LG2021
Variational Nested Dropout
Yufei Cui, Yu Mao, Ziquan Liu +5
Nested dropout is a variant of dropout operation that is able to order network parameters or features based on the pre-defined importance during training. It has been explored for:…