9 citations · 18 across the 17 of their papers we have counts for
Showing 2021Show all
2 papers · 1 filter
cs.LG2021★ 1 cited
Weight Rescaling: Effective and Robust Regularization for Deep Neural Networks with Batch Normalization
Ziquan Liu, Yufei Cui, Jia Wan +2
Weight decay is often used to ensure good generalization in the training practice of deep neural networks with batch normalization (BN-DNNs), where some convolution layers are inva…
cs.LG2021
Variational Nested Dropout
Yufei Cui, Yu Mao, Ziquan Liu +5
Nested dropout is a variant of dropout operation that is able to order network parameters or features based on the pre-defined importance during training. It has been explored for:…