14 citations · 14 across the 2 of their papers we have counts for
2 papers
cs.LG2021★ 14 cited
Beyond BatchNorm: Towards a Unified Understanding of Normalization in Deep Learning
Ekdeep Singh Lubana, Robert P. Dick, Hidenori Tanaka
Inspired by BatchNorm, there has been an explosion of normalization layers in deep learning. Recent works have identified a multitude of beneficial properties in BatchNorm to expla…
cs.CV2020
OrthoReg: Robust Network Pruning Using Orthonormality Regularization
Ekdeep Singh Lubana, Puja Trivedi, Conrad Hougen +2
Network pruning in Convolutional Neural Networks (CNNs) has been extensively investigated in recent years. To determine the impact of pruning a group of filters on a network's accu…