5 citations · 7 across the 3 of their papers we have counts for
3 papers
cs.CV2022★ 2 cited
Guidelines for the Regularization of Gammas in Batch Normalization for Deep Residual Networks
Bum Jun Kim, Hyeyeon Choi, Hyeonah Jang +3
L2 regularization for weights in neural networks is widely used as a standard training trick. However, L2 regularization for gamma, a trainable parameter of batch normalization, re…
cs.CV2021
Improved Robustness of Vision Transformer via PreLayerNorm in Patch Embedding
Bum Jun Kim, Hyeyeon Choi, Hyeonah Jang +3
Vision transformers (ViTs) have recently demonstrated state-of-the-art performance in a variety of vision tasks, replacing convolutional neural networks (CNNs). Meanwhile, since Vi…
cs.CV2021★ 5 cited
Dead Pixel Test Using Effective Receptive Field
Bum Jun Kim, Hyeyeon Choi, Hyeonah Jang +3
Deep neural networks have been used in various fields, but their internal behavior is not well known. In this study, we discuss two counterintuitive behaviors of convolutional neur…