2.4k citations · 12.3k across the 115 of their papers we have counts for
6 papers · 2 filters
Understanding Decoupled and Early Weight Decay
Johan Bjorck, Kilian Weinberger, Carla Gomes
Weight decay (WD) is a traditional regularization technique in deep learning, but despite its ubiquity, its behavior is still an area of active research. Golatkar et al. have recen…
Revisiting Meta-Learning as Supervised Learning
Wei-Lun Chao, Han-Jia Ye, De-Chuan Zhan +2
Recent years have witnessed an abundance of new publications and approaches on meta-learning. This community-wide enthusiasm has sparked great insights but has also created a pleth…
On Feature Normalization and Data Augmentation
Boyi Li, Felix Wu, Ser-Nam Lim +2
The moments (a.k.a., mean and standard deviation) of latent features are often removed as noise when training image recognition models, to increase stability and reduce training ti…
On Hiding Neural Networks Inside Neural Networks
Chuan Guo, Ruihan Wu, Kilian Q. Weinberger
Modern neural networks often contain significantly more parameters than the size of their training data. We show that this excess capacity provides an opportunity for embedding sec…
Convolutional Networks with Dense Connectivity
Gao Huang, Zhuang Liu, Geoff Pleiss +2
Recent work has shown that convolutional networks can be substantially deeper, more accurate, and efficient to train if they contain shorter connections between layers close to the…
Identifying Mislabeled Data using the Area Under the Margin Ranking
Geoff Pleiss, Tianyi Zhang, Ethan R. Elenberg +1
Not all data in a typical training set help with generalization; some samples can be overly ambiguous or outrightly mislabeled. This paper introduces a new method to identify such…