2.4k citations · 12.3k across the 115 of their papers we have counts for
13 papers · 1 filter
Understanding Decoupled and Early Weight Decay
Johan Bjorck, Kilian Weinberger, Carla Gomes
Weight decay (WD) is a traditional regularization technique in deep learning, but despite its ubiquity, its behavior is still an area of active research. Golatkar et al. have recen…
Correlator Convolutional Neural Networks: An Interpretable Architecture for Image-like Quantum Matter Data
Cole Miles, Annabelle Bohrdt, Ruihan Wu +7
Machine learning models are a powerful theoretical tool for analyzing data from quantum simulators, in which results of experiments are sets of snapshots of many-body states. Recen…
Harnessing Interpretable and Unsupervised Machine Learning to Address Big Data from Modern X-ray Diffraction
Jordan Venderley, Michael Matty, Krishnanand Mallayya +14
The information content of crystalline materials becomes astronomical when collective electronic behavior and their fluctuations are taken into account. In the past decade, improve…
Deep Co-Training with Task Decomposition for Semi-Supervised Domain Adaptation
Luyu Yang, Yan Wang, Mingfei Gao +4
Semi-supervised domain adaptation (SSDA) aims to adapt models trained from a labeled source domain to a different but related target domain, from which unlabeled data and a small s…
Wasserstein Distances for Stereo Disparity Estimation
Divyansh Garg, Yan Wang, Bharath Hariharan +3
Existing approaches to depth or disparity estimation output a distribution over a set of pre-defined discrete values. This leads to inaccurate results when the true depth or dispar…
Revisiting Few-sample BERT Fine-tuning
Tianyi Zhang, Felix Wu, Arzoo Katiyar +2
This paper is a study of fine-tuning of BERT contextual representations, with focus on commonly observed instabilities in few-sample scenarios. We identify several factors that cau…
Train in Germany, Test in The USA: Making 3D Object Detectors Generalize
Yan Wang, Xiangyu Chen, Yurong You +5
In the domain of autonomous driving, deep learning has substantially improved the 3D object detection accuracy for LiDAR and stereo camera data alike. While deep networks are great…
End-to-End Pseudo-LiDAR for Image-Based 3D Object Detection
Rui Qian, Divyansh Garg, Yan Wang +6
Reliable and accurate 3D object detection is a necessity for safe autonomous driving. Although LiDAR sensors can provide accurate 3D point cloud estimates of the environment, they…
Revisiting Meta-Learning as Supervised Learning
Wei-Lun Chao, Han-Jia Ye, De-Chuan Zhan +2
Recent years have witnessed an abundance of new publications and approaches on meta-learning. This community-wide enthusiasm has sparked great insights but has also created a pleth…
On Feature Normalization and Data Augmentation
Boyi Li, Felix Wu, Ser-Nam Lim +2
The moments (a.k.a., mean and standard deviation) of latent features are often removed as noise when training image recognition models, to increase stability and reduce training ti…
On Hiding Neural Networks Inside Neural Networks
Chuan Guo, Ruihan Wu, Kilian Q. Weinberger
Modern neural networks often contain significantly more parameters than the size of their training data. We show that this excess capacity provides an opportunity for embedding sec…
Convolutional Networks with Dense Connectivity
Gao Huang, Zhuang Liu, Geoff Pleiss +2
Recent work has shown that convolutional networks can be substantially deeper, more accurate, and efficient to train if they contain shorter connections between layers close to the…
Identifying Mislabeled Data using the Area Under the Margin Ranking
Geoff Pleiss, Tianyi Zhang, Ethan R. Elenberg +1
Not all data in a typical training set help with generalization; some samples can be overly ambiguous or outrightly mislabeled. This paper introduces a new method to identify such…