activity
20182023
most citedA Simple Framework for Contrastive Learning of Visual Representations

7.3k citations · 10k across the 37 of their papers we have counts for

collaborators
Showing 2019Show all

5 papers · 1 filter

cs.CV2019★ 121 cited

The Origins and Prevalence of Texture Bias in Convolutional Neural Networks

Katherine L. Hermann, Ting Chen, Simon Kornblith

Recent work has indicated that, unlike humans, ImageNet-trained CNNs tend to classify images by texture rather than by shape. How pervasive is this bias, and where does it come fro…

cs.CV2019★ 37 cited

Saccader: Improving Accuracy of Hard Attention Models for Vision

Gamaleldin F. Elsayed, Simon Kornblith, Quoc V. Le

Although deep convolutional neural networks achieve state-of-the-art performance across nearly all image classification tasks, their decisions are difficult to interpret. One appro…

cs.LG2019★ 878 cited

When Does Label Smoothing Help?

Rafael Müller, Simon Kornblith, Geoffrey Hinton

The generalization and learning speed of a multi-class neural network can often be significantly improved by using soft targets that are a weighted average of the hard targets and…

cs.CV2019★ 6 cited

Cerberus: A Multi-headed Derenderer

Boyang Deng, Simon Kornblith, Geoffrey Hinton

To generalize to novel visual scenes with new viewpoints and new object poses, a visual system needs representations of the shapes of the parts of an object that are invariant to c…

cs.LG2019★ 430 cited

Similarity of Neural Network Representations Revisited

Simon Kornblith, Mohammad Norouzi, Honglak Lee +1

Recent work has sought to understand the behavior of neural networks by comparing representations between layers and between different trained models. We examine methods for compar…