activity
20122022
most citedDistilling the Knowledge in a Neural Network

14.1k citations · 34.6k across the 53 of their papers we have counts for

collaborators
Showing 2019Show all

10 papers · 1 filter

cs.CV2019★ 20 cited

NASA: Neural Articulated Shape Approximation

Boyang Deng, JP Lewis, Timothy Jeruzalski +4

Efficient representation of articulated objects such as human bodies is an important problem in computer vision and graphics. To efficiently simulate deformation, existing approach…

cs.CV2019★ 7 cited

CvxNet: Learnable Convex Decomposition

Boyang Deng, Kyle Genova, Soroosh Yazdani +3

Any solid object can be decomposed into a collection of convex polytopes (in short, convexes). When a small number of convexes are used, such a decomposition can be thought of as a…

cs.LG2019★ 372 cited

Lookahead Optimizer: k steps forward, 1 step back

Michael R. Zhang, James Lucas, Geoffrey Hinton +1

The vast majority of successful deep neural networks are trained using variants of stochastic gradient descent (SGD) algorithms. Recent attempts to improve SGD can be broadly categ…

cs.LG2019★ 54 cited

Detecting and Diagnosing Adversarial Images with Class-Conditional Capsule Reconstructions

Yao Qin, Nicholas Frosst, Sara Sabour +3

Adversarial examples raise questions about whether neural network models are sensitive to the same visual features as humans. In this paper, we first detect adversarial examples or…

stat.ML2019★ 35 cited

Stacked Capsule Autoencoders

Adam R. Kosiorek, Sara Sabour, Yee Whye Teh +1

Objects are composed of a set of geometrically organized parts. We introduce an unsupervised capsule autoencoder (SCAE), which explicitly uses geometric relationships between parts…

cs.LG2019★ 878 cited

When Does Label Smoothing Help?

Rafael Müller, Simon Kornblith, Geoffrey Hinton

The generalization and learning speed of a multi-class neural network can often be significantly improved by using soft targets that are a weighted average of the hard targets and…