4 papers
Self-supervised learning through the eyes of a child
A. Emin Orhan, Vaibhav V. Gupta, Brenden M. Lake
Within months of birth, children develop meaningful expectations about the world around them. How much of this early knowledge can be explained through generic learning mechanisms…
Robustness properties of Facebook's ResNeXt WSL models
A. Emin Orhan
We investigate the robustness properties of ResNeXt class image recognition models trained with billion scale weakly supervised data (ResNeXt WSL models). These models, recently ma…
Improving the robustness of ImageNet classifiers using elements of human visual cognition
A. Emin Orhan, Brenden M. Lake
We investigate the robustness properties of image recognition models equipped with two features inspired by human vision, an explicit episodic memory and a shape bias, at the Image…
Improved memory in recurrent neural networks with sequential non-normal dynamics
A. Emin Orhan, Xaq Pitkow
Training recurrent neural networks (RNNs) is a hard problem due to degeneracies in the optimization landscape, a problem also known as vanishing/exploding gradients. Short of desig…