Crowding Reveals Fundamental Differences in Local vs. Global Processing in Humans and Machines

Abstract

Feedforward Convolutional Neural Networks (ffCNNs) have become state-of-the-art models both in computer vision and neuroscience. However, human-like performance of ffCNNs does not necessarily imply human-like computations. Previous studies have suggested that current ffCNNs do not make use of global shape information. However, it is currently unclear whether this reflects fundamental differences between ffCNN and human processing or is merely an artefact of how ffCNNs are trained. Here, we use visual crowding as a well-controlled, specific probe to test global shape computations. Our results provide evidence that ffCNNs cannot produce human-like global shape computations for principled architectural reasons. We lay out approaches that may address shortcomings of ffCNNs to provide better models of the human visual system.

References in corpus (7)

• Adam: A Method for Stochastic Optimization
• Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
• Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs)
• Deep Predictive Coding Networks for Video Prediction and Unsupervised Learning
• Recurrent computations for visual pattern completion
• Task-Driven Convolutional Recurrent Models of the Visual System
• PsyPhy: A Psychophysics Driven Evaluation Framework for Visual Recognition

Cited by in corpus (4)

• Going in circles is the way forward: the role of recurrence in visual inference
• Emergent Properties of Foveated Perceptual Systems
• Inconsistent illusory motion in predictive coding deep neural networks
• On the contrast-dependence of crowding