Convolutional Neural Networks as a Model of the Visual System: Past, Present, and Future

Abstract

Convolutional neural networks (CNNs) were inspired by early findings in the study of biological vision. They have since become successful tools in computer vision and state-of-the-art models of both neural activity and behavior on visual tasks. This review highlights what, in the context of CNNs, it means to be a good model in computational neuroscience and the various ways models can provide insight. Specifically, it covers the origins of CNNs and the methods by which we validate them as models of biological vision. It then goes on to elaborate on what we can learn about biological vision by understanding and experimenting on CNNs and discusses emerging opportunities for the use of CNNS in vision research beyond basic object recognition.

Review Article to be published in Journal of Cognitive Neuroscience, 18 pages, 5 figures plus 8 pages of references

References in corpus (10)

• Towards Explainable Artificial Intelligence
• Neural network models and deep learning - a primer for biologists
• Similarity of Neural Network Representations Revisited
• Deep Learning Models of the Retinal Response to Natural Scenes
• Local Aggregation for Unsupervised Learning of Visual Embeddings
• Attentional Neural Network: Feature Selection Using Cognitive Feedback
• Visual pathways from the perspective of cost functions and multi-task deep neural networks
• What does it mean to understand a neural network?
• KerCNNs: biologically inspired lateral connections for classification of corrupted images
• The functional role of cue-driven feature-based feedback in object recognition

Cited by in corpus (15)

• Detecting Visual Design Principles in Art and Architecture through Deep Convolutional Neural Networks
• A Spiking Neural Network for Image Segmentation
• Improving deep learning with prior knowledge and cognitive models: A survey on enhancing explainability, adversarial robustness and zero-shot learning
• Spiking Hyperdimensional Network: Neuromorphic Models Integrated with Memory-Inspired Framework
• If deep learning is the answer, then what is the question?
• High-performance Evolutionary Algorithms for Online Neuron Control
• Inconsistent illusory motion in predictive coding deep neural networks
• Attention module improves both performance and interpretability of 4D fMRI decoding neural network
• Supervised dimensionality reduction by a Linear Discriminant Analysis on pre-trained CNN features
• Deep Spiking Neural Networks with Resonate-and-Fire Neurons
• Immuno-mimetic Deep Neural Networks (Immuno-Net)
• Robust 3D U-Net Segmentation of Macular Holes
• Understanding top-down attention using task-oriented ablation design
• How saccadic vision might help with theinterpretability of deep networks
• Understanding Attention: In Minds and Machines