A sparse coding model with synaptically local plasticity and spiking neurons can account for the diverse shapes of V1 simple cell receptive fields

Abstract

Sparse coding algorithms trained on natural images can accurately predict the features that excite visual cortical neurons, but it is not known whether such codes can be learned using biologically realistic plasticity rules. We have developed a biophysically motivated spiking network, relying solely on synaptically local information, that can predict the full diversity of V1 simple cell receptive field shapes when trained on natural images. This represents the first demonstration that sparse coding principles, operating within the constraints imposed by cortical architecture, can successfully reproduce these receptive fields. We further prove, mathematically, that sparseness and decorrelation are the key ingredients that allow for synaptically local plasticity rules to optimize a cooperative, linear generative image model formed by the neural representation. Finally, we discuss several interesting emergent properties of our network, with the intent of bridging the gap between theoretical and experimental studies of visual cortex.

33 pages, 6 figures. To appear in PLoS Computational Biology. Some of these data were presented by author JZ at the 2011 CoSyNe meeting in Salt Lake City

Cited by in corpus (34)

• Deep Learning in Spiking Neural Networks
• The Heidelberg spiking datasets for the systematic evaluation of spiking neural networks
• Diversity in Machine Learning
• Biologically plausible deep learning -- but how far can we go with shallow networks?
• Bottom-up and top-down approaches for the design of neuromorphic processing systems: Tradeoffs and synergies between natural and artificial intelligence
• Nonlinear Hebbian learning as a unifying principle in receptive field formation
• Bio-Inspired Spiking Convolutional Neural Network using Layer-wise Sparse Coding and STDP Learning
• Representation Learning using Event-based STDP
• Input nonlinearities can shape beyond-pairwise correlations and improve information transmission by neural populations
• A Hebbian/Anti-Hebbian Network for Online Sparse Dictionary Learning Derived from Symmetric Matrix Factorization
• Sparse Coding by Spiking Neural Networks: Convergence Theory and Computational Results
• Statistical Physics and Representations in Real and Artificial Neural Networks
• Fast and Accurate Sparse Coding of Visual Stimuli with a Simple, Ultra-Low-Energy Spiking Architecture
• Replicating Kernels with a Short Stride Allows Sparse Reconstructions with Fewer Independent Kernels
• GP-select: Accelerating EM using adaptive subspace preselection
• N-Omniglot, a large-scale neuromorphic dataset for spatio-temporal sparse few-shot learning
• Memcapacitive Devices in Logic and Crossbar Applications
• GAIT-prop: A biologically plausible learning rule derived from backpropagation of error
• Exploitation of Image Statistics with Sparse Coding in the Case of Stereo Vision
• Dead leaves and the dirty ground: low-level image statistics in transmissive and occlusive imaging environments
• Sparse models for Computer Vision
• Faster Convergence in Deep-Predictive-Coding Networks to Learn Deeper Representations
• Learning Features and their Transformations by Spatial and Temporal Spherical Clustering
• Dictionary Learning by Dynamical Neural Networks
• Learning Sparse, Distributed Representations using the Hebbian Principle
• Do the receptive fields in the primary visual cortex span a variability over the degree of elongation of the receptive fields?
• Local Information with Feedback Perturbation Suffices for Dictionary Learning in Neural Circuits
• Compositional Factorization of Visual Scenes with Convolutional Sparse Coding and Resonator Networks
• Two "correlation games" for a nonlinear network with Hebbian excitatory neurons and anti-Hebbian inhibitory neurons
• Improving Spiking Sparse Recovery via Non-Convex Penalties
• Signal Coding and Perfect Reconstruction using Spike Trains
• Predictive coding in area V4: dynamic shape discrimination under partial occlusion
• A Normative and Biologically Plausible Algorithm for Independent Component Analysis
• Correlation-invariant synaptic plasticity