Learning as a phenomenon occurring in a critical state
arXiv:1003.1200 · doi:10.1073/pnas.0912289107
Abstract
Recent physiological measurements have provided clear evidence about scale-free avalanche brain activity and EEG spectra, feeding the classical enigma of how such a chaotic system can ever learn or respond in a controlled and reproducible way. Models for learning, like neural networks or perceptrons, have traditionally avoided strong fluctuations. Conversely, we propose that brain activity having features typical of systems at a critical point, represents a crucial ingredient for learning. We present here a study which provides novel insights toward the understanding of the problem. Our model is able to reproduce quantitatively the experimentally observed critical state of the brain and, at the same time, learns and remembers logical rules including the exclusive OR (XOR), which has posed difficulties to several previous attempts. We implement the model on a network with topological properties close to the functionality network in real brains. Learning occurs via plastic adaptation of synaptic strengths and exhibits universal features. We find that the learning performance and the average time required to learn are controlled by the strength of plastic adaptation, in a way independent of the specific task assigned to the system. Even complex rules can be learned provided that the plastic adaptation is sufficiently slow.
5 pages, 5 figures
References in corpus (3)
Cited by in corpus (30)
- Emergent complex neural dynamics
- Colloquium: Criticality and dynamical scaling in living systems
- A small-world of weak ties provides optimal global integration of self-similar modules in functional brain networks
- Quasi-Critical Brain Dynamics on a Non-Equilibrium Widom Line
- Self-organization toward criticality by synaptic plasticity
- Neural Avalanches at the Critical Point between Replay and Non-Replay of Spatiotemporal Patterns
- Theoretical foundations of studying criticality in the brain
- Brain modularity controls the critical behavior of spontaneous activity
- Avalanches in self-organized critical neural networks: A minimal model for the neural SOC universality class
- Self-Organized Supercriticality and Oscillations in Networks of Stochastic Spiking Neurons
- Optimal percentage of inhibitory synapses in multi-task learning
- Critical neural networks with short and long term plasticity
- Auditory power-law activation-avalanches exhibit a fundamental computational ground-state
- Self-organized criticality in neural networks from activity-based rewiring
- Neuronal avalanches of a self-organized neural network with active-neuron-dominant structure
- Spatial features of synaptic adaptation affecting learning performance
- Information processing occurs via critical avalanches in a model of the primary visual cortex
- Coexistence of scale invariant and rhythmic behavior in self-organized criticality
- Scale-free behavior of weight distributions of connectomes
- Learning with a network of competing synapses
- Balanced Information Storage and Transfer in Modular Spiking Neural Networks
- Slow synaptic dynamics in a network: from exponential to power-law forgetting
- On the role of anaxonic local neurons in the crossover to continuously varying exponents for avalanche activity
- Criticality at work: scaling in the mouse cortex enhances performance
- The effect of retardation in the random networks of excitable nodes embeddable in the Euclidean space
- Storing and retrieving long-term memories: cooperation and competition in synaptic dynamics
- Criticality, stability, competition, and consolidation of new representations in brain networks
- Extreme value theory of evolving phenomena in complex dynamical systems: firing cascades in a model of neural network
- A decaying factor accounts for contained activity in neuronal networks with no need of hierarchical or modular organization
- Letting the Brain Speak for itself