Intrinsic adaptation in autonomous recurrent neural networks

Abstract

A massively recurrent neural network responds on one side to input stimuli and is autonomously active, on the other side, in the absence of sensory inputs. Stimuli and information processing depends crucially on the qualia of the autonomous-state dynamics of the ongoing neural activity. This default neural activity may be dynamically structured in time and space, showing regular, synchronized, bursting or chaotic activity patterns. We study the influence of non-synaptic plasticity on the default dynamical state of recurrent neural networks. The non-synaptic adaption considered acts on intrinsic neural parameters, such as the threshold and the gain, and is driven by the optimization of the information entropy. We observe, in the presence of the intrinsic adaptation processes, three distinct and globally attracting dynamical regimes, a regular synchronized, an overall chaotic and an intermittent bursting regime. The intermittent bursting regime is characterized by intervals of regular flows, which are quite insensitive to external stimuli, interseeded by chaotic bursts which respond sensitively to input signals. We discuss these finding in the context of self-organized information processing and critical brain dynamics.

24 pages, 8 figures

References in corpus (2)

• Emergent complex neural dynamics
• Dynamical synapses causing self-organized criticality in neural networks

Cited by in corpus (9)

• Information driven self-organization of complex robotic behaviors
• The sensorimotor loop as a dynamical system: How regular motion primitives may emerge from self-organized limit cycles
• Generating functionals for computational intelligence: the Fisher information as an objective function for self-limiting Hebbian learning rules
• A versatile class of prototype dynamical systems for complex bifurcation cascades of limit cycles
• Two-trace model for spike-timing-dependent synaptic plasticity
• Attractor metadynamics in terms of target points in slow-fast systems: adiabatic vs. symmetry protected flow in a recurrent neural network
• A Self-Organized Neural Comparator
• An objective function for self-limiting neural plasticity rules
• Generating functionals for autonomous latching dynamics in attractor relict networks