Neuromorphic electronic circuits for building autonomous cognitive systems

Abstract

Several analog and digital brain-inspired electronic systems have been recently proposed as dedicated solutions for fast simulations of spiking neural networks. While these architectures are useful for exploring the computational properties of large-scale models of the nervous system, the challenge of building low-power compact physical artifacts that can behave intelligently in the real-world and exhibit cognitive abilities still remains open. In this paper we propose a set of neuromorphic engineering solutions to address this challenge. In particular, we review neuromorphic circuits for emulating neural and synaptic dynamics in real-time and discuss the role of biophysically realistic temporal dynamics in hardware neural processing architectures; we review the challenges of realizing spike-based plasticity mechanisms in real physical systems and present examples of analog electronic circuits that implement them; we describe the computational properties of recurrent neural networks and show how neuromorphic Winner-Take-All circuits can implement working-memory and decision-making mechanisms. We validate the neuromorphic approach proposed with experimental results obtained from our own circuits and systems, and argue how the circuits and networks presented in this work represent a useful set of components for efficiently and elegantly implementing neuromorphic cognition.

Submitted to Proceedings of IEEE, spiking neural network implementations in full custom VLSI

References in corpus (2)

• Six networks on a universal neuromorphic computing substrate
• A Neuromorphic VLSI Design for Spike Timing and Rate Based Synaptic Plasticity

Cited by in corpus (63)

• Memory and information processing in neuromorphic systems
• A scalable multi-core architecture with heterogeneous memory structures for Dynamic Neuromorphic Asynchronous Processors (DYNAPs)
• Synaptic Plasticity Dynamics for Deep Continuous Local Learning (DECOLLE)
• Neuromorphic Deep Learning Machines
• Hardware Implementation of Deep Network Accelerators Towards Healthcare and Biomedical Applications
• An electronic neuromorphic system for real-time detection of High Frequency Oscillations (HFOs) in intracranial EEG
• Real-time ultra-low power ECG anomaly detection using an event-driven neuromorphic processor
• An Accelerated LIF Neuronal Network Array for a Large Scale Mixed-Signal Neuromorphic Architecture
• A recipe for creating ideal hybrid memristive-CMOS neuromorphic computing systems
• Hybrid Spintronic-CMOS Spiking Neural Network With On-Chip Learning: Devices, Circuits and Systems
• Ultra-Low-Power FDSOI Neural Circuits for Extreme-Edge Neuromorphic Intelligence
• A neuromorphic systems approach to in-memory computing with non-ideal memristive devices: From mitigation to exploitation
• Unsupervised Heart-rate Estimation in Wearables With Liquid States and A Probabilistic Readout
• Synchronization dynamics on the picosecond timescale in coupled Josephson junction neurons
• The importance of space and time in neuromorphic cognitive agents
• Parameter Optimization and Learning in a Spiking Neural Network for UAV Obstacle Avoidance targeting Neuromorphic Processors
• Differential Evolution and Bayesian Optimisation for Hyper-Parameter Selection in Mixed-Signal Neuromorphic Circuits Applied to UAV Obstacle Avoidance
• An event-based architecture for solving constraint satisfaction problems
• Dynamical learning of dynamics
• A Nanoscale Room-Temperature Multilayer Skyrmionic Synapse for Deep Spiking Neural Networks
• Closed-loop spiking control on a neuromorphic processor implemented on the iCub
• A differential memristive synapse circuit for on-line learning in neuromorphic computing systems
• Tutorial: Neuromorphic spiking neural networks for temporal learning
• An Ultralow Leakage Synaptic Scaling Homeostatic Plasticity Circuit With Configurable Time Scales up to 100 ks
• Optoelectronic Intelligence
• An ultra-low-power sigma-delta neuron circuit
• ETLP: Event-based Three-factor Local Plasticity for online learning with neuromorphic hardware
• Integration of Neuromorphic AI in Event-Driven Distributed Digitized Systems: Concepts and Research Directions
• Integrated-photonic characterization of single-photon detectors for use in neuromorphic synapses
• Robust neuromorphic coupled oscillators for adaptive pacemakers
• Synaptic Delays for Temporal Feature Detection in Dynamic Neuromorphic Processors
• Neuromorphic analog circuits for robust on-chip always-on learning in spiking neural networks
• Visual Pattern Recognition with on On-chip Learning: towards a Fully Neuromorphic Approach
• Tunable Synaptic Working Memory with Volatile Memristive Devices
• Gradient-descent hardware-aware training and deployment for mixed-signal Neuromorphic processors
• Visual Odometry with Neuromorphic Resonator Networks
• Dimensions of Timescales in Neuromorphic Computing Systems
• Organic log-domain integrator synapse
• Neuromorphic Heart Rate Monitors: Neural State Machines for Monotonic Change Detection
• Spike-based computation using classical recurrent neural networks
• Integrate-and-fire circuit for converting analog signals to spikes using phase encoding
• Digital Multiplier-less Event-Driven Spiking Neural Network Architecture for Learning a Context-Dependent Task
• Sparse Spiking Gradient Descent
• Distributed Representations Enable Robust Multi-Timescale Symbolic Computation in Neuromorphic Hardware
• Building time-surfaces by exploiting the complex volatility of an ECRAM memristor
• Scaling mixed-signal neuromorphic processors to 28 nm FD-SOI technologies
• Control of the Correlation of Spontaneous Neuron Activity in Biological and Noise-activated CMOS Artificial Neural Microcircuits
• One-Shot Federated Learning with Neuromorphic Processors
• Spatiotemporal Pattern Recognition in Single Mixed-Signal VLSI Neurons with Heterogeneous Dynamic Synapses
• Synaptic Integration of Spatiotemporal Features with a Dynamic Neuromorphic Processor
• A Realistic Simulation Framework for Analog/Digital Neuromorphic Architectures
• Continuous signal sparse encoding using analog neuromorphic variability
• Mapping high-performance RNNs to in-memory neuromorphic chips
• A feedback control optimizer for online and hardware-aware training of Spiking Neural Networks
• Experimental Body-input Three-stage DC offset Calibration Scheme for Memristive Crossbar
• Harnessing Slow Dynamics in Neuromorphic Computation
• Current-mode Memristor Crossbars for Neuromemristive Systems
• An error-propagation spiking neural network compatible with neuromorphic processors
• Artificial Retina Using A Hybrid Neural Network With Spatial Transform Capability
• Triplet Spike Time Dependent Plasticity: A floating-gate Implementation
• Automatic gain control of ultra-low leakage synaptic scaling homeostatic plasticity circuits
• 2022 Roadmap on Neuromorphic Computing and Engineering
• Racing to Learn: Statistical Inference and Learning in a Single Spiking Neuron with Adaptive Kernels