STT-SNN: A Spin-Transfer-Torque Based Soft-Limiting Non-Linear Neuron for Low-Power Artificial Neural Networks
arXiv:1412.8648 · doi:10.1109/TNANO.2015.2437902
Abstract
Recent years have witnessed growing interest in the use of Artificial Neural Networks (ANNs) for vision, classification, and inference problems. An artificial neuron sums N weighted inputs and passes the result through a non-linear transfer function. Large-scale ANNs impose very high computing requirements for training and classification, leading to great interest in the use of post-CMOS devices to realize them in an energy efficient manner. In this paper, we propose a spin-transfer-torque (STT) device based on Domain Wall Motion (DWM) magnetic strip that can efficiently implement a Soft-limiting Non-linear Neuron (SNN) operating at ultra-low supply voltage and current. In contrast to previous spin-based neurons that can only realize hard-limiting transfer functions, the proposed STT-SNN displays a continuous resistance change with varying input current, and can therefore be employed to implement a soft-limiting neuron transfer function. Soft-limiting neurons are greatly preferred to hard-limiting ones due to their much improved modeling capacity, which leads to higher network accuracy and lower network complexity. We also present an ANN hardware design employing the proposed STT-SNNs and Memristor Crossbar Arrays (MCA) as synapses. The ultra-low voltage operation of the magneto metallic STT-SNN enables the programmable MCA-synapses, computing analog-domain weighted summation of input voltages, to also operate at ultra-low voltage. We modeled the STT-SNN using micro-magnetic simulation and evaluated them using an ANN for character recognition. Comparisons with analog and digital CMOS neurons show that STT-SNNs can achieve more than two orders of magnitude lower energy consumption.
arXiv commentThis paper was submitted to IEEE Transactions on Nanotechnology for review
References in corpus (8)
- The design and verification of Mumax3
- Direct observation of domain-wall configurations transformed by spin currents
- Spin-Based Neuron Model with Domain Wall Magnets as Synapse
- Vertical current induced domain wall motion in MgO-based magnetic tunnel junction with low current densities
- Spin Neurons: A Possible Path to Energy-Efficient Neuromorphic Computers
- Hierarchical Temporal Memory Based on Spin-Neurons and Resistive Memory for Energy-Efficient Brain-Inspired Computing
- Current-excited magnetization dynamics in narrow ferromagnetic wires
- Design and Synthesis of Ultra Low Energy Spin-Memristor Threshold Logic
Cited by in corpus (8)
- Recent progress and challenges in magnetic tunnel junctions with 2D materials for spintronic applications
- Magnetic Skyrmions for Unconventional Computing
- Magnetic domain wall based synaptic and activation function generator for neuromorphic accelerators
- Probabilistic Deep Spiking Neural Systems Enabled by Magnetic Tunnel Junction
- Spin-Orbit-Torque-based Devices, Circuits and Architectures
- Efficiency-driven Hardware Optimization for Adversarially Robust Neural Networks
- SwitchX: Gmin-Gmax Switching for Energy-Efficient and Robust Implementation of Binary Neural Networks on ReRAM Xbars
- Moiré spintronics: Emergent phenomena, material realization and machine learning accelerating discovery