Reliability of Neural Networks Based on Spintronic Neurons
arXiv:2106.16043 · doi:10.1109/LMAG.2021.3100317
Abstract
Spintronic technology is emerging as a direction for the hardware implementation of neurons and synapses of neuromorphic architectures. In particular, a single spintronic device can be used to implement the nonlinear activation function of neurons. Here, we propose how to implement spintronic neurons with a sigmoidal and ReLU-like activation functions. We then perform a numerical experiment showing the robustness of neural networks made by spintronic neurons all having different activation functions to emulate device-to-device variations in a possible hardware implementation of the network. Therefore, we consider a vanilla neural network implemented to recognize the categories of the Mixed National Institute of Standards and Technology database, and we show an average accuracy of 98.87 % in the test dataset which is very close to the 98.89% as obtained for the ideal case (all neurons have the same sigmoid activation function). Similar results are also obtained with neurons having a ReLU-like activation function.
References in corpus (13)
- cuDNN: Efficient Primitives for Deep Learning
- Vowel recognition with four coupled spin-torque nano-oscillators
- Voltage-Induced Ferromagnetic Resonance in Magnetic Tunnel Junctions
- Ultralow-current-density and bias-field-free spin-transfer nano-oscillator
- Giant spin-torque diode sensitivity at low input power in the absence of bias magnetic field
- The promise of spintronics for unconventional computing
- Perspectives on spintronic diodes
- Switching Properties in Magnetic Tunnel Junctions with Interfacial Perpendicular Anisotropy: Micromagnetic Study
- Reversible vs. irreversible voltage manipulation of interfacial magnetic anisotropy in Pt/Co/oxide multilayers
- Controllable reset behavior in domain wall-magnetic tunnel junction artificial neurons for task-adaptable computation
- Low frequency non-resonant rectification in spin-diodes
- Role of magnetic skyrmions for the solution of the shortest path problem
- Micromagnetic study of electrical-field-assisted magnetization switching in MTJ devices