Memristor models for machine learning
arXiv:1406.2210 · doi:10.1162/NECO_a_00694
Abstract
In the quest for alternatives to traditional CMOS, it is being suggested that digital computing efficiency and power can be improved by matching the precision to the application. Many applications do not need the high precision that is being used today. In particular, large gains in area- and power efficiency could be achieved by dedicated analog realizations of approximate computing engines. In this work, we explore the use of memristor networks for analog approximate computation, based on a machine learning framework called reservoir computing. Most experimental investigations on the dynamics of memristors focus on their nonvolatile behavior. Hence, the volatility that is present in the developed technologies is usually unwanted and it is not included in simulation models. In contrast, in reservoir computing, volatility is not only desirable but necessary. Therefore, in this work, we propose two different ways to incorporate it into memristor simulation models. The first is an extension of Strukov's model and the second is an equivalent Wiener model approximation. We analyze and compare the dynamical properties of these models and discuss their implications for the memory and the nonlinear processing capacity of memristor networks. Our results indicate that device variability, increasingly causing problems in traditional computer design, is an asset in the context of reservoir computing. We conclude that, although both models could lead to useful memristor based reservoir computing systems, their computational performance will differ. Therefore, experimental modeling research is required for the development of accurate volatile memristor models.
4 figures, no tables. Submitted to neural computation
References in corpus (4)
- Optoelectronic Reservoir Computing
- Integration of nanoscale memristor synapses in neuromorphic computing architectures
- Nanobatteries in redox-based resistive switches require extension of memristor theory
- The Missing Memristor: Novel Nanotechnology or rather new Case Study for the Philosophy and Sociology of Science?
Cited by in corpus (7)
- Recent Advances in Physical Reservoir Computing: A Review
- A Survey on Reservoir Computing and its Interdisciplinary Applications Beyond Traditional Machine Learning
- Learning by mistakes in memristor networks
- The mise en scene of memristive networks: effective memory, dynamics and learning
- The Computational Capacity of LRC, Memristive and Hybrid Reservoirs
- A mean-field model of memristive circuit interaction
- Over-the-Air Multi-Sensor Inference with Neural Networks Using Memristor-Based Analog Computing