Rebooting Neuromorphic Hardware Design -- A Complexity Engineering Approach
arXiv:2005.00522
Abstract
As the compute demands for machine learning and artificial intelligence applications continue to grow, neuromorphic hardware has been touted as a potential solution. New emerging devices like memristors, atomic switches, etc have shown tremendous potential to replace CMOS-based circuits but have been hindered by multiple challenges with respect to device variability, stochastic behavior and scalability. In this paper we will introduce a Description<->Design framework to analyze past successes in computing, understand current problems and identify solutions moving forward. Engineering systems with these emerging devices might require the modification of both the type of descriptions of learning that we will design for, and the design methodologies we employ in order to realize these new descriptions. We will explore ideas from complexity engineering and analyze the advantages and challenges they offer over traditional approaches to neuromorphic design with novel computing fabrics. A reservoir computing example is used to understand the specific changes that would accompany in moving towards a complexity engineering approach. The time is ideal for a significant reboot of our design methodologies and success will represent a radical shift in how neuromorphic hardware is designed and pave the way for a new paradigm.
References in corpus (12)
- A nonequilibrium equality for free energy differences
- The Entropy Production Fluctuation Theorem and the Nonequilibrium Work Relation for Free Energy Differences
- Recent Advances in Physical Reservoir Computing: A Review
- Deep Unsupervised Learning using Nonequilibrium Thermodynamics
- A Survey of Neuromorphic Computing and Neural Networks in Hardware
- Emergence of Winner-takes-all Connectivity Paths in Random Nanowire Networks
- A geometric approach to optimal nonequilibrium control: Minimizing dissipation in nanomagnetic spin systems
- Stable Self-Assembled Atomic-Switch Networks for Neuromorphic Applications
- Chemical Boltzmann Machines
- Thermodynamic cost and benefit of memory
- Nonequilibrium Thermodynamics of Restricted Boltzmann Machines
- What does it mean to understand a neural network?