Artificial neural networks for neuroscientists: A primer
arXiv:2006.01001 · doi:10.1016/j.neuron.2020.09.005
Abstract
Artificial neural networks (ANNs) are essential tools in machine learning that have drawn increasing attention in neuroscience. Besides offering powerful techniques for data analysis, ANNs provide a new approach for neuroscientists to build models for complex behaviors, heterogeneous neural activity and circuit connectivity, as well as to explore optimization in neural systems, in ways that traditional models are not designed for. In this pedagogical Primer, we introduce ANNs and demonstrate how they have been fruitfully deployed to study neuroscientific questions. We first discuss basic concepts and methods of ANNs. Then, with a focus on bringing this mathematical framework closer to neurobiology, we detail how to customize the analysis, structure, and learning of ANNs to better address a wide range of challenges in brain research. To help the readers garner hands-on experience, this Primer is accompanied with tutorial-style code in PyTorch and Jupyter Notebook, covering major topics.
References in corpus (13)
- Very Deep Convolutional Networks for Large-Scale Image Recognition
- Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
- PyTorch: An Imperative Style, High-Performance Deep Learning Library
- Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
- On the difficulty of training Recurrent Neural Networks
- Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation
- Deep Neural Networks Rival the Representation of Primate IT Cortex for Core Visual Object Recognition
- A Simple Way to Initialize Recurrent Networks of Rectified Linear Units
- Layer Normalization
- Similarity of Neural Network Representations Revisited
- Deep Learning Models of the Retinal Response to Natural Scenes
- Using Fast Weights to Attend to the Recent Past
- Dendritic error backpropagation in deep cortical microcircuits