High-contrast "gaudy" images improve the training of deep neural network models of visual cortex
arXiv:2006.11412
Abstract
A key challenge in understanding the sensory transformations of the visual system is to obtain a highly predictive model of responses from visual cortical neurons. Deep neural networks (DNNs) provide a promising candidate for such a model. However, DNNs require orders of magnitude more training data than neuroscientists can collect from real neurons because experimental recording time is severely limited. This motivates us to find images that train highly-predictive DNNs with as little training data as possible. We propose gaudy images---high-contrast binarized versions of natural images---to efficiently train DNNs. In extensive simulation experiments, we find that training DNNs with gaudy images substantially reduces the number of training images needed to accurately predict the simulated responses of visual cortical neurons. We also find that gaudy images, chosen before training, outperform images chosen during training by active learning algorithms. Thus, gaudy images overemphasize features of natural images, especially edges, that are the most important for efficiently training DNNs. We believe gaudy images will aid in the modeling of visual cortical neurons, potentially opening new scientific questions about visual processing, as well as aid general practitioners that seek ways to improve the training of DNNs.
References in corpus (11)
- Very Deep Convolutional Networks for Large-Scale Image Recognition
- The Effectiveness of Data Augmentation in Image Classification using Deep Learning
- FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidence
- YFCC100M: The New Data in Multimedia Research
- The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks
- Active Learning for Convolutional Neural Networks: A Core-Set Approach
- Deep Batch Active Learning by Diverse, Uncertain Gradient Lower Bounds
- Adversarial Active Learning for Deep Networks: a Margin Based Approach
- Dropout-based Active Learning for Regression
- Gradient-free activation maximization for identifying effective stimuli
- Shared Representational Geometry Across Neural Networks