Attentional Neural Network: Feature Selection Using Cognitive Feedback
arXiv:1411.5140
Abstract
Attentional Neural Network is a new framework that integrates top-down cognitive bias and bottom-up feature extraction in one coherent architecture. The top-down influence is especially effective when dealing with high noise or difficult segmentation problems. Our system is modular and extensible. It is also easy to train and cheap to run, and yet can accommodate complex behaviors. We obtain classification accuracy better than or competitive with state of art results on the MNIST variation dataset, and successfully disentangle overlaid digits with high success rates. We view such a general purpose framework as an essential foundation for a larger system emulating the cognitive abilities of the whole brain.
Poster in Neural Information Processing Systems (NIPS) 2014
Cited by in corpus (11)
- Convolutional Neural Networks as a Model of the Visual System: Past, Present, and Future
- First Step toward Model-Free, Anonymous Object Tracking with Recurrent Neural Networks
- Self-Attention Capsule Networks for Object Classification
- Dreaming More Data: Class-dependent Distributions over Diffeomorphisms for Learned Data Augmentation
- Dynamic Computational Time for Visual Attention
- The Costs and Benefits of Goal-Directed Attention in Deep Convolutional Neural Networks
- AFS: An Attention-based mechanism for Supervised Feature Selection
- Teaching CNNs to mimic Human Visual Cognitive Process & regularise Texture-Shape bias
- Learning to Point and Count
- Feature Selection Using Batch-Wise Attenuation and Feature Mask Normalization
- A Generative Neural Network Framework for Automated Software Testing