Understanding Convolutional Networks with APPLE : Automatic Patch Pattern Labeling for Explanation
arXiv:1802.03675
Abstract
With the success of deep learning, recent efforts have been focused on analyzing how learned networks make their classifications. We are interested in analyzing the network output based on the network structure and information flow through the network layers. We contribute an algorithm for 1) analyzing a deep network to find neurons that are 'important' in terms of the network classification outcome, and 2)automatically labeling the patches of the input image that activate these important neurons. We propose several measures of importance for neurons and demonstrate that our technique can be used to gain insight into, and explain how a network decomposes an image to make its final classification.
arXiv commentAAAI/ACM Conference on AI, Ethics, and Society
References in corpus (8)
- Very Deep Convolutional Networks for Large-Scale Image Recognition
- Striving for Simplicity: The All Convolutional Net
- Towards Vision-Based Deep Reinforcement Learning for Robotic Motion Control
- Learning Deep Features for Discriminative Localization
- Target-driven Visual Navigation in Indoor Scenes using Deep Reinforcement Learning
- Generating Visual Explanations
- Attentive Explanations: Justifying Decisions and Pointing to the Evidence
- Context-aware Captions from Context-agnostic Supervision