Self-Explaining Structures Improve NLP Models
arXiv:2012.01786
Abstract
Existing approaches to explaining deep learning models in NLP usually suffer from two major drawbacks: (1) the main model and the explaining model are decoupled: an additional probing or surrogate model is used to interpret an existing model, and thus existing explaining tools are not self-explainable; (2) the probing model is only able to explain a model's predictions by operating on low-level features by computing saliency scores for individual words but are clumsy at high-level text units such as phrases, sentences, or paragraphs. To deal with these two issues, in this paper, we propose a simple yet general and effective self-explaining framework for deep learning models in NLP. The key point of the proposed framework is to put an additional layer, as is called by the interpretation layer, on top of any existing NLP model. This layer aggregates the information for each text span, which is then associated with a specific weight, and their weighted combination is fed to the softmax function for the final prediction. The proposed model comes with the following merits: (1) span weights make the model self-explainable and do not require an additional probing model for interpretation; (2) the proposed model is general and can be adapted to any existing deep learning structures in NLP; (3) the weight associated with each text span provides direct importance scores for higher-level text units such as phrases and sentences. We for the first time show that interpretability does not come at the cost of performance: a neural model of self-explaining features obtains better performances than its counterpart without the self-explaining nature, achieving a new SOTA performance of 59.1 on SST-5 and a new SOTA performance of 92.3 on SNLI.
arXiv commentCode is available at https://github.com/ShannonAI/Self_Explaining_Structures_Improve_NLP_Models
References in corpus (32)
- Adam: A Method for Stochastic Optimization
- Neural Machine Translation by Jointly Learning to Align and Translate
- LSTM: A Search Space Odyssey
- Striving for Simplicity: The All Convolutional Net
- Learning Important Features Through Propagating Activation Differences
- Explaining NonLinear Classification Decisions with Deep Taylor Decomposition
- Understanding Black-box Predictions via Influence Functions
- Visualizing and Understanding Recurrent Networks
- Attention is not Explanation
- Understanding Neural Networks through Representation Erasure
- A large annotated corpus for learning natural language inference
- Towards Robust Interpretability with Self-Explaining Neural Networks
- Deep Text Classification Can be Fooled
- Beyond Word Importance: Contextual Decomposition to Extract Interactions from LSTMs
- Towards Crafting Text Adversarial Samples
- Visualizing and Understanding Neural Models in NLP
- Understanding Back-Translation at Scale
- Do Attention Heads in BERT Track Syntactic Dependencies?
- Extraction of Salient Sentences from Labelled Documents
- HotFlip: White-Box Adversarial Examples for Text Classification
- CXPlain: Causal Explanations for Model Interpretation under Uncertainty
- Attention Interpretability Across NLP Tasks
- A Unified MRC Framework for Named Entity Recognition
- A Game Theoretic Approach to Class-wise Selective Rationalization
- Description Based Text Classification with Reinforcement Learning
- Explicit Contextual Semantics for Text Comprehension
- Coreference Resolution as Query-based Span Prediction
- SentiBERT: A Transferable Transformer-Based Architecture for Compositional Sentiment Semantics
- LSTMVis: A Tool for Visual Analysis of Hidden State Dynamics in Recurrent Neural Networks
- Pair the Dots: Jointly Examining Training History and Test Stimuli for Model Interpretability
- Improved Sentence Modeling using Suffix Bidirectional LSTM
- Language Representation Models for Fine-Grained Sentiment Classification