Analysis Methods in Neural Language Processing: A Survey
arXiv:1812.08951
Abstract
The field of natural language processing has seen impressive progress in recent years, with neural network models replacing many of the traditional systems. A plethora of new models have been proposed, many of which are thought to be opaque compared to their feature-rich counterparts. This has led researchers to analyze, interpret, and evaluate neural networks in novel and more fine-grained ways. In this survey paper, we review analysis methods in neural language processing, categorize them according to prominent research trends, highlight existing limitations, and point to potential directions for future work.
Version including the supplementary materials (3 tables), also available at https://boknilev.github.io/nlp-analysis-methods
References in corpus (23)
- Towards A Rigorous Science of Interpretable Machine Learning
- Transferability in Machine Learning: from Phenomena to Black-Box Attacks using Adversarial Samples
- Exploring the Limits of Language Modeling
- Visualizing and Understanding Recurrent Networks
- Understanding Neural Networks through Representation Erasure
- Generating Natural Adversarial Examples
- Adversarial Examples: Attacks and Defenses for Deep Learning
- Towards Crafting Text Adversarial Samples
- Hierarchical interpretations for neural network predictions
- Seq2Sick: Evaluating the Robustness of Sequence-to-Sequence Models with Adversarial Examples
- Separated by an Un-common Language: Towards Judgment Language Informed Vector Space Modeling
- Revisiting the poverty of the stimulus: hierarchical generalization without a hierarchical bias in recurrent neural networks
- Simple and Accurate Dependency Parsing Using Bidirectional LSTM Feature Representations
- Identifying and Controlling Important Neurons in Neural Machine Translation
- Greedy Attack and Gumbel Attack: Generating Adversarial Examples for Discrete Data
- From phonemes to images: levels of representation in a recurrent neural model of visually-grounded language learning
- Gate Activation Signal Analysis for Gated Recurrent Neural Networks and Its Correlation with Phoneme Boundaries
- Latent Tree Learning with Differentiable Parsers: Shift-Reduce Parsing and Chart Parsing
- Multi-task Learning for Universal Sentence Embeddings: A Thorough Evaluation using Transfer and Auxiliary Tasks
- Natural Language Multitasking: Analyzing and Improving Syntactic Saliency of Hidden Representations
- A Challenge Set for French --> English Machine Translation
- Debugging Neural Machine Translations
- Paying Attention to Attention: Highlighting Influential Samples in Sequential Analysis