It's Morphin' Time! Combating Linguistic Discrimination with Inflectional Perturbations

Abstract

Training on only perfect Standard English corpora predisposes pre-trained neural networks to discriminate against minorities from non-standard linguistic backgrounds (e.g., African American Vernacular English, Colloquial Singapore English, etc.). We perturb the inflectional morphology of words to craft plausible and semantically similar adversarial examples that expose these biases in popular NLP models, e.g., BERT and Transformer, and show that adversarially fine-tuning them for a single epoch significantly improves robustness without sacrificing performance on clean data.

arXiv commentTo appear in the Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics (ACL 2020)

References in corpus (10)

• Explaining and Harnessing Adversarial Examples
• Intriguing properties of neural networks
• HuggingFace's Transformers: State-of-the-art Natural Language Processing
• Convolutional Sequence to Sequence Learning
• Bidirectional Attention Flow for Machine Comprehension
• Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings
• CTRL: A Conditional Transformer Language Model for Controllable Generation
• Synthetic and Natural Noise Both Break Neural Machine Translation
• Adversarial Attacks on Deep Learning Models in Natural Language Processing: A Survey
• Is BERT Really Robust? A Strong Baseline for Natural Language Attack on Text Classification and Entailment

Cited by in corpus (20)

• Post-hoc Interpretability for Neural NLP: A Survey
• TextAttack: A Framework for Adversarial Attacks, Data Augmentation, and Adversarial Training in NLP
• Spinning Language Models: Risks of Propaganda-As-A-Service and Countermeasures
• Towards a Robust Deep Neural Network in Texts: A Survey
• Polyjuice: Generating Counterfactuals for Explaining, Evaluating, and Improving Models
• An Empirical Survey of Data Augmentation for Limited Data Learning in NLP
• Better Robustness by More Coverage: Adversarial Training with Mixup Augmentation for Robust Fine-tuning
• Text-CRS: A Generalized Certified Robustness Framework against Textual Adversarial Attacks
• Effective and Imperceptible Adversarial Textual Attack via Multi-objectivization
• Efficient Combinatorial Optimization for Word-level Adversarial Textual Attack
• From Hero to Zéroe: A Benchmark of Low-Level Adversarial Attacks
• Generating Syntactically Controlled Paraphrases without Using Annotated Parallel Pairs
• Addressing the Vulnerability of NMT in Input Perturbations
• Code-Mixing on Sesame Street: Dawn of the Adversarial Polyglots
• Spinning Sequence-to-Sequence Models with Meta-Backdoors
• CLINE: Contrastive Learning with Semantic Negative Examples for Natural Language Understanding
• Evaluating the Morphosyntactic Well-formedness of Generated Texts
• On the Robustness of Intent Classification and Slot Labeling in Goal-oriented Dialog Systems to Real-world Noise
• Achieving Model Robustness through Discrete Adversarial Training
• On the Universality of Deep Contextual Language Models