Tell Me How to Ask Again: Question Data Augmentation with Controllable Rewriting in Continuous Space

Abstract

In this paper, we propose a novel data augmentation method, referred to as Controllable Rewriting based Question Data Augmentation (CRQDA), for machine reading comprehension (MRC), question generation, and question-answering natural language inference tasks. We treat the question data augmentation task as a constrained question rewriting problem to generate context-relevant, high-quality, and diverse question data samples. CRQDA utilizes a Transformer autoencoder to map the original discrete question into a continuous embedding space. It then uses a pre-trained MRC model to revise the question representation iteratively with gradient-based optimization. Finally, the revised question representations are mapped back into the discrete space, which serve as additional question data. Comprehensive experiments on SQuAD 2.0, SQuAD 1.1 question generation, and QNLI tasks demonstrate the effectiveness of CRQDA

Accepted at EMNLP 2020

References in corpus (13)

• Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation
• MASS: Masked Sequence to Sequence Pre-training for Language Generation
• QANet: Combining Local Convolution with Global Self-Attention for Reading Comprehension
• Data Augmentation Using GANs
• Data Augmentation using Pre-trained Transformer Models
• Transforming Question Answering Datasets Into Natural Language Inference Datasets
• HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answering
• Learning to Ask: Neural Question Generation for Reading Comprehension
• ProphetNet: Predicting Future N-gram for Sequence-to-Sequence Pre-training
• NewsQA: A Machine Comprehension Dataset
• Synthetic QA Corpora Generation with Roundtrip Consistency
• Addressing Semantic Drift in Question Generation for Semi-Supervised Question Answering
• mu-Forcing: Training Variational Recurrent Autoencoders for Text Generation