Text Data Augmentation: Towards better detection of spear-phishing emails
arXiv:2007.02033
Abstract
Text data augmentation, i.e., the creation of new textual data from an existing text, is challenging. Indeed, augmentation transformations should take into account language complexity while being relevant to the target Natural Language Processing (NLP) task (e.g., Machine Translation, Text Classification). Initially motivated by an application of Business Email Compromise (BEC) detection, we propose a corpus and task agnostic augmentation framework used as a service to augment English texts within our company. Our proposal combines different methods, utilizing BERT language model, multi-step back-translation and heuristics. We show that our augmentation framework improves performances on several text classification tasks using publicly available models and corpora as well as on a BEC detection task. We also provide a comprehensive argumentation about the limitations of our augmentation framework.
References in corpus (11)
- Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation
- A systematic study of the class imbalance problem in convolutional neural networks
- HuggingFace's Transformers: State-of-the-art Natural Language Processing
- The Effectiveness of Data Augmentation in Image Classification using Deep Learning
- Stochastic Backpropagation and Approximate Inference in Deep Generative Models
- Unsupervised Data Augmentation for Consistency Training
- Universal Sentence Encoder
- Data Augmentation using Pre-trained Transformer Models
- A Deep Generative Framework for Paraphrase Generation
- Robust Convolutional Neural Networks under Adversarial Noise
- Word Embedding Perturbation for Sentence Classification