MixText: Linguistically-Informed Interpolation of Hidden Space for Semi-Supervised Text Classification
arXiv:2004.12239
Abstract
This paper presents MixText, a semi-supervised learning method for text classification, which uses our newly designed data augmentation method called TMix. TMix creates a large amount of augmented training samples by interpolating text in hidden space. Moreover, we leverage recent advances in data augmentation to guess low-entropy labels for unlabeled data, hence making them as easy to use as labeled data.By mixing labeled, unlabeled and augmented data, MixText significantly outperformed current pre-trained and fined-tuned models and other state-of-the-art semi-supervised learning methods on several text classification benchmarks. The improvement is especially prominent when supervision is extremely limited. We have publicly released our code at https://github.com/GT-SALT/MixText.
arXiv commentACL 2020
References in corpus (9)
- The Effectiveness of Data Augmentation in Image Classification using Deep Learning
- Unsupervised Data Augmentation for Consistency Training
- Temporal Ensembling for Semi-Supervised Learning
- Manifold Mixup: Better Representations by Interpolating Hidden States
- Weakly-Supervised Neural Text Classification
- Understanding Back-Translation at Scale
- Improved Variational Autoencoders for Text Modeling using Dilated Convolutions
- Semi-Supervised Sequence Modeling with Cross-View Training
- Semi-Supervised Models via Data Augmentationfor Classifying Interactive Affective Responses