Machine Learning Meets Natural Language Processing -- The story so far
arXiv:2104.10213
Abstract
Natural Language Processing (NLP) has evolved significantly over the last decade. This paper highlights the most important milestones of this period while trying to pinpoint the contribution of each individual model and algorithm to the overall progress. Furthermore, it focuses on issues still remaining to be solved, emphasizing the groundbreaking proposals of Transformers, BERT, and all the similar attention-based models.
13 pages, 5 figures
References in corpus (7)
- Language Models are Few-Shot Learners
- Cross-lingual Language Model Pretraining
- Convolutional Neural Networks for Sentence Classification
- Comparative Study of CNN and RNN for Natural Language Processing
- ERNIE: Enhanced Representation through Knowledge Integration
- A Convolutional Neural Network for Modelling Sentences
- Beyond Bilingual: Multi-sense Word Embeddings using Multilingual Context