Transfer Learning for Multi-lingual Tasks -- a Survey
arXiv:2110.02052
Abstract
These days different platforms such as social media provide their clients from different backgrounds and languages the possibility to connect and exchange information. It is not surprising anymore to see comments from different languages in posts published by international celebrities or data providers. In this era, understanding cross languages content and multilingualism in natural language processing (NLP) are hot topics, and multiple efforts have tried to leverage existing technologies in NLP to tackle this challenging research problem. In this survey, we provide a comprehensive overview of the existing literature with a focus on transfer learning techniques in multilingual tasks. We also identify potential opportunities for further research in this domain.
References in corpus (15)
- Neural Architecture Search with Reinforcement Learning
- Cross-lingual Language Model Pretraining
- Convolutional Neural Networks for Sentence Classification
- A Convolutional Neural Network for Modelling Sentences
- Adaptation of Deep Bidirectional Multilingual Transformers for Russian Language
- How multilingual is Multilingual BERT?
- Multilingual is not enough: BERT for Finnish
- NewsQA: A Machine Comprehension Dataset
- Train Once, Test Anywhere: Zero-Shot Learning for Text Classification
- Multi-lingual Intent Detection and Slot Filling in a Joint BERT-based Model
- Cross-lingual Zero- and Few-shot Hate Speech Detection Utilising Frozen Transformer Language Models and AXEL
- Distilling Large Language Models into Tiny and Effective Students using pQRNN
- Low-Resource Task-Oriented Semantic Parsing via Intrinsic Modeling
- Improving Slot Filling Performance with Attentive Neural Networks on Dependency Structures
- Efficient Contextual Representation Learning Without Softmax Layer