Transfer Learning for Multi-lingual Tasks -- a Survey
arXiv:2110.02052
Abstract
These days different platforms such as social media provide their clients from different backgrounds and languages the possibility to connect and exchange information. It is not surprising anymore to see comments from different languages in posts published by international celebrities or data providers. In this era, understanding cross languages content and multilingualism in natural language processing (NLP) are hot topics, and multiple efforts have tried to leverage existing technologies in NLP to tackle this challenging research problem. In this survey, we provide a comprehensive overview of the existing literature with a focus on transfer learning techniques in multilingual tasks. We also identify potential opportunities for further research in this domain.
References in corpus (26)
- Efficient Estimation of Word Representations in Vector Space
- Neural Architecture Search with Reinforcement Learning
- Longformer: The Long-Document Transformer
- XLNet: Generalized Autoregressive Pretraining for Language Understanding
- Cross-lingual Language Model Pretraining
- Pre-trained Models for Natural Language Processing: A Survey
- Convolutional Neural Networks for Sentence Classification
- AraBERT: Transformer-based Model for Arabic Language Understanding
- A Convolutional Neural Network for Modelling Sentences
- Beyond English-Centric Multilingual Machine Translation
- Snips Voice Platform: an embedded Spoken Language Understanding system for private-by-design voice interfaces
- Adaptation of Deep Bidirectional Multilingual Transformers for Russian Language
- How multilingual is Multilingual BERT?
- Multilingual is not enough: BERT for Finnish
- NewsQA: A Machine Comprehension Dataset
- Train Once, Test Anywhere: Zero-Shot Learning for Text Classification
- Multilingual Sentiment Analysis: An RNN-Based Framework for Limited Data
- Multilingual End-to-End Speech Recognition with A Single Transformer on Low-Resource Languages
- Multi-lingual Intent Detection and Slot Filling in a Joint BERT-based Model
- SUPERB: Speech processing Universal PERformance Benchmark
- Cross-lingual Zero- and Few-shot Hate Speech Detection Utilising Frozen Transformer Language Models and AXEL
- Distilling Large Language Models into Tiny and Effective Students using pQRNN
- Single-/Multi-Source Cross-Lingual NER via Teacher-Student Learning on Unlabeled Data in Target Language
- Low-Resource Task-Oriented Semantic Parsing via Intrinsic Modeling
- Improving Slot Filling Performance with Attentive Neural Networks on Dependency Structures
- Efficient Contextual Representation Learning Without Softmax Layer