Challenges and Considerations with Code-Mixed NLP for Multilingual Societies
arXiv:2106.07823
Abstract
Multilingualism refers to the high degree of proficiency in two or more languages in the written and oral communication modes. It often results in language mixing, a.k.a. code-mixing, when a multilingual speaker switches between multiple languages in a single utterance of a text or speech. This paper discusses the current state of the NLP research, limitations, and foreseeable pitfalls in addressing five real-world applications for social good crisis management, healthcare, political campaigning, fake news, and hate speech for multilingual societies. We also propose futuristic datasets, models, and tools that can significantly advance the current research in multilingual NLP applications for the societal good. As a representative example, we consider English-Hindi code-mixing but draw similar inferences for other language pairs
References in corpus (6)
- Analyzing the Digital Traces of Political Manipulation: The 2016 Russian Interference Twitter Campaign
- CoAID: COVID-19 Healthcare Misinformation Dataset
- XFake: Explainable Fake News Detector with Visualizations
- Hate Speech Detection from Code-mixed Hindi-English Tweets Using Deep Learning Models
- MM-COVID: A Multilingual and Multimodal Data Repository for Combating COVID-19 Disinformation
- Analysing the Extent of Misinformation in Cancer Related Tweets