Experimental Evaluation of Deep Learning models for Marathi Text Classification

Abstract

The Marathi language is one of the prominent languages used in India. It is predominantly spoken by the people of Maharashtra. Over the past decade, the usage of language on online platforms has tremendously increased. However, research on Natural Language Processing (NLP) approaches for Marathi text has not received much attention. Marathi is a morphologically rich language and uses a variant of the Devanagari script in the written form. This works aims to provide a comprehensive overview of available resources and models for Marathi text classification. We evaluate CNN, LSTM, ULMFiT, and BERT based models on two publicly available Marathi text classification datasets and present a comparative analysis. The pre-trained Marathi fast text word embeddings by Facebook and IndicNLP are used in conjunction with word-based models. We show that basic single layer models based on CNN and LSTM coupled with FastText embeddings perform on par with the BERT based models on the available datasets. We hope our paper aids focused research and experiments in the area of Marathi NLP.

Accepted at ICMISC 2021

References in corpus (5)

• Cross-lingual Language Model Pretraining
• Convolutional Neural Networks for Sentence Classification
• CCNet: Extracting High Quality Monolingual Datasets from Web Crawl Data
• How multilingual is Multilingual BERT?
• iNLTK: Natural Language Toolkit for Indic Languages

Cited by in corpus (9)

• Mono vs Multilingual BERT for Hate Speech Detection and Text Classification: A Case Study in Marathi
• Mono vs Multilingual BERT: A Case Study in Hindi and Marathi Named Entity Recognition
• Hate and Offensive Speech Detection in Hindi and Marathi
• On Sensitivity of Deep Learning Based Text Classification Algorithms to Practical Input Perturbations
• InstructNet: A Novel Approach for Multi-Label Instruction Classification through Advanced Deep Learning
• L3CubeMahaSent: A Marathi Tweet-based Sentiment Analysis Dataset
• ShufText: A Simple Black Box Approach to Evaluate the Fragility of Text Classification Models
• Universal Cross-Lingual Text Classification
• L3Cube-MahaNews: News-based Short Text and Long Document Classification Datasets in Marathi