7 citations · 7 across the 3 of their papers we have counts for
3 papers
TextGram: Towards a better domain-adaptive pretraining
Sharayu Hiwarkhedkar, Saloni Mittal, Vidula Magdum +4
For green AI, it is crucial to measure and reduce the carbon footprint emitted during the training of large language models. In NLP, performing pre-training on Transformer models r…
Towards Simple and Efficient Task-Adaptive Pre-training for Text Classification
Arnav Ladkat, Aamir Miyajiwala, Samiksha Jagadale +2
Language models are pre-trained using large corpora of generic data like book corpus, common crawl and Wikipedia, which is essential for the model to understand the linguistic char…
On Sensitivity of Deep Learning Based Text Classification Algorithms to Practical Input Perturbations
Aamir Miyajiwala, Arnav Ladkat, Samiksha Jagadale +1
Text classification is a fundamental Natural Language Processing task that has a wide variety of applications, where deep learning approaches have produced state-of-the-art results…