Adapting Multilingual Models to Code-Mixed Tasks via Model Merging

Prashant Kodali, Vaishnavi Shivkumar, Swarang Joshi +3

We study model merging as a practical alternative to conventional adaptation strategies for code-mixed NLP. Starting from a multilingual base model, we: (i) perform continued pre-t…