Inducing Generalization across Languages and Tasks using Featurized Low-Rank Mixtures

Chu-Cheng Lin, Xinyi Wang, Jonathan H. Clark +4

Adapting pretrained large language models (LLMs) to various downstream tasks in tens or hundreds of human languages is computationally expensive. Parameter-efficient fine-tuning (P…