Making Small Language Models Better Multi-task Learners with Mixture-of-Task-Adapters

Yukang Xie, Chengyu Wang, Junbing Yan +3

Recently, Large Language Models (LLMs) have achieved amazing zero-shot learning performance over a variety of Natural Language Processing (NLP) tasks, especially for text generativ…