Unplug and Play Language Models: Decomposing Experts in Language Models at Inference Time

Nakyeong Yang, Jiwon Moon, Junseok Kim +2

Enabled by large-scale text corpora with huge parameters, pre-trained language models operate as multi-task experts using a single model architecture. However, recent studies have…