Learning Easily Updated General Purpose Text Representations with Adaptable Task-Specific Prefixes

Kuan-Hao Huang, Liang Tan, Rui Hou +3

Many real-world applications require making multiple predictions from the same text. Fine-tuning a large pre-trained language model for each downstream task causes computational bu…