Go-tuning: Improving Zero-shot Learning Abilities of Smaller Language Models

Jingjing Xu, Qingxiu Dong, Hongyi Liu +1

With increasing scale, large language models demonstrate both quantitative improvement and new qualitative capabilities, especially as zero-shot learners, like GPT-3. However, thes…