Few-shot Adaptation Works with UnpredicTable Data

Jun Shern Chan, Michael Pieler, Jonathan Jao +2

Prior work on language models (LMs) shows that training on a large number of diverse tasks improves few-shot learning (FSL) performance on new tasks. We take this to the extreme, a…