Two Sides of Meta-Learning Evaluation: In vs. Out of Distribution

Amrith Setlur, Oscar Li, Virginia Smith

We categorize meta-learning evaluation into two settings: $\text{in-distribution}$ [ID], in which the train and test tasks are sampled $\text{iid}$ from the same underlying tas…