Is Pre-training Truly Better Than Meta-Learning?

Brando Miranda, Patrick Yu, Saumya Goyal +2

In the context of few-shot learning, it is currently believed that a fixed pre-trained (PT) model, along with fine-tuning the final layer during evaluation, outperforms standard me…