Deep Ensembles for Low-Data Transfer Learning

Basil Mustafa, Carlos Riquelme, Joan Puigcerver +3

In the low-data regime, it is difficult to train good supervised models from scratch. Instead practitioners turn to pre-trained models, leveraging transfer learning. Ensembling is…