Model soups need only one ingredient

Alireza Abdollahpoorrostam, Nikolaos Dimitriadis, Adam Hazimeh +1

Fine-tuning large pre-trained models on a target distribution often improves in-distribution (ID) accuracy, but at the cost of out-of-distribution (OOD) robustness as representatio…