AutoFT: Learning an Objective for Robust Fine-Tuning

Caroline Choi, Yoonho Lee, Annie Chen +3

Foundation models encode rich representations that can be adapted to downstream tasks by fine-tuning. However, fine-tuning a model on one data distribution often degrades performan…