1 paper · 1 filter
Jui-Hui Chung, Hongzhou Lin, Lai Jiang +2
Heavy supervised fine-tuning on a target domain can strongly suppress capabilities that were present in the base model. We study this phenomenon in formal mathematics using Goedel-…