Self Distillation Fine-Tuning of Protein Language Models Improves Versatility in Protein Design

Amin Tavakoli, Raswanth Murugan, Ozan Gokdemir +3

Supervised fine-tuning (SFT) is a standard approach for adapting large language models to specialized domains, yet its application to protein sequence modeling and protein language…