Logits-Based Finetuning

Jingyao Li, Senqiao Yang, Sitong Wu +4

In recent years, developing compact and efficient large language models (LLMs) has emerged as a thriving area of research. Traditional Supervised Fine-Tuning (SFT), which relies on…