TokenSeek: Memory Efficient Fine Tuning via Instance-Aware Token Ditching

Runjia Zeng, Qifan Wang, Qiang Guan +6

Fine tuning has been regarded as a de facto approach for adapting large language models (LLMs) to downstream tasks, but the high training memory consumption inherited from LLMs mak…