TopoTuner: Topological Finetuning of Large Language Models

Abdulkadir Erol, Yash Mahajan, Vepaul Hariprashad +4

Full fine-tuning remains a strong way to adapt pretrained LLMs, but it updates all weights and can be expensive. LoRA reduces the number of trainable parameters, but it does not di…