Curvature-Guided LoRA: Matching Full Fine-Tuning in Function Space

Frédéric Zheng, Alexandre Proutière

Parameter-efficient fine-tuning methods such as LoRA enable efficient adaptation of large pretrained models, but often lag behind full fine-tuning in both convergence speed and fin…