IFCLoRA: Topology-Aware Rank Allocation for Parameter-Efficient Fine-Tuning

Wei Zhang, Xinwu Liu, Yihang Cheng

Low-Rank Adaptation (LoRA) is a widely used approach to parameter-efficient fine-tuning (PEFT) of LLMs whose effectiveness depends on rank allocation. Existing adaptive LoRA method…