LAARA: Layer-Aware Adaptive Rank Allocation for Parameter-Efficient Fine-Tuning

Ashutosh Tripathi, Surya Deep Singh, Pranab Sahoo +1

Low-Rank Adaptation is widely used for parameter-efficient fine-tuning, yet existing methods typically assign the same adapter rank to every transformer layer despite their heterog…