Activation Boundary Matching: Task-Informed Initialization for Low-Rank Adaptation

Dongha Lee, Jinhee Park, Minjun Kim +1

Low-Rank Adaptation (LoRA) is highly sensitive to initialization, yet existing schemes construct the initial subspace from statistics at the pretrained point, capturing pre-adaptat…