most citedA Single Linear Layer Yields Task-Adapted Low-Rank Matrices

1 citations · 1 across the 1 of their papers we have counts for

collaborators
Showing cs.CLShow all

1 paper · 1 filter

cs.CL2024★ 1 cited

A Single Linear Layer Yields Task-Adapted Low-Rank Matrices

Hwichan Kim, Shota Sasaki, Sho Hoshino +1

Low-Rank Adaptation (LoRA) is a widely used Parameter-Efficient Fine-Tuning (PEFT) method that updates an initial weight matrix with a delta matrix consisted by two low-…