Frozen Factor or Spectral Band? Disentangling Two Choices in Low-Rank LoRA

Adnan Slimane Ali, Ayoub Belfatmi, David Ngwe Pouth

Spectral variants of low-rank adaptation (LoRA) choose both a subspace and which factor to freeze. We separate these choices by freezing the input factor A or output factor B on th…