Spectral-Aware Low-Rank Adaptation for Speaker Verification

Zhe Li, Man-wai Mak, Mert Pilanci +2

Previous research has shown that the principal singular vectors of a pre-trained model's weight matrices capture critical knowledge. In contrast, those associated with small singul…