A Bayesian Interpretation of Adaptive Low-Rank Adaptation

Haolin Chen, Philip N. Garner

Motivated by the sensitivity-based importance score of the adaptive low-rank adaptation (AdaLoRA), we utilize more theoretically supported metrics, including the signal-to-noise ra…