LARC: Low-Rank Adaptive Residual Connections for Learning in Frozen Models

Junyi Zou, Avrova Donz

Low-Rank Adaptive Residual Connections (LARC) give a frozen model a compact numerical state that can learn from feedback. The map $h+BAh$ adds a low-rank correction to a hidden rep…