Formalising the Logit Shift Induced by LoRA: A Technical Note

Xiang Shi, Shuaizhi Cheng, Mingwei Li

This technical note provides a first-order formalisation of the logit shift and fact-margin change induced by Low-Rank Adaptation (LoRA). Using a first-order Fréchet approximation…