From the 1 of 4 linked papers with an AI index.
4 papers
Understanding LoRA as Knowledge Memory: An Empirical Analysis
Seungju Back, Dongwoo Lee, Naun Kang +4
The paper empirically studies Low-Rank Adaptation (LoRA) as a parametric memory for updating knowledge in large language models, analyzing its capacity, composability, and scaling…
Knowledge Integration Decay in Search-Augmented Reasoning of Large Language Models
Sangwon Yu, Ik-hwan Kim, Donghun Kang +6
Modern Large Language Models (LLMs) have demonstrated remarkable capabilities in complex tasks by employing search-augmented reasoning to incorporate external knowledge into long c…
Correcting Negative Bias in Large Language Models through Negative Attention Score Alignment
Sangwon Yu, Jongyoon Song, Bongkyu Hwang +7
A binary decision task, like yes-no questions or answer verification, reflects a significant real-world scenario such as where users look for confirmation about the correctness of…
Improving Instruction Following in Language Models through Proxy-Based Uncertainty Estimation
JoonHo Lee, Jae Oh Woo, Juree Seok +11
Assessing response quality to instructions in language models is vital but challenging due to the complexity of human language across different contexts. This complexity often resu…