Data-Efficient Adaptation of LLMs via Attention Head Reweighting

Tuomas Oikarinen, Zixiao Chen, Charlotte Siska +3

Learning effectively from limited data is critical in domains like security where labeled examples are scarce. Large language models (LLMs) have demonstrated some capabilities for…