From the 2 of 17 linked papers with an AI index.
4 papers · 1 filter
Data-Efficient Adaptation of LLMs via Attention Head Reweighting
Tuomas Oikarinen, Zixiao Chen, Charlotte Siska +3
The paper introduces Attention Head Reweighting (AHR), a method that adapts large language models to new text‑classification tasks by learning a single scalar weight per attention…
Test-Time Learning with an Evolving Library
Weijia Xu, Alessandro Sordoni, Chandan Singh +4
The paper introduces EvoLib, a test-time learning framework that lets large language models build, reuse, and evolve a shared library of knowledge abstractions across tasks without…
Interpreting and Steering State-Space Models via Activation Subspace Bottlenecks
Vamshi Sunku Mohan, Kaustubh Gupta, Aneesha Das +1
State-space models (SSMs) have emerged as an efficient strategy for building powerful language models, avoiding the quadratic complexity of computing attention in transformers. Des…
Learning a Decision Tree Algorithm with Transformers
Yufan Zhuang, Liyuan Liu, Chandan Singh +2
Decision trees are renowned for their ability to achieve high predictive performance while remaining interpretable, especially on tabular data. Traditionally, they are constructed…