Training-free Context-adaptive Attention for Efficient Long Context Modeling

Zeng You, Yaofo Chen, Shuhai Zhang +5

Large Language Models (LLMs) have demonstrated remarkable capabilities across a wide range of natural language processing tasks. These capabilities stem primarily from the self-att…