ROSA-Tuning: Enhancing Long-Context Modeling via Suffix Matching

Yunao Zheng, Xiaojie Wang, Lei Ren +1

Long-context capability and computational efficiency are among the central challenges facing today's large language models. Existing efficient attention methods reduce computationa…