Are Long-LLMs A Necessity For Long-Context Tasks?

Hongjin Qian, Zheng Liu, Peitian Zhang +4

The learning and deployment of long-LLMs remains a challenging problem despite recent progresses. In this work, we argue that the long-LLMs are not a necessity to solve long-contex…