Infinite Retrieval: Attention Enhanced LLMs in Long-Context Processing

Xiaoju Ye, Zhichun Wang, Jingyuan Wang

Limited by the context window size of Large Language Models(LLMs), handling various tasks with input tokens exceeding the upper limit has been challenging, whether it is a simple d…