A Survey on Transformer Context Extension: Approaches and Evaluation

Yijun Liu, Jinzheng Yu, Yang Xu +2

Large language models (LLMs) based on Transformer have been widely applied in the filed of natural language processing (NLP), demonstrating strong performance, particularly in hand…