RePo: Language Models with Context Re-Positioning

Huayang Li, Tianyu Zhao, Deng Cai +1

In-context learning is fundamental to modern Large Language Models (LLMs); however, prevailing architectures impose a rigid and fixed contextual structure by assigning linear or co…