NLL-Guided Full-Attention Layer Selection for Training-Free Sliding-Window Adaptation

Qiong Tang, Xiangkun Hu, Xiangyang Liu +2

Hybrid attention models that mix full and sliding-window attention across layers offer a promising approach to efficient long-context inference, but the critical question of \emph{…