RBS-Attention: Radius-Bounded Sparse Prefill for Long-Context Large Language Models

Chuxu Song, Jiuqi Wei, Zhencan Peng

Long-context large language model inference is increasingly limited by prefill, where dense self-attention processes the entire prompt before generation begins. Sparse block select…