BFLA: Block-Filtered Long-Context Attention Mechanism

Chong Wu, Zhenan Feng, Renjie Xu +5

This paper proposes Block-Filtered Long-Context Attention (BFLA), a training-free sparse prefill attention mechanism for long-context inference. BFLA adopts a two-stage design. In…