Block Sparse Flash Attention

Daniel Ohayon, Itay Lamprecht, Itay Hubara +3

Modern large language models increasingly require long contexts for reasoning and multi-document tasks, but attention's quadratic complexity creates a severe computational bottlene…