FLASH-MAXSIM: IO-Aware Fused Kernels for Late-Interaction Retrieval

Roi Pony, Daniel Ezer, Adi Raz Goldfarb +3

Late-interaction retrieval (ColBERT, ColPali) scores a query against a document via the MaxSim operator. The standard PyTorch implementation materialises the full query-token x doc…