FastLane: Efficient Routed Systems for Late-Interaction Retrieval

Ramnath Kumar, Prateek Jain, Cho-Jui Hsieh

Late-interaction retrieval models like ColBERT achieve superior accuracy by enabling token-level interactions, but their computational cost hinders scalability and integration with…