Matryoshka Re-Ranker: A Flexible Re-Ranking Architecture With Configurable Depth and Width

Zheng Liu, Chaofan Li, Shitao Xiao +3

Large language models (LLMs) provide powerful foundations to perform fine-grained text re-ranking. However, they are often prohibitive in reality due to constraints on computation…