Layer-wise Token Compression for Efficient Document Reranking

Shengyao Zhuang, Zhichao Xu, Ivano Lauriola

Transformer-based document cross-encoder rerankers are a central component of modern information retrieval systems. Despite their success, these models suffer from high computation…