Learning to Route Queries to Heads for Attention-based Re-ranking with Large Language Models

Yuxing Tian, Fengran Mo, Zhiqi Huang +2

Large Language Models (LLMs) have recently been explored as fine-grained zero-shot re-rankers by leveraging attention signals to estimate document relevance. However, existing meth…