HeadRank: Decoding-Free Passage Reranking via Preference-Aligned Attention Heads

Juyuan Wang, Chenxing Wang, Yuchen Fang +8

Decoding-free reranking methods that read relevance signals directly from LLM attention weights offer significant latency advantages over autoregressive approaches, yet suffer from…