How role-play shapes relevance judgment in zero-shot LLM rankers

Yumeng Wang, Jirui Qi, Catherine Chen +2

Large Language Models (LLMs) have emerged as promising zero-shot rankers, but their performance is highly sensitive to prompt formulation. In particular, role-play prompts, where t…