Batched Self-Consistency Improves LLM Relevance Assessment and Ranking

Anton Korikov, Pan Du, Scott Sanner +1

LLM query-passage relevance assessment is typically studied using a one-by-one pointwise (PW) strategy where each LLM call judges one passage at a time. However, this strategy requ…