Likert or Not: LLM Absolute Relevance Judgments on Fine-Grained Ordinal Scales

Charles Godfrey, Ping Nie, Natalia Ostapuk +3

Large language models (LLMs) obtain state of the art zero shot relevance ranking performance on a variety of information retrieval tasks. The two most common prompts to elicit LLM…