Amulet: Putting Complex Multi-Turn Conversations on the Stand with LLM Juries

Sahana Ramnath, Anurag Mudgil, Brihi Joshi +2

Today, large language models are widely used as judges to evaluate responses from other language models. Hence, it is imperative to benchmark and improve these LLM-judges on real-w…