Feedback Indices to Evaluate LLM Responses to Rebuttals for Multiple Choice Type Questions

Justin C. Dunlap, Anne-Simone Parent, Ralf Widenhorn

We present a systematic framework of indices designed to characterize Large Language Model (LLM) responses when challenged with rebuttals during a chat. Assessing how LLMs respond…