ConflictScore: Identifying and Measuring How Language Models Handle Conflicting Evidence

Siyi Liu, Aaron Halfaker, Dan Roth +1

Existing metrics for factuality and faithfulness evaluate whether an answer is supported or contradicted by its grounding documents, but they fail to capture when both supporting a…