Same Scores, Different Decisions: Evaluating JEV and Language Models for Legal Document Understanding

Fan Zhang, Yankai Chen, Zhuohan Xie +11

Contract inference requires multiple judgments about a shared document, but aggregate accuracy can conceal changes in the individual decisions. Repeated agreement is also insuffici…