Auditing Proxy-Based Validation Across Text Spans

Daein Weon, Dong Ho Kang

Evaluation scores are often validated by their agreement with inexpensive proxy labels. When the score and the proxy are computed from the same text span, however, that agreement c…