works on
benchmark evaluation 1financial nlp 1measurement risk 1metric selection 1rubric sensitivity 1

From the 1 of 1 linked paper with an AI index.

collaborators

1 paper

cs.AI2026

Measurement Risk in Supervised Financial NLP: Rubric and Metric Sensitivity on JF-ICR

Sidi Chang, Peiying Zhu, Yuxiao Chen +1

The paper investigates how the wording of evaluation rubrics and the choice of metrics affect the reliability of supervised financial NLP benchmarks, using a Japanese implicit‑comm…