1 citations · 1 across the 3 of their papers we have counts for
4 papers
The QCET Taxonomy of Standard Quality Criterion Names and Definitions for the Evaluation of NLP Systems
Anya Belz, Simon Mille, Craig Thomson
Prior work has shown that two NLP evaluation experiments that report results for the same quality criterion name (e.g. Fluency) do not necessarily evaluate the same aspect of quali…
HEDS 3.0: The Human Evaluation Data Sheet Version 3.0
Anya Belz, Craig Thomson
This paper presents version 3.0 of the Human Evaluation Datasheet (HEDS). This update is the result of our experience using HEDS in the context of numerous recent human evaluation…
Generation Challenges: Results of the Accuracy Evaluation Shared Task
Craig Thomson, Ehud Reiter
The Shared Task on Evaluating Accuracy focused on techniques (both manual and automatic) for evaluating the factual accuracy of texts produced by neural NLG systems, in a sports-re…
A Gold Standard Methodology for Evaluating Accuracy in Data-To-Text Systems
Craig Thomson, Ehud Reiter
Most Natural Language Generation systems need to produce accurate texts. We propose a methodology for high-quality human evaluation of the accuracy of generated texts, which is int…