Showing cs.CLShow all
3 papers · 1 filter
cs.CL2026
Validating DBpedia Triple Sets for Natural Language Generation
Mark Andrade, Simon Mille, Anya Belz +1
We present a study of the quality of individual DBpedia triples from the perspective of Natural Language Generation, and propose and evaluate an approach for collecting entity-spec…
cs.CL2025
The QCET Taxonomy of Standard Quality Criterion Names and Definitions for the Evaluation of NLP Systems
Anya Belz, Simon Mille, Craig Thomson
Prior work has shown that two NLP evaluation experiments that report results for the same quality criterion name (e.g. Fluency) do not necessarily evaluate the same aspect of quali…
cs.CL2024
On the Role of Summary Content Units in Text Summarization Evaluation
Marcel Nawrath, Agnieszka Nowak, Tristan Ratz +13
At the heart of the Pyramid evaluation method for text summarization lie human written summary content units (SCUs). These SCUs are concise sentences that decompose a summary into…