11 citations · 40 across the 14 of their papers we have counts for
Showing 2020Show all
3 papers · 1 filter
cs.CL2020★ 6 cited
Understanding the Extent to which Summarization Evaluation Metrics Measure the Information Quality of Summaries
Daniel Deutsch, Dan Roth
Reference-based metrics such as ROUGE or BERTScore evaluate the content quality of a summary by comparing the summary to a reference. Ideally, this comparison should measure the su…
cs.CL2020★ 11 cited
Towards Question-Answering as an Automatic Metric for Evaluating the Content Quality of a Summary
Daniel Deutsch, Tania Bedrax-Weiss, Dan Roth
A desirable property of a reference-based evaluation metric that measures the content quality of a summary is that it should estimate how much information that summary has in commo…
cs.CL2020
SacreROUGE: An Open-Source Library for Using and Developing Summarization Evaluation Metrics
Daniel Deutsch, Dan Roth
We present SacreROUGE, an open-source library for using and developing summarization evaluation metrics. SacreROUGE removes many obstacles that researchers face when using or devel…