6 citations · 17 across the 16 of their papers we have counts for
4 papers · 1 filter
Is human scoring the best criteria for summary evaluation?
Oleg Vasilyev, John Bohannon
Normally, summary quality measures are compared with quality scores produced by human annotators. A higher correlation with human scores is considered to be a fair indicator of a b…
Sensitivity of BLANC to human-scored qualities of text summaries
Oleg Vasilyev, Vedant Dharnidharka, Nicholas Egan +2
We explore the sensitivity of a document summary quality estimator, BLANC, to human assessment of qualities for the same summaries. In our human evaluations, we distinguish five su…
Zero-shot topic generation
Oleg Vasilyev, Kathryn Evans, Anna Venancio-Marques +1
We present an approach to generating topics using a model trained only for document title generation, with zero examples of topics given during training. We leverage features that…
Fill in the BLANC: Human-free quality estimation of document summaries
Oleg Vasilyev, Vedant Dharnidharka, John Bohannon
We present BLANC, a new approach to the automatic estimation of document summary quality. Our goal is to measure the functional performance of a summary with an objective, reproduc…