7 citations · 22 across the 12 of their papers we have counts for
Showing 2022Show all
2 papers · 1 filter
cs.CL2022
Better Smatch = Better Parser? AMR evaluation is not so simple anymore
Juri Opitz, Anette Frank
Recently, astonishing advances have been observed in AMR parsing, as measured by the structural Smatch metric. In fact, today's systems achieve performance levels that seem to surp…
cs.CL2022
A Dynamic, Interpreted CheckList for Meaning-oriented NLG Metric Evaluation -- through the Lens of Semantic Similarity Rating
Laura Zeidler, Juri Opitz, Anette Frank
Evaluating the quality of generated text is difficult, since traditional NLG evaluation metrics, focusing more on surface form than meaning, often fail to assign appropriate scores…