137 citations · 212 across the 21 of their papers we have counts for
Showing 2024 · cs.CLShow all
3 papers · 2 filters
cs.CL2024
Schroedinger's Threshold: When the AUC doesn't predict Accuracy
Juri Opitz
The Area Under Curve measure (AUC) seems apt to evaluate and compare diverse models, possibly without calibration. An important example of AUC application is the evaluation and ben…
cs.CL2024★ 2 cited
Natural Language Processing RELIES on Linguistics
Juri Opitz, Shira Wein, Nathan Schneider
Large Language Models (LLMs) have become capable of generating highly fluent text in certain languages, without modules specially designed to capture grammar or semantic coherence.…
cs.CL2024
On the Role of Summary Content Units in Text Summarization Evaluation
Marcel Nawrath, Agnieszka Nowak, Tristan Ratz +13
At the heart of the Pyramid evaluation method for text summarization lie human written summary content units (SCUs). These SCUs are concise sentences that decompose a summary into…