4 papers
How Do People Quantify Naturally: Evidence from Mandarin Picture Description
Yayun Zhang, Guanyi Chen, Fahime Same +2
Quantification is a fundamental component of everyday language use, yet little is known about how speakers decide whether and how to quantify in naturalistic production. We investi…
LLMs as Span Annotators: A Comparative Study of LLMs and Humans
ZdenÄk Kasner, Vilém Zouhar, PatrÃcia Schmidtová +7
Span annotation - annotating specific text features at the span level - can be used to evaluate texts where single-score metrics fail to provide actionable feedback. Until recently…
Real-World Summarization: When Evaluation Reaches Its Limits
PatrÃcia Schmidtová, OndÅej DuÅ¡ek, Saad Mahamood
We examine evaluation of faithfulness to input data in the context of hotel highlights: brief LLM-generated summaries that capture unique features of accommodations. Through human…
Sentence Embeddings as an intermediate target in end-to-end summarisation
Maciej Zembrzuski, Saad Mahamood
Current neural network-based methods to the problem of document summarisation struggle when applied to datasets containing large inputs. In this paper we propose a new approach to…