2 papers
cs.CL2025
Neither Valid nor Reliable? Investigating the Use of LLMs as Judges
Khaoula Chehbouni, Mohammed Haddou, Jackie Chi Kit Cheung +1
Evaluating natural language generation (NLG) systems remains a core challenge of natural language processing (NLP), further complicated by the rise of large language models (LLMs)…
cs.AI2024
Does This Summary Answer My Question? Modeling Query-Focused Summary Readers with Rational Speech Acts
Cesare Spinoso-Di Piano, Jackie Chi Kit Cheung
Query-focused summarization (QFS) is the task of generating a summary in response to a user-written query. Despite its user-oriented nature, there has been limited work in QFS in e…