3 papers
cs.CL2024
Automatic Metrics in Natural Language Generation: A Survey of Current Evaluation Practices
Patrícia Schmidtová, Saad Mahamood, Simone Balloccu +6
Automatic metrics are extensively used to evaluate natural language processing systems. However, there has been increasing focus on how they are used and reported by practitioners…
cs.CL2021
OTTers: One-turn Topic Transitions for Open-Domain Dialogue
Karin Sevegnani, David M. Howcroft, Ioannis Konstas +1
Mixed initiative in open-domain dialogue requires a system to pro-actively introduce new topics. The one-turn topic transition task explores how a system connects two topics in a c…
cs.CL2019
Semantic Noise Matters for Neural Natural Language Generation
Ondřej Dušek, David M. Howcroft, Verena Rieser
Neural natural language generation (NNLG) systems are known for their pathological outputs, i.e. generating text which is unrelated to the input specification. In this paper, we sh…