activity
20162024
most citedEvaluating the State-of-the-Art of End-to-End Natural Language Generation: The E2E NLG Challenge

185 citations · 582 across the 36 of their papers we have counts for

collaborators
Showing 2019Show all

6 papers · 1 filter

cs.CL2019

Semantic Noise Matters for Neural Natural Language Generation

Ondřej Dušek, David M. Howcroft, Verena Rieser

Neural natural language generation (NNLG) systems are known for their pathological outputs, i.e. generating text which is unrelated to the input specification. In this paper, we sh…

cs.CL2019

Automatic Quality Estimation for Natural Language Generation: Ranting (Jointly Rating and Ranking)

Ondřej Dušek, Karin Sevegnani, Ioannis Konstas +1

We present a recurrent neural network based system for automatic quality estimation of natural language generation (NLG) outputs, which jointly learns to assign numerical ratings t…

cs.HC2019

A Crowd-based Evaluation of Abuse Response Strategies in Conversational Agents

Amanda Cercas Curry, Verena Rieser

How should conversational agents respond to verbal abuse through the user? To answer this question, we conduct a large-scale crowd-sourced evaluation of abuse response strategies e…

cs.CL2019

User Evaluation of a Multi-dimensional Statistical Dialogue System

Simon Keizer, Ondřej Dušek, Xingkun Liu +1

We present the first complete spoken dialogue system driven by a multi-dimensional statistical dialogue manager. This framework has been shown to substantially reduce data needs by…

cs.CL2019★ 89 cited

Benchmarking Natural Language Understanding Services for building Conversational Agents

Xingkun Liu, Arash Eshghi, Pawel Swietojanski +1

We have recently seen the emergence of several publicly available Natural Language Understanding (NLU) toolkits, which map user utterances to structured, but more abstract, Dialogu…

cs.CL2019★ 185 cited

Evaluating the State-of-the-Art of End-to-End Natural Language Generation: The E2E NLG Challenge

Ondřej Dušek, Jekaterina Novikova, Verena Rieser

This paper provides a comprehensive analysis of the first shared task on End-to-End Natural Language Generation (NLG) and identifies avenues for future research based on the result…