185 citations · 582 across the 36 of their papers we have counts for
6 papers · 1 filter
An Ensemble Model with Ranking for Social Dialogue
Ioannis Papaioannou, Amanda Cercas Curry, Jose L. Part +6
Open-domain social dialogue is one of the long-standing goals of Artificial Intelligence. This year, the Amazon Alexa Prize challenge was announced for the first time, where real c…
A Review of Evaluation Techniques for Social Dialogue Systems
Amanda Cercas Curry, Helen Hastie, Verena Rieser
In contrast with goal-oriented dialogue, social dialogue has no clear measure of task success. Consequently, evaluation of these systems is notoriously hard. In this paper, we revi…
Referenceless Quality Estimation for Natural Language Generation
Ondřej Dušek, Jekaterina Novikova, Verena Rieser
Traditional automatic evaluation measures for natural language generation (NLG) use costly human-authored references to estimate the quality of a system output. In this paper, we p…
Why We Need New Evaluation Metrics for NLG
Jekaterina Novikova, Ondřej Dušek, Amanda Cercas Curry +1
The majority of NLG evaluation relies on automatic metrics, such as BLEU . In this paper, we motivate the need for novel, system- and data-independent automatic evaluation methods:…
The E2E Dataset: New Challenges For End-to-End Generation
Jekaterina Novikova, Ondřej Dušek, Verena Rieser
This paper describes the E2E data, a new dataset for training end-to-end, data-driven natural language generation systems in the restaurant domain, which is ten times bigger than e…
Data-driven Natural Language Generation: Paving the Road to Success
Jekaterina Novikova, Ondřej Dušek, Verena Rieser
We argue that there are currently two major bottlenecks to the commercial use of statistical machine learning approaches for natural language generation (NLG): (a) The lack of reli…