Is Reference Necessary in the Evaluation of NLG Systems? When and Where?

Shuqian Sheng, Yi Xu, Luoyi Fu +4

The majority of automatic metrics for evaluating NLG systems are reference-based. However, the challenge of collecting human annotation results in a lack of reliable references in…