The statistical advantage of automatic NLG metrics at the system level

Johnny Tian-Zheng Wei, Robin Jia

Estimating the expected output quality of generation systems is central to NLG. This paper qualifies the notion that automatic metrics are not as good as humans in estimating syste…