Human vs Automatic Metrics: on the Importance of Correlation Design

Anastasia Shimorina

This paper discusses two existing approaches to the correlation analysis between automatic evaluation metrics and human scores in the area of natural language generation. Our exper…