A Challenge Set Approach to Evaluating Machine Translation

Pierre Isabelle, Colin Cherry, George Foster

Neural machine translation represents an exciting leap forward in translation quality. But what longstanding weaknesses does it resolve, and which remain? We address these question…