15 citations · 48 across the 12 of their papers we have counts for
4 papers · 1 filter
Fine-grained evaluation of Quality Estimation for Machine translation based on a linguistically-motivated Test Suite
Avramidis Eleftherios, Vivien Macketanz, Arle Lommel +1
We present an alternative method of evaluating Quality Estimation systems, which is based on a linguistically-motivated Test Suite. We create a test-set consisting of 14 linguistic…
Fine-grained evaluation of German-English Machine Translation based on a Test Suite
Vivien Macketanz, Eleftherios Avramidis, Aljoscha Burchardt +1
We present an analysis of 16 state-of-the-art MT systems on German-English based on a linguistically-motivated test suite. The test suite has been devised manually by a team of lan…
Linguistic evaluation of German-English Machine Translation using a Test Suite
Eleftherios Avramidis, Vivien Macketanz, Ursula Strohriegel +1
We present the results of the application of a grammatical test suite for GermanEnglish MT on the systems submitted at WMT19, with a detailed analysis for 107 phenomen…
Train, Sort, Explain: Learning to Diagnose Translation Models
Robert Schwarzenberg, David Harbecke, Vivien Macketanz +2
Evaluating translation models is a trade-off between effort and detail. On the one end of the spectrum there are automatic count-based methods such as BLEU, on the other end lingui…