15 citations · 43 across the 5 of their papers we have counts for
6 papers
Assessing Quality of Experience in Natural Language Generation of German Text
Dinh Nam Pham, Shushen Manakhimova, Vivien Macketanz +1
The rapid advancement of Natural Language Generation (NLG) has made the reliable evaluation of generated text increasingly critical, as these systems, such as large language models…
Fine-grained linguistic evaluation for state-of-the-art Machine Translation
Eleftherios Avramidis, Vivien Macketanz, Ursula Strohriegel +2
This paper describes a test suite submission providing detailed statistics of linguistic performance for the state-of-the-art German-English systems of the Fifth Conference of Mach…
Fine-grained evaluation of Quality Estimation for Machine translation based on a linguistically-motivated Test Suite
Avramidis Eleftherios, Vivien Macketanz, Arle Lommel +1
We present an alternative method of evaluating Quality Estimation systems, which is based on a linguistically-motivated Test Suite. We create a test-set consisting of 14 linguistic…
Fine-grained evaluation of German-English Machine Translation based on a Test Suite
Vivien Macketanz, Eleftherios Avramidis, Aljoscha Burchardt +1
We present an analysis of 16 state-of-the-art MT systems on German-English based on a linguistically-motivated test suite. The test suite has been devised manually by a team of lan…
Linguistic evaluation of German-English Machine Translation using a Test Suite
Eleftherios Avramidis, Vivien Macketanz, Ursula Strohriegel +1
We present the results of the application of a grammatical test suite for GermanEnglish MT on the systems submitted at WMT19, with a detailed analysis for 107 phenomen…
Train, Sort, Explain: Learning to Diagnose Translation Models
Robert Schwarzenberg, David Harbecke, Vivien Macketanz +2
Evaluating translation models is a trade-off between effort and detail. On the one end of the spectrum there are automatic count-based methods such as BLEU, on the other end lingui…