Fine-Tuned Machine Translation Metrics Struggle in Unseen Domains

Vilém Zouhar, Shuoyang Ding, Anna Currey +3

We introduce a new, extensive multidimensional quality metrics (MQM) annotated dataset covering 11 language pairs in the biomedical domain. We use this dataset to investigate wheth…