4 papers
Looking under the Wrong Lamppost: On the Limitations of Automated Translation Quality Estimation
Serge Gladkoff, Angelika Vaasa, Sue Ellen Wright +2
Automation of Translation Quality Estimation (QE) has emerged as a widely discussed approach to managing translation quality at scale, and a growing number of tools and technologie…
Non-Linear Scoring Model for Translation Quality Evaluation
Serge Gladkoff, Lifeng Han, Katerina Gasova
Analytic Translation Quality Evaluation (TQE), based on Multidimensional Quality Metrics (MQM), traditionally uses a linear error-to-penalty scale calibrated to a reference sample…
The Multi-Range Theory of Translation Quality Measurement: MQM scoring models and Statistical Quality Control
Arle Lommel, Serge Gladkoff, Alan Melby +10
The year 2024 marks the 10th anniversary of the Multidimensional Quality Metrics (MQM) framework for analytic translation quality evaluation. The MQM error typology has been widely…
MTUncertainty: Assessing the Need for Post-editing of Machine Translation Outputs by Fine-tuning OpenAI LLMs
Serge Gladkoff, Lifeng Han, Gleb Erofeev +2
Translation Quality Evaluation (TQE) is an essential step of the modern translation production process. TQE is critical in assessing both machine translation (MT) and human transla…