5 papers
How Uncertainty Estimation Scales with Sampling in Reasoning Models
Maksym Del, Markus Kängsepp, Marharyta Domnich +4
Uncertainty estimation is critical for deploying reasoning language models, yet remains poorly understood under extended chain-of-thought reasoning. We study parallel sampling as a…
Preliminary Ranking of WMT25 General Machine Translation Systems
Tom Kocmi, Eleftherios Avramidis, Rachel Bawden +25
We present the preliminary rankings of machine translation (MT) systems submitted to the WMT25 General Machine Translation Shared Task, as determined by automatic evaluation metric…
Backtranslation Feedback Improves User Confidence in MT, Not Quality
Vilém Zouhar, Michal Novák, Matúš Žilinec +7
Translating text into a language unknown to the text's author, dubbed outbound translation, is a modern need for which the user experience has significant room for improvement, bey…
Unsupervised Quality Estimation for Neural Machine Translation
Marina Fomicheva, Shuo Sun, Lisa Yankovskaya +6
Quality Estimation (QE) is an important component in making Machine Translation (MT) useful in real-world applications, as it is aimed to inform the user on the quality of the MT o…
A Study in Improving BLEU Reference Coverage with Diverse Automatic Paraphrasing
Rachel Bawden, Biao Zhang, Lisa Yankovskaya +2
We investigate a long-perceived shortcoming in the typical use of BLEU: its reliance on a single reference. Using modern neural paraphrasing techniques, we study whether automatica…