5 papers · 1 filter
Last Translation Benchmark
Vilém Zouhar, Niyati Bafna, Mukund Choudhary +241
For scientific progress, we need benchmarks that test the limits of state-of-the-art models, and evaluation methods that inform us about failure cases. As models get stronger, stan…
Ladders in Chaos: When, How, (and Perhaps Why) Does Test-Time Scaling Improve LLM Machine Translation
Di Wu, Sergey Troshin, Christof Monz +2
Two forms of test-time scaling for Large Language Models (LLMs) have emerged as effective and widely adopted paradigms: sequential, in which later answer attempts depend on earlier…
Representation Collapse in Machine Translation Through the Lens of Angular Dispersion
Evgeniia Tokarchuk, Maya K. Nachesa, Sergey Troshin +1
Modern neural translation models based on the Transformer architecture are known for their high performance, particularly when trained on high-resource datasets. A standard next-to…
Asking a Language Model for Diverse Responses
Sergey Troshin, Irina Saparina, Antske Fokkens +1
Large language models increasingly rely on explicit reasoning chains and can produce multiple plausible responses for a given context. We study the candidate sampler that produces…
Angular Dispersion Accelerates -Nearest Neighbors Machine Translation
Evgeniia Tokarchuk, Sergey Troshin, Vlad Niculae
Augmenting neural machine translation with external memory at decoding time, in the form of k-nearest neighbors machine translation (-NN MT), is a well-established strategy for…