4 papers
When Do Agents Help? Embedding, LLM and Agentic Alignment of Classical Texts and Their Translations
Máté Metzger
Classical texts aligned with their translations support machine translation, retrieval and computational research, but evidence comparing alignment workflows is scattered. This stu…
Can We Triage LLM Translation Errors in Classical Texts Without Human References? Source Novelty, GEMBA Scoring, and Budgeted Review through Pali-to-English Translation
Máté Metzger
As large language models become capable translators of classical texts, a key challenge is deciding which outputs need expert review when no human reference exists. This study test…
From Outliers to Errors: Auditing Pali-to-English LLM Translations with Multi-Reference Adjudication
Máté Metzger, Nadnapang Phophichit, Hansa Dhammahaso
Single-score translation metrics can conflate legitimate variation with error, a problem especially acute for classical languages where multiple defensible English renderings of th…
PaliBench: A Multi-Reference Blueprint for Classical Language Translation Benchmarks
Máté Metzger, Nadnapang Phophichit
Digital humanities projects increasingly rely on machine translation and large language models to widen access to classical, religious, and otherwise under-translated textual tradi…