5 papers
Fenchel-Young Variational Learning
Sophia Sklaviadis, Thomas Moellenhoff, Andre Martins +1
From a variational perspective, many statistical learning criteria involve seeking a distribution that balances empirical risk and regularization. In this paper, we broaden this pe…
Modern Hopfield Networks with Continuous-Time Memories
Saul Santos, António Farinhas, Daniel C. McNamee +1
Recent research has established a connection between modern Hopfield networks (HNs) and transformer attention heads, with guarantees of exponential storage capacity. However, these…
Reranking Laws for Language Generation: A Communication-Theoretic Perspective
António Farinhas, Haau-Sing Li, André F. T. Martins
To ensure large language models (LLMs) are used safely, one must reduce their propensity to hallucinate or to generate unacceptable answers. A simple and often used strategy is to…
QUEST: Quality-Aware Metropolis-Hastings Sampling for Machine Translation
Gonçalo R. A. Faria, Sweta Agrawal, António Farinhas +3
An important challenge in machine translation (MT) is to generate high-quality and diverse translations. Prior work has shown that the estimated likelihood from the MT model correl…
Can Automatic Metrics Assess High-Quality Translations?
Sweta Agrawal, António Farinhas, Ricardo Rei +1
Automatic metrics for evaluating translation quality are typically validated by measuring how well they correlate with human assessments. However, correlation methods tend to captu…