activity
20232026
most citedCroissantLLM: A Truly Bilingual French-English Language Model

8 citations · 17 across the 15 of their papers we have counts for

collaborators
Showing 2024Show all

9 papers · 1 filter

cs.CL2024

A Context-aware Framework for Translation-mediated Conversations

José Pombal, Sweta Agrawal, Patrick Fernandes +2

Automatic translation systems offer a powerful solution to bridge language barriers in scenarios where participants do not share a common language. However, these systems can intro…

cs.CL2024

Fine-Grained Reward Optimization for Machine Translation using Error Severity Mappings

Miguel Moura Ramos, Tomás Almeida, Daniel Vareta +4

Reinforcement learning (RL) has been proven to be an effective and robust method for training neural machine translation systems, especially when paired with powerful reward models…

cs.CL2024

Modeling User Preferences with Automatic Metrics: Creating a High-Quality Preference Dataset for Machine Translation

Sweta Agrawal, José G. C. de Souza, Ricardo Rei +5

Alignment with human preferences is an important step in developing accurate and safe large language models. This is no exception in machine translation (MT), where better handling…

cs.CL2024★ 3 cited

EuroLLM: Multilingual Language Models for Europe

Pedro Henrique Martins, Patrick Fernandes, João Alves +12

The quality of open-weight LLMs has seen significant improvement, yet they remain predominantly focused on English. In this paper, we introduce the EuroLLM project, aimed at develo…

cs.CL2024

Thesis proposal: Are We Losing Textual Diversity to Natural Language Processing?

Josef Jon

This thesis argues that the currently widely used Natural Language Processing algorithms possibly have various limitations related to the properties of the texts they handle and pr…

cs.CL2024

DOCE: Finding the Sweet Spot for Execution-Based Code Generation

Haau-Sing Li, Patrick Fernandes, Iryna Gurevych +1

Recently, a diverse set of decoding and reranking procedures have been shown effective for LLM-based code generation. However, a comprehensive framework that links and experimental…

cs.CL2024

Is Context Helpful for Chat Translation Evaluation?

Sweta Agrawal, Amin Farajian, Patrick Fernandes +2

Despite the recent success of automatic metrics for assessing translation quality, their application in evaluating the quality of machine-translated chats has been limited. Unlike…

cs.CL2024★ 6 cited

Tower: An Open Multilingual Large Language Model for Translation-Related Tasks

Duarte M. Alves, José Pombal, Nuno M. Guerreiro +10

While general-purpose large language models (LLMs) demonstrate proficiency on multiple tasks within the domain of translation, approaches based on open LLMs are competitive only wh…

cs.CL2024★ 8 cited

CroissantLLM: A Truly Bilingual French-English Language Model

Manuel Faysse, Patrick Fernandes, Nuno M. Guerreiro +13

We introduce CroissantLLM, a 1.3B language model pretrained on a set of 3T English and French tokens, to bring to the research and industrial community a high-performance, fully op…