40 citations · 63 across the 6 of their papers we have counts for
6 papers
WARM: On the Benefits of Weight Averaged Reward Models
Alexandre Ramé, Nino Vieillard, Léonard Hussenot +4
Aligning large language models (LLMs) with human preferences through reinforcement learning (RLHF) can lead to reward hacking, where LLMs exploit failures in the reward model (RM)…
Factually Consistent Summarization via Reinforcement Learning with Textual Entailment Feedback
Paul Roit, Johan Ferret, Lior Shani +16
Despite the seeming success of contemporary grounded text generation systems, they often tend to generate factually inconsistent text with respect to their input. This phenomenon i…
Get Back Here: Robust Imitation by Return-to-Distribution Planning
Geoffrey Cideron, Baruch Tabanpour, Sebastian Curi +6
We consider the Imitation Learning (IL) setup where expert data are not collected on the actual deployment environment but on a different version. To address the resulting distribu…
vec2text with Round-Trip Translations
Geoffrey Cideron, Sertan Girgin, Anton Raichuk +3
We investigate models that can generate arbitrary natural language text (e.g. all English sentences) from a bounded, convex and well-behaved control space. We call them universal v…
Diversity Policy Gradient for Sample Efficient Quality-Diversity Optimization
Thomas Pierrot, Valentin Macé, Félix Chalumeau +6
A fascinating aspect of nature lies in its ability to produce a large and diverse collection of organisms that are all high-performing in their niche. By contrast, most AI algorith…
HIGhER : Improving instruction following with Hindsight Generation for Experience Replay
Geoffrey Cideron, Mathieu Seurin, Florian Strub +1
Language creates a compact representation of the world and allows the description of unlimited situations and objectives through compositionality. While these characterizations may…