24 citations · 120 across the 27 of their papers we have counts for
Showing 2023Show all
3 papers · 1 filter
cs.CL2023
Distilled Self-Critique of LLMs with Synthetic Data: a Bayesian Perspective
Victor Gallego
This paper proposes an interpretation of RLAIF as Bayesian inference by introducing distilled Self-Critique (dSC), which refines the outputs of a LLM through a Gibbs sampler that i…
cs.CV2023
Fast Adaptation with Bradley-Terry Preference Models in Text-To-Image Classification and Generation
Victor Gallego
Recently, large multimodal models, such as CLIP and Stable Diffusion have experimented tremendous successes in both foundations and applications. However, as these models increase…
cs.CL2023
ZYN: Zero-Shot Reward Models with Yes-No Questions for RLAIF
Victor Gallego
In this work, we address the problem of directing the text generation of a language model (LM) towards a desired behavior, aligning the generated text with the preferences of the h…