2 papers
cs.LG2024
Catalytic Role Of Noise And Necessity Of Inductive Biases In The Emergence Of Compositional Communication
Åukasz KuciÅski, Tomasz Korbak, PaweÅ KoÅodziej +1
Communication is compositional if complex signals can be represented as a combination of simpler subparts. In this paper, we theoretically show that inductive biases on both the tr…
cs.CL2024
Training Language Models with Language Feedback at Scale
Jérémy Scheurer, Jon Ander Campos, Tomasz Korbak +4
Pretrained language models often generate outputs that are not in line with human preferences, such as harmful text or factually incorrect summaries. Recent work approaches the abo…