17 citations · 67 across the 33 of their papers we have counts for
Showing 2023Show all
2 papers · 1 filter
cs.CL2023
Some things are more CRINGE than others: Iterative Preference Optimization with the Pairwise Cringe Loss
Jing Xu, Andrew Lee, Sainbayar Sukhbaatar +1
Practitioners commonly align large language models using pairwise preferences, i.e., given labels of the type response A is preferred to response B for a given input. Perhaps less…
cs.CL2023★ 12 cited
System 2 Attention (is something you might need too)
Jason Weston, Sainbayar Sukhbaatar
Soft attention in Transformer-based Large Language Models (LLMs) is susceptible to incorporating irrelevant information from the context into its latent representations, which adve…