34 citations · 123 across the 12 of their papers we have counts for
3 papers · 2 filters
KL-Divergence Guided Temperature Sampling
Chung-Ching Chang, David Reitter, Renat Aksitov +1
Temperature sampling is a conventional approach to diversify large language model predictions. As temperature increases, the prediction becomes diverse but also vulnerable to hallu…
How do decoding algorithms distribute information in dialogue responses?
Saranya Venkatraman, He He, David Reitter
Humans tend to follow the Uniform Information Density (UID) principle by distributing information evenly in utterances. We study if decoding algorithms implicitly follow this UID p…
Characterizing Attribution and Fluency Tradeoffs for Retrieval-Augmented Large Language Models
Renat Aksitov, Chung-Ching Chang, David Reitter +2
Despite recent progress, it has been difficult to prevent semantic hallucinations in generative Large Language Models. One common solution to this is augmenting LLMs with a retriev…