4 citations · 12 across the 28 of their papers we have counts for
3 papers · 1 filter
Don't Repeat Yourself: Stopping Verbatim Loops at Sampling Time
Philipp Emanuel Weidmann, Allen Roush, Judah Goldfeder +2
Large Language Models generate text autoregressively, but open-ended generation is prone to verbatim looping, in which models repeat spans already present in context. Standard defe…
XTC: Head-Aware Sampling by Excluding Top Choices
Philipp Emanuel Weidmann, Allen Roush, Judah Goldfeder +2
Standard decoding rules for autoregressive language models promote diversity by rescaling the full next-token distribution or truncating its low-probability tail. These strategies…
A superpersuasive autonomous policy debating system
Allen Roush, Devin Gonier, John Hines +4
The capacity for highly complex, evidence-based, and strategically adaptive persuasion remains a formidable great challenge for artificial intelligence. Previous work, like IBM Pro…