1 citations · 1 across the 2 of their papers we have counts for
2 papers
cs.CL2023
Character-level Chinese Backpack Language Models
Hao Sun, John Hewitt
The Backpack is a Transformer alternative shown to improve interpretability in English language modeling by decomposing predictions into a weighted sum of token sense components. H…
cs.CL2023★ 1 cited
Closing the Curious Case of Neural Text Degeneration
Matthew Finlayson, John Hewitt, Alexander Koller +2
Despite their ubiquity in language generation, it remains unknown why truncation sampling heuristics like nucleus sampling are so effective. We provide a theoretical explanation fo…