4 citations · 5 across the 3 of their papers we have counts for
3 papers
Instruction Following without Instruction Tuning
John Hewitt, Nelson F. Liu, Percy Liang +1
Instruction tuning commonly means finetuning a language model on instruction-response pairs. We discover two forms of adaptation (tuning) that are deficient compared to instruction…
Closing the Curious Case of Neural Text Degeneration
Matthew Finlayson, John Hewitt, Alexander Koller +2
Despite their ubiquity in language generation, it remains unknown why truncation sampling heuristics like nucleus sampling are so effective. We provide a theoretical explanation fo…
Backpack Language Models
John Hewitt, John Thickstun, Christopher D. Manning +1
We present Backpacks: a new neural architecture that marries strong modeling performance with an interface for interpretability and control. Backpacks learn multiple non-contextual…