2.3k citations · 4.7k across the 88 of their papers we have counts for
4 papers · 2 filters
Language Through a Prism: A Spectral Approach for Multiscale Language Representations
Alex Tamkin, Dan Jurafsky, Noah Goodman
Language exhibits structure at different scales, ranging from subwords to words, sentences, paragraphs, and documents. To what extent do deep models capture information at these sc…
Learning to refer informatively by amortizing pragmatic reasoning
Julia White, Jesse Mu, Noah D. Goodman
A hallmark of human language is the ability to effectively and efficiently convey contextually relevant information. One theory for how humans reason about language is presented in…
Investigating Transferability in Pretrained Language Models
Alex Tamkin, Trisha Singh, Davide Giovanardi +1
How does language model pretraining help transfer learning? We consider a simple ablation technique for determining the impact of each pretrained layer on transfer task performance…
Generalizing meanings from partners to populations: Hierarchical inference supports convention formation on networks
Robert D. Hawkins, Noah D. Goodman, Adele E. Goldberg +1
A key property of linguistic conventions is that they hold over an entire community of speakers, allowing us to communicate efficiently even with people we have never met before. A…