1 citations · 1 across the 11 of their papers we have counts for
Showing 2023Show all
2 papers · 1 filter
cs.CL2023
Bridging Information-Theoretic and Geometric Compression in Language Models
Emily Cheng, Corentin Kervadec, Marco Baroni
For a language model (LM) to faithfully model human language, it must compress vast, potentially infinite information into relatively few dimensions. We propose analyzing compressi…
cs.CL2023
On the Correspondence between Compositionality and Imitation in Emergent Neural Communication
Emily Cheng, Mathieu Rita, Thierry Poibeau
Compositionality is a hallmark of human language that not only enables linguistic generalization, but also potentially facilitates acquisition. When simulating language emergence w…