13 citations · 13 across the 3 of their papers we have counts for
3 papers
cs.CL2022★ 13 cited
Characterizing Intrinsic Compositionality in Transformers with Tree Projections
Shikhar Murty, Pratyusha Sharma, Jacob Andreas +1
When trained on language data, do transformers learn some arbitrary computation that utilizes the full capacity of the architecture or do they learn a simpler, tree-like computatio…
cs.CL2021
How Do Neural Sequence Models Generalize? Local and Global Context Cues for Out-of-Distribution Prediction
Anthony Bau, Jacob Andreas
After a neural sequence model encounters an unexpected token, can its behavior be predicted? We show that RNN and transformer language models exhibit structured, consistent general…
cs.SD2021
Cetacean Translation Initiative: a roadmap to deciphering the communication of sperm whales
Jacob Andreas, Gašper Beguš, Michael M. Bronstein +16
The past decade has witnessed a groundbreaking rise of machine learning for human language analysis, with current methods capable of automatically accurately recovering various asp…