13 citations · 13 across the 4 of their papers we have counts for
Showing 2021Show all
2 papers · 1 filter
cs.CL2021
How Do Neural Sequence Models Generalize? Local and Global Context Cues for Out-of-Distribution Prediction
Anthony Bau, Jacob Andreas
After a neural sequence model encounters an unexpected token, can its behavior be predicted? We show that RNN and transformer language models exhibit structured, consistent general…
cs.SD2021
Cetacean Translation Initiative: a roadmap to deciphering the communication of sperm whales
Jacob Andreas, Gašper Beguš, Michael M. Bronstein +16
The past decade has witnessed a groundbreaking rise of machine learning for human language analysis, with current methods capable of automatically accurately recovering various asp…