2 citations · 5 across the 13 of their papers we have counts for
4 papers · 1 filter
On Non-interactive Evaluation of Animal Communication Translators
Orr Paradise, David F. Gruber, Adam Tauman Kalai
If you had an AI Whale-to-English translator, how could you validate whether or not it is working? Does one need to interact with the animals or rely on grounded observations such…
Unsupervised Translation of Emergent Communication
Ido Levy, Orr Paradise, Boaz Carmeli +3
Emergent Communication (EC) provides a unique window into the language systems that emerge autonomously when agents are trained to jointly achieve shared goals. However, it is diff…
Pseudointelligence: A Unifying Framework for Language Model Evaluation
Shikhar Murty, Orr Paradise, Pratyusha Sharma
With large language models surpassing human performance on an increasing number of benchmarks, we must take a principled approach for targeted evaluation of model capabilities. Ins…
A Theory of Unsupervised Translation Motivated by Understanding Animal Communication
Shafi Goldwasser, David F. Gruber, Adam Tauman Kalai +1
Neural networks are capable of translating between languages -- in some cases even between two languages where there is little or no access to parallel translations, in what is kno…