157 citations · 471 across the 17 of their papers we have counts for
4 papers · 1 filter
Intriguing Properties of Quantization at Scale
Arash Ahmadian, Saurabh Dash, Hongyu Chen +5
Emergent properties have been widely adopted as a term to describe behavior not present in smaller models but observed in larger models. Recent work suggests that the trade-off inc…
Learning and Evaluating General Linguistic Intelligence
Dani Yogatama, Cyprien de Masson d'Autume, Jerome Connor +8
We define general linguistic intelligence as the ability to reuse previously acquired knowledge about a language's lexicon, syntax, semantics, and pragmatic conventions to adapt to…
Transferring Physical Motion Between Domains for Neural Inertial Tracking
Changhao Chen, Yishu Miao, Chris Xiaoxuan Lu +3
Inertial information processing plays a pivotal role in ego-motion awareness for mobile agents, as inertial measurements are entirely egocentric and not environment dependent. Howe…
Optimizing Performance of Recurrent Neural Networks on GPUs
Jeremy Appleyard, Tomas Kocisky, Phil Blunsom
As recurrent neural networks become larger and deeper, training times for single networks are rising into weeks or even months. As such there is a significant incentive to improve…