15 citations · 24 across the 3 of their papers we have counts for
3 papers
Decoding and Diversity in Machine Translation
Nicholas Roberts, Davis Liang, Graham Neubig +1
Neural Machine Translation (NMT) systems are typically evaluated using automated metrics that assess the agreement between generated translations and ground truth candidates. To im…
Model Weight Theft With Just Noise Inputs: The Curious Case of the Petulant Attacker
Nicholas Roberts, Vinay Uday Prabhu, Matthew McAteer
This paper explores the scenarios under which an attacker can claim that 'Noise and access to the softmax layer of the model is all you need' to steal the weights of a convolutiona…
Grassmannian Packings in Neural Networks: Learning with Maximal Subspace Packings for Diversity and Anti-Sparsity
Dian Ang Yap, Nicholas Roberts, Vinay Uday Prabhu
Kernel sparsity ("dying ReLUs") and lack of diversity are commonly observed in CNN kernels, which decreases model capacity. Drawing inspiration from information theory and wireless…