15 citations · 20 across the 5 of their papers we have counts for
5 papers
Masked Siamese ConvNets
Li Jing, Jiachen Zhu, Yann LeCun
Self-supervised learning has shown superior performances over supervised methods on various vision benchmarks. The siamese network, which encourages embeddings to be invariant to d…
Data-Informed Global Sparseness in Attention Mechanisms for Deep Neural Networks
Ileana Rugina, Rumen Dangovski, Li Jing +2
Attention mechanisms play a crucial role in the neural revolution of Natural Language Processing (NLP). With the growth of attention-based models, several pruning techniques have b…
Vector-Vector-Matrix Architecture: A Novel Hardware-Aware Framework for Low-Latency Inference in NLP Applications
Matthew Khoury, Rumen Dangovski, Longwu Ou +3
Deep neural networks have become the standard approach to building reliable Natural Language Processing (NLP) applications, ranging from Neural Machine Translation (NMT) to dialogu…
Contextualizing Enhances Gradient Based Meta Learning
Evan Vogelbaum, Rumen Dangovski, Li Jing +1
Meta learning methods have found success when applied to few shot classification problems, in which they quickly adapt to a small number of labeled examples. Prototypical represent…
Rotational Unit of Memory
Rumen Dangovski, Li Jing, Marin Soljacic
The concepts of unitary evolution matrices and associative memory have boosted the field of Recurrent Neural Networks (RNN) to state-of-the-art performance in a variety of sequenti…