401 citations · 434 across the 12 of their papers we have counts for
5 papers · 1 filter
LM Transparency Tool: Interactive Tool for Analyzing Transformer Language Models
Igor Tufanov, Karen Hambardzumyan, Javier Ferrando +1
We present the LM Transparency Tool (LM-TT), an open-source interactive toolkit for analyzing the internal workings of Transformer-based language models. Differently from previousl…
Scaling Laws for Generative Mixed-Modal Language Models
Armen Aghajanyan, Lili Yu, Alexis Conneau +7
Generative language models define distributions over sequences of tokens that can represent essentially any combination of data modalities (e.g., any permutation of image tokens fr…
WARP: Word-level Adversarial ReProgramming
Karen Hambardzumyan, Hrant Khachatrian, Jonathan May
Transfer learning from pretrained language models recently became the dominant approach for solving many NLP tasks. A common approach to transfer learning for multiple tasks that m…
Towards JointUD: Part-of-speech Tagging and Lemmatization using Recurrent Neural Networks
Gor Arakelyan, Karen Hambardzumyan, Hrant Khachatrian
This paper describes our submission to CoNLL 2018 UD Shared Task. We have extended an LSTM-based neural network designed for sequence tagging to additionally generate character-lev…
Natural Language Inference over Interaction Space: ICLR 2018 Reproducibility Report
Martin Mirakyan, Karen Hambardzumyan, Hrant Khachatrian
We have tried to reproduce the results of the paper "Natural Language Inference over Interaction Space" submitted to ICLR 2018 conference as part of the ICLR 2018 Reproducibility C…