1 citations · 1 across the 2 of their papers we have counts for
3 papers · 1 filter
Transformer Feed-Forward Layers Are Key-Value Memories
Mor Geva, Roei Schuster, Jonathan Berant +1
Feed-forward layers constitute two-thirds of a transformer model's parameters, yet their role in the network remains under-explored. We show that feed-forward layers in transformer…
Humpty Dumpty: Controlling Word Meanings via Corpus Poisoning
Roei Schuster, Tal Schuster, Yoav Meri +1
Word embeddings, i.e., low-dimensional vector representations such as GloVe and SGNS, encode word "meaning" in the sense that distances between words' vectors correspond to their s…
The Limitations of Stylometry for Detecting Machine-Generated Fake News
Tal Schuster, Roei Schuster, Darsh J Shah +1
Recent developments in neural language models (LMs) have raised concerns about their potential misuse for automatically spreading misinformation. In light of these concerns, severa…