70 citations · 75 across the 5 of their papers we have counts for
Showing 2020Show all
2 papers · 1 filter
cs.CL2020
Influence Patterns for Explaining Information Flow in BERT
Kaiji Lu, Zifan Wang, Piotr Mardziel +1
While attention is all you need may be proving true, we do not know why: attention-based transformer models such as BERT are superior but how information flows from input tokens to…
cs.CL2020★ 1 cited
Influence Paths for Characterizing Subject-Verb Number Agreement in LSTM Language Models
Kaiji Lu, Piotr Mardziel, Klas Leino +2
LSTM-based recurrent neural networks are the state-of-the-art for many natural language processing (NLP) tasks. Despite their performance, it is unclear whether, or how, LSTMs lear…