95 citations · 284 across the 17 of their papers we have counts for
Showing cs.CLShow all
3 papers · 1 filter
cs.CL2020
Influence Patterns for Explaining Information Flow in BERT
Kaiji Lu, Zifan Wang, Piotr Mardziel +1
While attention is all you need may be proving true, we do not know why: attention-based transformer models such as BERT are superior but how information flows from input tokens to…
cs.CL2020★ 1 cited
Influence Paths for Characterizing Subject-Verb Number Agreement in LSTM Language Models
Kaiji Lu, Piotr Mardziel, Klas Leino +2
LSTM-based recurrent neural networks are the state-of-the-art for many natural language processing (NLP) tasks. Despite their performance, it is unclear whether, or how, LSTMs lear…
cs.CL2018★ 70 cited
Gender Bias in Neural Natural Language Processing
Kaiji Lu, Piotr Mardziel, Fangjing Wu +2
We examine whether neural natural language processing (NLP) systems reflect historical biases in training data. We define a general benchmark to quantify gender bias in a variety o…