6 citations · 10 across the 8 of their papers we have counts for
8 papers
Formal Language Recognition by Hard Attention Transformers: Perspectives from Circuit Complexity
Yiding Hao, Dana Angluin, Robert Frank
This paper analyzes three formal models of Transformer encoders that differ in the form of their self-attention mechanism: unique hard attention (UHAT); generalized unique hard att…
An Adversarial Benchmark for Fake News Detection Models
Lorenzo Jaime Yu Flores, Yiding Hao
With the proliferation of online misinformation, fake news detection has gained importance in the artificial intelligence community. In this paper, we propose an adversarial benchm…
Evaluating Attribution Methods using White-Box LSTMs
Yiding Hao
Interpretability methods for neural networks are difficult to evaluate because we do not understand the black-box models typically used to test them. This paper proposes a framewor…
Probabilistic Predictions of People Perusing: Evaluating Metrics of Language Model Performance for Psycholinguistic Modeling
Yiding Hao, Simon Mendelsohn, Rachel Sterneck +2
By positing a relationship between naturalistic reading times and information-theoretic surprisal, surprisal theory (Hale, 2001; Levy, 2008) provides a natural interface between la…
Attribution Analysis of Grammatical Dependencies in LSTMs
Yiding Hao
LSTM language models have been shown to capture syntax-sensitive grammatical dependencies such as subject-verb agreement with a high degree of accuracy (Linzen et al., 2016, inter…
Action-Sensitive Phonological Dependencies
Yiding Hao, Dustin Bowers
This paper defines a subregular class of functions called the tier-based synchronized strictly local (TSSL) functions. These functions are similar to the the tier-based input-outpu…