Exploring BERT's Sensitivity to Lexical Cues using Tests from Semantic Priming

Kanishka Misra, Allyson Ettinger, Julia Taylor Rayz

Models trained to estimate word probabilities in context have become ubiquitous in natural language processing. How do these models use lexical cues in context to inform their word…