1 citations · 1 across the 6 of their papers we have counts for
13 papers · 1 filter
Semantics or spelling? Probing contextual word embeddings with orthographic noise
Jacob A. Matthews, John R. Starr, Marten van Schijndel
Pretrained language model (PLM) hidden states are frequently employed as contextual word embeddings (CWE): high-dimensional representations that encode semantic information given l…
Does Dependency Locality Predict Non-canonical Word Order in Hindi?
Sidharth Ranjan, Marten van Schijndel
Previous work has shown that isolated non-canonical sentences with Object-before-Subject (OSV) order are initially harder to process than their canonical counterparts with Subject-…
Discourse Context Predictability Effects in Hindi Word Order
Sidharth Ranjan, Marten van Schijndel, Sumeet Agarwal +1
We test the hypothesis that discourse predictability influences Hindi syntactic choice. While prior work has shown that a number of factors (e.g., information status, dependency le…
Dual Mechanism Priming Effects in Hindi Word Order
Sidharth Ranjan, Marten van Schijndel, Sumeet Agarwal +1
Word order choices during sentence production can be primed by preceding sentences. In this work, we test the DUAL MECHANISM hypothesis that priming is driven by multiple different…
All Bark and No Bite: Rogue Dimensions in Transformer Language Models Obscure Representational Quality
William Timkey, Marten van Schijndel
Similarity measures are a vital tool for understanding how language models represent and process language. Standard representational similarity measures such as cosine similarity a…
To Point or Not to Point: Understanding How Abstractive Summarizers Paraphrase Text
Matt Wilber, William Timkey, Marten Van Schijndel
Abstractive neural summarization models have seen great improvements in recent years, as shown by ROUGE scores of the generated summaries. But despite these improved metrics, there…