42 citations · 47 across the 6 of their papers we have counts for
6 papers
Perturbation: A simple and efficient adversarial tracer for representation learning in language models
Joshua Rozner, Cory Shain
Linguistic representation learning in deep neural language models (LMs) has been studied for decades, but finding representations in LMs remains an unsolved problem. On the one han…
BabyLM's First Constructions: Causal probing provides a signal of learning
Joshua Rozner, Leonie Weissweiler, Cory Shain
Construction grammar posits that language learners acquire constructions (form-meaning pairings) from the statistics of their environment. Recent work supports this hypothesis by s…
Constructions are Revealed in Word Distributions
Joshua Rozner, Leonie Weissweiler, Kyle Mahowald +1
Construction grammar posits that constructions, or form-meaning pairings, are acquired through experience with language (the distributional learning hypothesis). But how much infor…
Inducing Causal Structure for Interpretable Neural Networks
Atticus Geiger, Zhengxuan Wu, Hanson Lu +5
In many areas, we have well-founded insights about causal structure that would be useful to bring into our trained models while still allowing them to learn in a data-driven fashio…
Decrypting Cryptic Crosswords: Semantically Complex Wordplay Puzzles as a Target for NLP
Josh Rozner, Christopher Potts, Kyle Mahowald
Cryptic crosswords, the dominant crossword variety in the UK, are a promising target for advancing NLP systems that seek to process semantically complex, highly compositional langu…
Finding Rare AGN: X-ray Number Counts of Chandra Sources in Stripe 82
Stephanie M. LaMassa, C. Megan Urry, Eilat Glikman +14
We present the first results of a wide area X-ray survey within the Sloan Digital Sky Survey (SDSS) Stripe 82, a 300 deg region of the sky with a substantial investment in mult…