3 citations · 3 across the 4 of their papers we have counts for
5 papers
A scaling law of contextual persistence in human language
Elan Barenholtz
Human language exhibits lawful structure at the level of words (frequency, vocabulary growth) and word pairs (co-occurrence across distance). Here we show that the arrangement of w…
Trajectory Dynamics in Language Model Hidden States Predict Human Processing Costs Beyond Surprisal
Elan Barenholtz
Human language comprehension unfolds sequentially: each word is processed in the context of those that came before, and the interpretation builds incrementally over time. Surprisal…
World Properties without World Models: Distributional Associations and the Interpretation of Decoding Results from Language Models
Elan Barenholtz
A growing literature shows that variables can be linearly decoded from the activations of large language models (LLMs). These range from properties of the world, such as the locati…
The Role of Bio-Inspired Modularity in General Learning
Rachel A. StClair, William Edward Hahn, Elan Barenholtz
One goal of general intelligence is to learn novel information without overwriting prior learning. The utility of learning without forgetting (CF) is twofold: first, the system can…
A Systematic Comparison of Deep Learning Architectures in an Autonomous Vehicle
Michael Teti, William Edward Hahn, Shawn Martin +2
Self-driving technology is advancing rapidly --- albeit with significant challenges and limitations. This progress is largely due to recent developments in deep learning algorithms…