6 papers
The Changing Geometry of Grammar: Dimensionality and Neighborhood Reorganization across Transformer Layers
Samuele Vallisa, Federico Ravenda, Claudio Palominos +5
Transformer representations describe trajectories through high-dimensional vector spaces, which are shaped dynamically as tokens incorporate relational context across layers. Such…
Activation-Guided Neuron Intervention to Induce Alzheimer's-Related Computational Language Phenotypes in a Large Language Model
Rui He, Ercong Nie, Hong Jiang +3
Changes in spontaneous speech provide an early signal of cognitive dysfunction in Alzheimer's disease (AD) that large language models (LLMs) can detect. However, detection alone ca…
Deviance from a pink noise regime in the temporal organization of semantic relations in psychosis
Paola Moreno Ancalmo, Emre Bora, Rieke Roxanne Mülfarth +5
The notion of pink noise refers to 'scale-invariant' temporal dynamics, where fluctuations exhibit similar statistical structure across time scales. Departures from a regime associ…
Early psychosis shows deviations in scaling behaviour within a critical regime
Irem Topal, Paola Moreno Ancalmo, Guillermo Montaña-Valverde +2
Accumulating evidence suggests that large-scale brain activity exhibits scale-invariant dynamics consistent with operation in a near-critical regime. Such dynamics have been associ…
The grip of grammar on meaning uncertainty: cross-linguistic evidence, neural correlates, and clinical relevance
Rui He, Claudio Palominos, Samuele Vallisa +16
Isolated word meanings are inherently uncertain. This uncertainty reduces when they are combined and anchored in context. We propose that grammar compresses meaning uncertainty cro…
Cross-lingual brain-language model alignment is robust but challenges hierarchical and computational accounts
Ni Yang, Rui He, Philipp Homan +3
Brain-language model alignment is often interpreted as evidence that transformer models implement computations similar to those of the human brain. This assumes that neural predict…