Showing cs.CLShow all
2 papers · 1 filter
cs.CL2026
H-Probes: Extracting Hierarchical Structures From Latent Representations of Language Models
Cutter Dawes, Aryan Sharma, Angelos Ioannis Lagos +1
Representing and navigating hierarchy is a fundamental primitive of reasoning. Large language models have demonstrated proficiency in a wide variety of tasks requiring hierarchical…
cs.CL2026
Dissociating Decodability and Causal Use in Bracket-Sequence Transformers
Aryan Sharma, Cutter Dawes, Shivam Raval
When trained on tasks requiring an understanding of hierarchical structure, transformers have been found to represent this hierarchy in distinct ways: in the geometry of the residu…