H-Probes: Extracting Hierarchical Structures From Latent Representations of Language Models

Cutter Dawes, Aryan Sharma, Angelos Ioannis Lagos +1

Representing and navigating hierarchy is a fundamental primitive of reasoning. Large language models have demonstrated proficiency in a wide variety of tasks requiring hierarchical…