Layerwise Recall and the Geometry of Interwoven Knowledge in LLMs

Ge Lei, Samuel J. Cooper

This study explores how large language models (LLMs) encode interwoven scientific knowledge, using chemical elements and LLaMA-series models as a case study. We identify a 3D spira…