Emergent phases of superposition: from partial to full representation

Lihao Guo, Yizhou Liu, Jeff Gore

Large language models are thought to represent features by vectors in a hidden space of dimension given by the model's width. Superposition, in which more features are represented…