Features Emerge as Discrete States: The First Application of SAEs to 3D Representations

Albert Miao, Chenliang Zhou, Jiawei Zhou +1

Sparse Autoencoders (SAEs) are a powerful dictionary learning technique for decomposing neural network activations, translating the hidden state into human ideas with high semantic…