Weights Read and Write Features: Scalable Parameter Decomposition Grounded in Activation Space

Tue M. Cao, Lisiane Pruinelli, My T. Thai

Activation space and parameter space provide complementary views of model computation. Activations represent information, while weights read, transform, and write that information.…