The Geometry of Learning: Read-Write Asymmetry Across Training

Valeria Ruscio, Eli-Shaoul Khedouri, Keiran Thompson

Pretraining and alignment update the same transformer weights, and we ask in which directions each stage changes them. The residual stream gives every matrix a shared coordinate sy…