Where Pretraining writes and Alignment reads: the asymmetry of Transformer weight space

Valeria Ruscio, Eli-Shaoul Khedouri, Keiran Thompson

Cross-entropy pretraining and preference alignment update the same transformer weights, but leave geometrically distinct traces. We characterise this asymmetry with a relative-subs…