Erased, Rerouted, or Rescaled? Post-Training and the Causal Quotient of a Language Model's Belief State

Weihan Li, Tianshi Zheng, Junhao Wu +1

What happens to information a pretrained model already encodes when post-training no longer rewards using it? The common language of representation compression conflates three fate…