Pre-training interventions, ex post facto: Grafting model beliefs across checkpoints

Peter Nutter, Dani Roytburg, Clément Dumas +2

Pre-training interventions are critical to alignment research, since beliefs formed during pre-training shape how a model generalizes from later training. One recently popular tech…