Chunky Post-Training: Data Driven Failures of Generalization

Seoirse Murray, Allison Qi, Timothy Qian +3

LLM post-training involves many diverse datasets, each targeting a specific behavior. But these datasets encode incidental patterns alongside intended ones: correlations between fo…