Shift is Good: Mismatched Data Mixing Improves Test Performance

Marko Medvedev, Kaifeng Lyu, Zhiyuan Li +1

We consider training and testing on mixture distributions with different training and test proportions. We show that in many settings, and in some sense generically, distribution s…