Fairness Feedback Loops: Training on Synthetic Data Amplifies Bias

Sierra Wyllie, Ilia Shumailov, Nicolas Papernot

Model-induced distribution shifts (MIDS) occur as previous model outputs pollute new model training sets over generations of models. This is known as model collapse in the case of…