Characterizing Stereotypical Bias from Privacy-preserving Pre-Training

Stefan Arnold, Rene Gröbner, Annika Schreiner

Differential Privacy (DP) can be applied to raw text by exploiting the spatial arrangement of words in an embedding space. We investigate the implications of such text privatizatio…