Discrete Unit based Masking for Improving Disentanglement in Voice Conversion

Philip H. Lee, Ismail Rasim Ulgen, Berrak Sisman

Voice conversion (VC) aims to modify the speaker's identity while preserving the linguistic content. Commonly, VC methods use an encoder-decoder architecture, where disentangling t…