CoBERT: Self-Supervised Speech Representation Learning Through Code Representation Learning

Chutong Meng, Junyi Ao, Tom Ko +2

Speech is the surface form of a finite set of phonetic units, which can be represented by discrete codes. We propose the Code BERT (CoBERT) approach for self-supervised speech repr…