Iterative refinement, not training objective, makes HuBERT behave differently from wav2vec 2.0

Robin Huo, Ewan Dunbar

Self-supervised models for speech representation learning now see widespread use for their versatility and performance on downstream tasks, but the effect of model architecture on…