Cluster Assignments in Soft Targets Shape Speech Representations: Evidence from S-JEPA

Wenxuan He, Yunpeng Li, Zewei Li +4

Cluster-based prediction is widely used in self-supervised speech learning. A soft target preserves a distribution over clusters rather than a single label. This distribution speci…