TriNet: stabilizing self-supervised learning from complete or slow collapse on ASR

Lixin Cao, Jun Wang, Ben Yang +2

Self-supervised learning (SSL) models confront challenges of abrupt informational collapse or slow dimensional collapse. We propose TriNet, which introduces a novel triple-branch a…