Disentangling Linguistic and Paralinguistic Information with Routed Sparse Autoencoders

Beimnet Bekele Guta, Xiaoyu Yang, Guangzhi Sun +1

Self-supervised speech encoders contain linguistic and paralinguistic information in a shared, entangled representation space. We combine a TopK sparse autoencoder with route-speci…