TASLA: Text-Aligned Speech Tokens with Multiple Layer-Aggregation

Ming-Hao Hsu, Liang-Hsuan Tseng, Hung-yi Lee +1

We propose Text-Aligned Speech Tokens with Multiple Layer-Aggregation (TASLA), which is a text-aligned speech tokenization framework that aims to address the problem that under a l…