Compressing Streaming Neural Audio Encoders via Latent-Space Distillation

Prasanth Yadla, Mohammad Samragh, Dongseong Hwang +7

System-wide Dictation on Apple devices runs entirely on-device, and the speech it transcribes reaches the foundation model through a tokenizer: an encoder that maps short windows o…