2 papers
cs.SD2026
RVQ Position Aware Speculative Decoding for On Device Text to Speech
Berkin Durmus, Eduardo Pacheco, Zach Nagengast +1
Autoregressive decoding (AR) with Transformer models is memory bandwidth bound at single stream inference, the typical deployment regime for on device text to speech (TTS). Real ti…
cs.SD2025
WhisperKit: On-device Real-time ASR with Billion-Scale Transformers
Atila Orhon, Arda Okan, Berkin Durmus +2
Real-time Automatic Speech Recognition (ASR) is a fundamental building block for many commercial applications of ML, including live captioning, dictation, meeting transcriptions, a…