4 papers
MTVA-Bench: Evaluating the Language Model Inside Cascaded Voice Agents
Pritish Mishra, Ishaan Kumar, Akshat Mandoli +1
Generally, most voice agents are cascaded systems, i.e., an ASR model transcribes the caller's audio, a language model reads the transcript and decides what to say and which backen…
DLLM-TTS: Block Discrete Diffusion Language Model for Text-to-Speech Synthesis
Wasim Madha, Nityanand Mathur, Hamees Sayed +4
Current text-to-speech systems face a trade-off: autoregres- sive codec language models produce highly intelligible speech but require large-scale models and training data and deco…
How Do Instructions Shape Speech? Cross-Attention Attribution for Style-Captioned Text-to-Speech
Nityanand Mathur, Hamees Sayed, Wasim Madha +4
Style-captioned text-to-speech systems use natural language to control voice characteristics, but how individual words influence acoustic output remains unclear. Understanding this…
Rewriting TTS Inference Economics: Lightning V2 on Tenstorrent Achieves 4x Lower Cost Than NVIDIA L40S
Ranjith M. S., Akshat Mandloi, Sudarshan Kamath
Text-to-Speech (TTS) models are significantly more numerically fragile than Large Language Models (LLMs) due to their continuous waveform generation and perceptual sensitivity to s…