6 citations · 19 across the 22 of their papers we have counts for
5 papers · 1 filter
CAST-ASD: Causal Attention over Speakers and Time for Online Active Speaker Detection
Pratham Gupta, Haotian Qi, Tushar Sandhan +1
We present CAST-ASD (Causal Attention over Speakers and Time), a causal joint model for active speaker detection (ASD). Recent ASD models improve performance by jointly processing…
Exploring Multimodal Turn-Taking Cues in Face-to-Face Conversation using Voice Activity Projection
Willem Berner, Julio Cesar Cavalcanti, Kalle Åström +1
Turn-taking is a fundamental component of spoken interaction, and while humans naturally rely on both verbal and non-verbal signals, dialogue systems usually depend on audio cues a…
MuVAP: Multimodal Multiparty Voice Activity Projection for Turn-taking Prediction in the Wild
Haotian Qi, Gabriel Skantze
Current multiparty turn-taking models often rely on complex microphone arrays or multi-camera setups, limiting their applicability in human-robot interaction scenarios. We introduc…
Do Factual Recall Mechanisms Carry over from Text to Speech in Multimodal Language Models?
Luca Modica, Filip Landin, Mehrdad Farahani +3
In recent years, several Speech Language Models (SLMs) that represent speech and written text jointly have been presented. The question then emerges about how model-internal mechan…
VoXtream2: Full-stream TTS with dynamic speaking rate control
Nikita Torgashov, Gustav Eje Henter, Gabriel Skantze
Full-stream text-to-speech (TTS) for interactive systems must start speaking with minimal delay while remaining controllable as text arrives incrementally. We present VoXtream2, a…