4 papers
Adaptive Turn-Taking for Real-time Multi-Party Voice Agents
Soumyajit Mitra, Prabhat Pandey, Abhinav Jain +2
Turn-taking in multi-party spoken conversations remains a fundamental challenge for voice-based agents, particularly under dynamic floor competition and varying user expectations.…
An Efficient Self-Learning Framework For Interactive Spoken Dialog Systems
Hitesh Tulsiani, David M. Chan, Shalini Ghosh +6
Dialog systems, such as voice assistants, are expected to engage with users in complex, evolving conversations. Unfortunately, traditional automatic speech recognition (ASR) system…
Streaming Speech-to-Confusion Network Speech Recognition
Denis Filimonov, Prabhat Pandey, Ariya Rastrow +2
In interactive automatic speech recognition (ASR) systems, low-latency requirements limit the amount of search space that can be explored during decoding, particularly in end-to-en…
Lattention: Lattice-attention in ASR rescoring
Prabhat Pandey, Sergio Duarte Torres, Ali Orkan Bayer +2
Lattices form a compact representation of multiple hypotheses generated from an automatic speech recognition system and have been shown to improve performance of downstream tasks l…