2 papers
cs.CL2026
Micro Language Models Enable Instant Responses
Wen Cheng, Tuochao Chen, Karim Helwani +3
Edge devices such as smartwatches and smart glasses cannot continuously run even the smallest 100M-1B parameter language models due to power and compute constraints, yet cloud infe…
cs.LG2026
A Hierarchical End-of-Turn Model with Primary Speaker Segmentation for Real-Time Conversational AI
Karim Helwani, Hoang Do, James Luan +1
We present a real-time front-end for voice-based conversational AI to enable natural turn-taking in two-speaker scenarios by combining primary speaker segmentation with hierarchica…