Scalable Context Orchestration for Serving LLMs Over Voice

Linyi Jiang, Silvery D. Fu, Yifei Zhu

Voice AI applications are gaining popularity as advances in large language models (LLMs) enable more natural and accessible spoken interactions. Serving these applications requires…