4 citations · 8 across the 6 of their papers we have counts for
1 paper · 1 filter
Prabhu Vellaisamy, Shreesh Tripathi, Vignesh Natarajan +3
Large Language Model (LLM) inference is widely used in interactive assistants and agentic systems. In latency-sensitive deployments, inference time can become dominated by host-sid…