17 citations · 33 across the 40 of their papers we have counts for
4 papers · 1 filter
Nalar: Workflow-Aware Management of Agentic Applications
Marco Laju, Donghyun Son, Saurabh Agarwal +4
LLM-driven agentic applications automate complex, multi-step tasks, but serving them efficiently remains difficult due to heterogeneous components, dynamic model-driven control flo…
Software-Defined Agentic Serving
Saurabh Agarwal, Marco Laju, Jayanth Srinivasa +2
As multi-agent LLM pipelines grow in complexity, existing serving paradigms fail to adapt to the dynamic serving conditions. We argue that agentic serving systems should be program…
Dora: QoE-Aware Hybrid Parallelism for Distributed Edge AI
Jianli Jin, Ziyang Lin, Qianli Dong +5
With the proliferation of edge AI applications, satisfying user quality of experience (QoE) requirements, such as model inference latency, has become a first class objective, as th…
Harmonia: End-to-End RAG Serving Optimization
Saurabh Agarwal, Bodun Hu, Luis Pabon +3
Retrieval-Augmented Generation (RAG) improves the reliability of large language models by integrating external knowledge, but serving RAG pipelines efficiently is challenging becau…