1 citations · 2 across the 13 of their papers we have counts for
5 papers · 1 filter
One Threshold Is Not Enough: Prompt-Invariant Caching Schedules for Video Diffusion
Om Agrawal, Saurabh Agarwal, Aditya Akella
Video diffusion models remain expensive because denoising repeatedly evaluates a costly model backbone. Dynamic caching methods like TeaCache, EasyCache, and DiCache reduce this co…
Sangam: Efficiently Serving Diffusion LLMs with the AR Stack
Nitin Kedia, Saurabh Agarwal, Myungjin Lee +1
Diffusion language models (dLLMs) generate text by iteratively denoising a masked response and can commit multiple output positions per model invocation. Their bidirectional attent…
CUCo: An Agentic Framework for Compute and Communication Co-design
Yoga Sri Varshan Varadharajan, Bodun Hu, Saurabh Agarwal +1
Computation and communication in distributed LLM training and inference are traditionally optimized in isolation; expert-crafted systems such as DeepEP, FLUX, and TokenWeave show t…
Nalar: Workflow-Aware Management of Agentic Applications
Marco Laju, Donghyun Son, Saurabh Agarwal +4
LLM-driven agentic applications automate complex, multi-step tasks, but serving them efficiently remains difficult due to heterogeneous components, dynamic model-driven control flo…
Software-Defined Agentic Serving
Saurabh Agarwal, Marco Laju, Jayanth Srinivasa +2
As multi-agent LLM pipelines grow in complexity, existing serving paradigms fail to adapt to the dynamic serving conditions. We argue that agentic serving systems should be program…