4 citations · 12 across the 17 of their papers we have counts for
7 papers · 1 filter
VineLM: Trie-Based Fine-Grained Control for Agentic Workflows
Nikos Pagonas, Matthew Lou, Tianyi Peng +2
Agentic workflows interleave configurable LLM stages with tool stages and often include retries or refinement loops. Existing workflow managers profile full workflow configurations…
Cortex: Workflow-Aware Resource Pooling and Scheduling for Agentic Serving
Nikos Pagonas, Yeounoh Chung, Kostis Kaffes +1
We introduce Cortex, a prototype workflow-aware serving platform designed for agentic workloads. The core principle of Cortex is stage isolation: it provisions dedicated resource p…
Toward Systems Foundations for Agentic Exploration
Jiakai Xu, Tianle Zhou, Eugene Wu +1
Agentic exploration, letting LLM-powered agents branch, backtrack, and search across many execution paths, demands systems support well beyond today's pass-at-k resets. Our benchma…
Shabari: Delayed Decision-Making for Faster and Efficient Serverless Functions
Prasoon Sinha, Kostis Kaffes, Neeraja J. Yadwadkar
Serverless computing relieves developers from the burden of resource management, thus providing ease-of-use to the users and the opportunity to optimize resource utilization for th…
Towards Fast, Adaptive, and Hardware-Assisted User-Space Scheduling
Lisa, Li, Nikita Lazarev +7
Modern datacenter applications are prone to high tail latencies since their requests typically follow highly-dispersive distributions. Delivering fast interrupts is essential to re…
Practical Scheduling for Real-World Serverless Computing
Kostis Kaffes, Neeraja J. Yadwadkar, Christos Kozyrakis
Serverless computing has seen rapid growth due to the ease-of-use and cost-efficiency it provides. However, function scheduling, a critical component of serverless systems, has bee…
RackSched: A Microsecond-Scale Scheduler for Rack-Scale Computers (Technical Report)
Hang Zhu, Kostis Kaffes, Zixu Chen +4
Low-latency online services have strict Service Level Objectives (SLOs) that require datacenter systems to support high throughput at microsecond-scale tail latency. Dataplane oper…