1 citations · 1 across the 3 of their papers we have counts for
4 papers
Chronos: Efficient Bolt-on Branching Across Data Stores for Stateful Agentic Applications
Xinjing Zhou, Jason Mohoney, Samuel Madden +2
Data-centric applications increasingly use speculative execution to explore multiple candidate paths where each path modifies state distributed across heterogeneous data stores. Th…
Is the GPU Half-Empty or Half-Full? Practical Scheduling Techniques for LLMs
Ferdi Kossmann, Bruce Fontaine, Daya Khudia +2
Serving systems for Large Language Models (LLMs) improve throughput by processing several requests concurrently. However, multiplexing hardware resources between concurrent request…
CascadeServe: Unlocking Model Cascades for Inference Serving
Ferdi Kossmann, Ziniu Wu, Alex Turk +3
Machine learning (ML) models are increasingly deployed to production, calling for efficient inference serving systems. Efficient inference serving is complicated by two challenges:…
Kairos: Efficient Temporal Graph Analytics on a Single Machine
Joana M. F. da Trindade, Julian Shun, Samuel Madden +1
Many important societal problems are naturally modeled as algorithms over temporal graphs. To date, however, most graph processing systems remain inefficient as they rely on distri…