2 papers
cs.DC2026
Scepsy: Serving Agentic Workflows Using Aggregate LLM Pipelines
Marcel Wagenländer, Otto White, Britannio Jarrett +6
Agentic workflows carry out complex tasks by orchestrating multiple large language models (LLMs) and tools. Serving such workflows at a target throughput with low latency is challe…
cs.DC2023
Tenplex: Dynamic Parallelism for Deep Learning using Parallelizable Tensor Collections
Marcel Wagenländer, Guo Li, Bo Zhao +2
Deep learning (DL) jobs use multi-dimensional parallelism, i.e. combining data, model, and pipeline parallelism, to use large GPU clusters efficiently. Long-running jobs may experi…