Showing cs.DCShow all
2 papers · 1 filter
cs.DC2026
Dissecting the Carbon-SLO Tension in Geo-Distributed LLM Serving
Burak Topcu, Musa Cim, Zuhal Ozturk +1
Large Language Model (LLM) inference is driving a growing share of datacenter carbon emissions. Although carbon-aware scheduling can reduce these emissions in geo-distributed datac…
cs.DC2026
Parallelization Strategies for Dense LLM Deployment: Navigating Through Application-Specific Tradeoffs and Bottlenecks
Burak Topcu, Musa Oguzhan Cim, Poovaiah Palangappa +2
Breakthroughs in the generative AI domain have fueled an explosion of large language model (LLM)-powered applications, whose workloads fundamentally consist of sequences of inferen…