Showing cs.DCShow all
2 papers · 1 filter
cs.DC2026
Scaling LLM Inference via Parallelism: Throughput-Latency Trade-off
Javad Mirzaei, Jeebak Mitra
Large Language Model (LLM) serving systems must balance latency and throughput while efficiently utilizing distributed GPU resources. This challenge arises because inference consis…
cs.DC2026
Characterizing Parallelism Strategies in LLM Inference: Fundamental Compute-Communication Trade-offs
Javad Mirzaei, Jeebak Mitra
Large Language Model (LLM) inference has become the dominant workload in modern AI systems, requiring serving infrastructures to maximize throughput while meeting strict latency Se…