Characterizing Parallelism Strategies in LLM Inference: Fundamental Compute-Communication Trade-offs

Javad Mirzaei, Jeebak Mitra

Large Language Model (LLM) inference has become the dominant workload in modern AI systems, requiring serving infrastructures to maximize throughput while meeting strict latency Se…