Characterizing and Optimizing LLM Inference Workloads on CPU-GPU Coupled Architectures

Prabhu Vellaisamy, Thomas Labonte, Sourav Chakraborty +3

Large language model (LLM)-based inference workloads increasingly dominate data center costs and resource utilization. Therefore, understanding the inference workload characteristi…