A Systematic Characterization of LLM Inference on GPUs

Haonan Wang, Xuxin Xiao, Mingyu Yan +8

This work presents a systematic characterization of Large Language Model (LLM) inference to address fragmented understanding. Through comprehensive experiments, we establish a four…