KernelSight-LM: A Kernel-Level LLM Inference Simulator

Xiteng Yao, Taeho Kim, Hengzhi Pei +7

As large language models (LLMs) move into production serving, practitioners must rapidly evaluate inference performance across diverse hardware, models, and serving parameters to m…