TokenSim: Enabling Hardware and Software Exploration for Large Language Model Inference Systems

Feiyang Wu, Zhuohang Bian, Guoyang Duan +6

The increasing demand for large language model (LLM) serving has necessitated significant advancements in the optimization and profiling of LLM inference systems. As these models b…