117 citations · 142 across the 5 of their papers we have counts for
Showing cs.ARShow all
2 papers · 1 filter
cs.AR2026
Simthesizer: An Agent-Driven Simulation Framework for LLM Serving Systems
Wonung Kim, Hyunmin Choi, Minsu Kim +3
System-level simulation is an essential tool for exploring the rapidly expanding design space of LLM serving systems, where real deployments remain costly and often infeasible. How…
cs.AR2024★ 117 cited
NeuPIMs: NPU-PIM Heterogeneous Acceleration for Batched LLM Inferencing
Guseul Heo, Sangyeop Lee, Jaehong Cho +6
Modern transformer-based Large Language Models (LLMs) are constructed with a series of decoder blocks. Each block comprises three key components: (1) QKV generation, (2) multi-head…