2 papers
cs.AR2025
SLOTH: Lightweight Detection and Localization of On-Chip Fail-Slow Failures for DNN Accelerators
Junchi Wu, Xinfei Wan, Zhuoran Li +5
Spatial DNN accelerators are essential for high-performance inference, but their performance is undermined by widespread fail-slow failures. Detecting such failures on-chip is chal…
cs.DC2025
TokenSim: Enabling Hardware and Software Exploration for Large Language Model Inference Systems
Feiyang Wu, Zhuohang Bian, Guoyang Duan +6
The increasing demand for large language model (LLM) serving has necessitated significant advancements in the optimization and profiling of LLM inference systems. As these models b…