SPAD: Specialized Prefill and Decode Hardware for Disaggregated LLM Inference

Hengrui Zhang, Pratyush Patel, August Ning +1

Large Language Models (LLMs) have gained popularity in recent years, driving up the demand for inference. LLM inference is composed of two phases with distinct characteristics: a c…