7 citations · 10 across the 3 of their papers we have counts for
3 papers
cs.AR2025
SPAD: Specialized Prefill and Decode Hardware for Disaggregated LLM Inference
Hengrui Zhang, Pratyush Patel, August Ning +1
Large Language Models (LLMs) have gained popularity in recent years, driving up the demand for inference. LLM inference is composed of two phases with distinct characteristics: a c…
cs.AR2023★ 3 cited
A Hardware Evaluation Framework for Large Language Model Inference
Hengrui Zhang, August Ning, Rohan Prabhakar +1
The past year has witnessed the increasing popularity of Large Language Models (LLMs). Their unprecedented scale and associated high hardware cost have impeded their broader adopti…
cs.AR2023★ 7 cited
Duet: Creating Harmony between Processors and Embedded FPGAs
Ang Li, August Ning, David Wentzlaff
The demise of Moore's Law has led to the rise of hardware acceleration. However, the focus on accelerating stable algorithms in their entirety neglects the abundant fine-grained ac…