5 citations · 5 across the 2 of their papers we have counts for
Showing cs.ARShow all
2 papers · 1 filter
cs.AR2026
PATTON: Enabling Commodity PIM for Production LLM Serving
Hangyeol Kim, Sanghyun Lee, Teokkyu Suh +1
Processing-in-Memory (PIM) is promising for accelerating memory-bound decode attention, but attention acceleration alone is insufficient for production LLM serving, where engines d…
cs.AR2024
LPU: A Latency-Optimized and Highly Scalable Processor for Large Language Model Inference
Seungjae Moon, Jung-Hoon Kim, Junsoo Kim +14
The explosive arrival of OpenAI's ChatGPT has fueled the globalization of large language model (LLM), which consists of billions of pretrained parameters that embodies the aspects…