activity
20222025
most citedOaken: Fast and Efficient LLM Serving with Online-Offline Hybrid KV Cache Quantization

16 citations · 21 across the 3 of their papers we have counts for

collaborators
Showing 2024Show all

1 paper · 1 filter

cs.AR2024

LPU: A Latency-Optimized and Highly Scalable Processor for Large Language Model Inference

Seungjae Moon, Jung-Hoon Kim, Junsoo Kim +14

The explosive arrival of OpenAI's ChatGPT has fueled the globalization of large language model (LLM), which consists of billions of pretrained parameters that embodies the aspects…