activity
20242026
most citedOaken: Fast and Efficient LLM Serving with Online-Offline Hybrid KV Cache Quantization

16 citations · 17 across the 4 of their papers we have counts for

collaborators
Showing 2024Show all

1 paper · 1 filter

cs.AR2024

LPU: A Latency-Optimized and Highly Scalable Processor for Large Language Model Inference

Seungjae Moon, Jung-Hoon Kim, Junsoo Kim +14

The explosive arrival of OpenAI's ChatGPT has fueled the globalization of large language model (LLM), which consists of billions of pretrained parameters that embodies the aspects…