most citedThroughput-Oriented LLM Inference via KV-Activation Hybrid Caching with a Single GPU

1 citations · 1 across the 3 of their papers we have counts for

collaborators
Showing cs.ARShow all

1 paper · 1 filter

cs.AR2025

Hardware-based Heterogeneous Memory Management for Large Language Model Inference

Soojin Hwang, Jungwoo Kim, Sanghyeon Lee +2

A large language model (LLM) is one of the most important emerging machine learning applications nowadays. However, due to its huge model size and runtime increase of the memory fo…