activity
20242026
most citedInfiniGen: Efficient Generative Inference of Large Language Models with Dynamic KV Cache Management

1 citations · 1 across the 5 of their papers we have counts for

collaborators
Showing 2024Show all

2 papers · 1 filter

cs.LG2024★ 1 cited

InfiniGen: Efficient Generative Inference of Large Language Models with Dynamic KV Cache Management

Wonbeom Lee, Jungi Lee, Junghwan Seo +1

Transformer-based large language models (LLMs) demonstrate impressive performance across various natural language processing tasks. Serving LLM inference for generating long conten…

cs.LG2024

Tender: Accelerating Large Language Models via Tensor Decomposition and Runtime Requantization

Jungi Lee, Wonbeom Lee, Jaewoong Sim

Large language models (LLMs) demonstrate outstanding performance in various tasks in machine learning and have thus become one of the most important workloads in today's computing…