2 citations · 3 across the 3 of their papers we have counts for
3 papers
cs.AR2025
Hardware-based Heterogeneous Memory Management for Large Language Model Inference
Soojin Hwang, Jungwoo Kim, Sanghyeon Lee +2
A large language model (LLM) is one of the most important emerging machine learning applications nowadays. However, due to its huge model size and runtime increase of the memory fo…
cs.DC2025★ 1 cited
Throughput-Oriented LLM Inference via KV-Activation Hybrid Caching with a Single GPU
Sanghyeon Lee, Hongbeen Kim, Soojin Hwang +3
Large language models (LLMs) with growing model sizes use many GPUs to meet memory capacity requirements, incurring substantial costs for token generation. To provide cost-effectiv…
cs.DC2021★ 2 cited
Hardware-assisted Trusted Memory Disaggregation for Secure Far Memory
Taekyung Heo, Seunghyo Kang, Sanghyeon Lee +2
Memory disaggregation provides efficient memory utilization across network-connected systems. It allows a node to use part of memory in remote nodes in the same cluster. Recent stu…