2 papers
cs.DC2025
MatKV: Trading Compute for Flash Storage in LLM Inference
Kun-Woo Shin, Jay H. Park, Moonwook Oh +3
We observe two major trends in LLM-based generative AI: (1) inference is becoming the dominant factor in terms of cost and power consumption, surpassing training, and (2) retrieval…
cs.DC2025
Accelerating LLM Inference with Precomputed Query Storage
Jay H. Park, Youngju Cho, Choungsol Lee +2
Large language model (LLM) inference often suffers from high latency, particularly in resource-constrained environments such as on-device or edge deployments. To address this chall…