2 papers
cs.AR2026
Adaptive Multi-Objective Tiered Storage Configuration for KV Cache in LLM Service
Xianzhe Zheng, Zhengheng Wang, Ruiyan Ma +17
The memory-for-computation paradigm of KV caching is essential for accelerating large language model (LLM) inference service, but limited GPU high-bandwidth memory (HBM) capacity m…
cs.CL2026
A Two-Stage GPU Kernel Tuner Combining Semantic Refactoring and Search-Based Optimization
Qiuyi Qu, Yicheng Sui, Yufei Sun +5
GPU code optimization is a key performance bottleneck for HPC workloads as well as large-model training and inference. Although compiler optimizations and hand-written kernels can…