2 papers
cs.LG2026
MTServe: Efficient Serving for Generative Recommendation Models with Hierarchical Caches
Xin Wang, Chi Ma, Shaobin Chen +14
Generative recommendation (GR) offers superior modeling capabilities but suffers from prohibitive inference costs due to the repeated encoding of long user histories. While cross-r…
cs.DB2026
HierarchicalKV: A GPU Hash Table with Cache Semantics for Continuous Online Embedding Storage
Haidong Rong, Jiashu Yao, Matthias Langer +12
Traditional GPU hash tables preserve every inserted key -- a dictionary assumption that wastes scarce High Bandwidth Memory (HBM) when embedding tables routinely exceed single-GPU…