2 papers
cs.IR2026
Memory Layer: Train the In-Model Cache for Recommendation Models
Liangyuan Na, Gufan Yin, Yixin Bao +19
Early ranking stages in recommendation systems precompute item embeddings and cache them in-model for scoring within strict latency constraints. Because this cache exists only at s…
cs.IR2026
SilverTorch: A Unified Model-based System to Democratize Large-Scale Recommendation on GPUs
Bi Xue, Hong Wu, Lei Chen +29
Serving deep learning based recommendation models (DLRM) at scale is challenging. Existing approaches rely on dedicated ANN indexing and filtering services on CPUs, suffering from…