SilverTorch: A Unified Model-based System to Democratize Large-Scale Recommendation on GPUs

Bi Xue, Hong Wu, Lei Chen +29

Serving deep learning based recommendation models (DLRM) at scale is challenging. Existing approaches rely on dedicated ANN indexing and filtering services on CPUs, suffering from…