Near-Zero-Overhead Freshness for Recommendation Systems via Inference-Side Model Updates

Wenjun Yu, Sitian Chen, Cheng Chen +1

Deep Learning Recommendation Models (DLRMs) underpin personalized services but face a critical freshness-accuracy tradeoff due to massive parameter synchronization overheads. Produ…