Deep Recommender Models Inference: Automatic Asymmetric Data Flow Optimization

Giuseppe Ruggeri, Renzo Andri, Daniele Jahier Pagliari +1

Deep Recommender Models (DLRMs) inference is a fundamental AI workload accounting for more than 79% of the total AI workload in Meta's data centers. DLRMs' performance bottleneck i…