Stochastic Communication Avoidance for Recommendation Systems

Lutfi Eren Erdogan, Vijay Anand Raghava Kanakagiri, Kurt Keutzer +1

One of the major bottlenecks for efficient deployment of neural network based recommendation systems is the memory footprint of their embedding tables. Although many neural network…