355 citations · 440 across the 13 of their papers we have counts for
6 papers · 1 filter
Towards MoE Deployment: Mitigating Inefficiencies in Mixture-of-Expert (MoE) Inference
Haiyang Huang, Newsha Ardalani, Anna Sun +6
Mixture-of-Experts (MoE) models have gained popularity in achieving state-of-the-art performance in a wide range of tasks in computer vision and natural language processing. They e…
DisaggRec: Architecting Disaggregated Systems for Large-Scale Personalized Recommendation
Liu Ke, Xuan Zhang, Benjamin Lee +2
Deep learning-based personalized recommendation systems are widely used for online user-facing services in production datacenters, where a large amount of hardware resources are pr…
Hercules: Heterogeneity-Aware Inference Serving for At-Scale Personalized Recommendation
Liu Ke, Udit Gupta, Mark Hempstead +3
Personalized recommendation is an important class of deep-learning applications that powers a large collection of internet services and consumes a considerable amount of datacenter…
DeepRecSys: A System for Optimizing End-To-End At-scale Neural Recommendation Inference
Udit Gupta, Samuel Hsia, Vikram Saraph +6
Neural personalized recommendation is the corner-stone of a wide collection of cloud services and products, constituting significant compute demand of the cloud infrastructure. Thu…
RecNMP: Accelerating Personalized Recommendation with Near-Memory Processing
Liu Ke, Udit Gupta, Carole-Jean Wu +18
Personalized recommendation systems leverage deep learning models and account for the majority of data center AI cycles. Their performance is dominated by memory-bound sparse embed…
The Architectural Implications of Facebook's DNN-based Personalized Recommendation
Udit Gupta, Carole-Jean Wu, Xiaodong Wang +12
The widespread application of deep learning has changed the landscape of computation in the data center. In particular, personalized recommendation for content ranking is now large…