5 papers
GRACE: Generative Recommender Acceleration Engine for Real-Time Ads Retrieval
Zhou Fang, Yuhang Huang, Ang Zhang +12
Productionizing generative recommenders for high-volume, real-time ads retrieval creates two serving challenges: eligibility, ensuring that each generated ad is eligible for the re…
GR2 Technical Report
Yufei Li, Zaiwei Zhang, Mingfu Liang +67
Industrial recommendation systems serve billions of users through a multi-stage funnel -- retrieval, early-stage ranking, and re-ranking -- where the final re-ranking step dispropo…
KernelEvolve: Scaling Agentic Kernel Coding for Heterogeneous AI Accelerators at Meta
Gang Liao, Hongsen Qin, Ying Wang +36
Making deep learning recommendation model (DLRM) training and inference fast and efficient is important. However, this presents three key system challenges - model architecture div…
External Large Foundation Model: How to Efficiently Serve Trillions of Parameters for Online Ads Recommendation
Mingfu Liang, Xi Liu, Rong Jin +104
Ads recommendation is a prominent service of online advertising systems and has been actively studied. Recent studies indicate that scaling-up and advanced design of the recommenda…
Understanding Capacity-Driven Scale-Out Neural Recommendation Inference
Michael Lui, Yavuz Yetim, Özgür Özkan +4
Deep learning recommendation models have grown to the terabyte scale. Traditional serving schemes--that load entire models to a single server--are unable to support this scale. One…