FLAME: A Serving System Optimized for Large-Scale Generative Recommendation with Efficiency

Xianwen Guo, Bin Huang, Xiaomeng Wu +6

Generative recommendation (GR) models possess greater scaling power compared to traditional deep learning recommendation models (DLRMs), yet they also impose a tremendous increase…