Efficiency Unleashed: Inference Acceleration for LLM-based Recommender Systems with Speculative Decoding

Yunjia Xi, Hangyu Wang, Bo Chen +7

The past few years have witnessed a growing interest in LLM-based recommender systems (RSs), although their industrial deployment remains in a preliminary stage. Most existing depl…