EARN: Efficient Inference Acceleration for LLM-based Generative Recommendation by Register Tokens

Chaoqun Yang, Xinyu Lin, Wenjie Wang +4

Large Language Model-based generative recommendation (LLMRec) has achieved notable success, but it suffers from high inference latency due to massive computational overhead and mem…