RcLLM: Accelerating Generative Recommendation via Beyond-Prefix KV Caching

Zhan Zhao, Yuxin Wang, Amelie Chi Zhou

Large Language Models (LLMs) are transforming recommendation from ranking into a generative task, but industrial deployment remains limited by the high latency of processing long,…