SOLARIS: Speculative Offloading of Latent-bAsed Representation for Inference Scaling

Zikun Liu, Liang Luo, Qianru Li +31

Recent advances in recommendation scaling laws have led to foundation models of unprecedented complexity. While these models offer superior performance, their computational demands…