Showing cs.LGShow all
3 papers · 1 filter
cs.LG2026
MTServe: Efficient Serving for Generative Recommendation Models with Hierarchical Caches
Xin Wang, Chi Ma, Shaobin Chen +14
Generative recommendation (GR) offers superior modeling capabilities but suffers from prohibitive inference costs due to the repeated encoding of long user histories. While cross-r…
cs.LG2024
MOYU: A Theoretical Study on Massive Over-activation Yielded Uplifts in LLMs
Chi Ma, Mincong Huang, Chao Wang +2
Massive Over-activation Yielded Uplifts(MOYU) is an inherent property of large language models, and dynamic activation(DA) based on the MOYU property is a clever yet under-explored…
cs.LG2024
Dynamic Activation Pitfalls in LLaMA Models: An Empirical Study
Chi Ma, Mincong Huang, Chao Wang +2
In this work, we systematically investigate the efficacy of dynamic activation mechanisms within the LLaMA family of language models. Despite the potential of dynamic activation me…