activity
20242026
most citedThe Efficiency vs. Accuracy Trade-off: Optimizing RAG-Enhanced LLM Recommender Systems Using Multi-Head Early Exit

1 citations · 1 across the 12 of their papers we have counts for

collaborators
Showing 2026 · cs.LGShow all

2 papers · 2 filters

cs.LG2026

Multi-Gate Residuals

Zhizhan Zheng, Feiyun Zhang, Shuchun Liu +4

While Attention Residuals has shown some effectiveness in addressing the widespread issue of unbounded activation growth across deep residual layers, it inevitably incurs significa…

cs.LG2026

A Replicate-and-Quantize Strategy for Plug-and-Play Load Balancing of Sparse Mixture-of-Experts LLMs

Zijie Liu, Jie Peng, Jinhao Duan +7

Sparse Mixture-of-Experts (SMoE) architectures are increasingly used to scale large language models efficiently, delivering strong accuracy under fixed compute budgets. However, SM…