2 papers
cs.DC2026
Revealing the Challenges of Attention-FFN Disaggregation for Modern MoE Models and Hardware Systems
Guowei Liu, Hongming Li, Yaning Guo +5
Deploying large-scale MoE models presents challenges in memory capacity and bandwidth for expert activation. While Attention-FFN Disaggregation (AFD) has emerged as a potential arc…
cs.CL2026
ERNIE 5.0 Technical Report
Haifeng Wang, Hua Wu, Tian Wu +432
In this report, we introduce ERNIE 5.0, a natively autoregressive foundation model desinged for unified multimodal understanding and generation across text, image, video, and audio…