Showing 2025Show all
2 papers · 1 filter
cs.LG2025
DEER: Draft with Diffusion, Verify with Autoregressive Models
Zicong Cheng, Guo-Wei Yang, Jia Li +3
Efficiency, as a critical practical challenge for LLM-driven agentic and reasoning systems, is increasingly constrained by the inherent latency of autoregressive (AR) decoding. Spe…
cs.DC2025
Huawei Cloud Model-as-a-Service on the CloudMatrix384 SuperPod
Ao Xiao, Bangzheng He, Baoquan Zhang +125
Scaled-out MoE LLMs and scaled-up SuperPods create new systems challenges for production Model-as-a-Service (MaaS), requiring disaggregation, low-latency communication, and decentr…