activity
20242026
most citedHydraInfer: Hybrid Disaggregated Scheduling for Multimodal Large Language Model Serving

1 citations · 1 across the 7 of their papers we have counts for

collaborators
Showing cs.AIShow all

1 paper · 1 filter

cs.AI2026

SpecFit: Not All Draft Tokens Cost the Same in Offloaded MoE Inference

Hongliang Cao, Xiuyu Li, Siqi Wang +3

Mixture-of-experts (MoE) models activate only a few experts per token, but when their expert weights are offloaded to host memory, host-to-device (H2D) expert transfers enter the c…