236 citations · 1.8k across the 47 of their papers we have counts for
Showing 2026Show all
2 papers · 1 filter
cs.NI2026
TopoCompress: Topology Aware Token Compression Algorithm for Distributed Edge MoE Inference
Ning Li, Xinyu Wang, Xin Yuan +3
Mixture-of-experts (MoE) models improve capacity with moderate overhead by sparsely activating experts per token. However, deploying MoE across resource-constrained edge servers in…
cs.NI2026
OrderMoE: An expert similarity driven distributed edge MoE inference
Xin Yuan, Ning Li, Quan Chen +2
Although mixture-of-experts, MoE, models have been increasingly adopted to scale large language models with moderate computation cost, it remains challenging to deploy MoE inferenc…