Showing cs.LGShow all
2 papers · 1 filter
cs.LG2025
Specter: Fast MoE Inference via Quantization-Enabled Multi-Step Speculative Offloading
Wenfeng Wang, Jiacheng Liu, Xiaofeng Hou +7
Mixture-of-experts (MoE) models often exceed a single accelerator's memory capacity. Offloading experts to host memory creates a severe PCIe I/O bottleneck because data-dependent r…
cs.LG2025
PEAR: Planner-Executor Agent Robustness Benchmark
Shen Dong, Mingxuan Zhang, Pengfei He +4
Large Language Model (LLM)-based Multi-Agent Systems (MAS) have emerged as a powerful paradigm for tackling complex, multi-step tasks across diverse domains. However, despite their…