1 paper · 1 filter
Bin Ma, Wenjie Fan, Jialin Liu +2
Mixture-of-Experts (MoE) decoding on scratchpad-based tensor accelerators (STA) is dominated by moving expert weights while the compute engines sit idle. This traffic is hard to hi…