EStream: Fast and Memory-Efficient MoE Prefill through Expert Virtualization on Mobile NPUs

Junming Zhang, Zhenzhe Zheng, Fan Wu +2

Mobile vendors and application developers increasingly deploy LLMs on smartphones for diverse prefill-only services. Yet current systems rely mainly on dense models whose regular c…