2 papers
cs.LG2026
Lever: Speculative LLM Inference on Smartphones
Tuowei Wang, Fengzu Li, Yanfan Sun +2
Large language models (LLMs) are increasingly needed for interactive mobile applications, but high-quality models exceed the limited DRAM available on smartphones. Flash storage ca…
cs.DC2025
DynaKV: Enabling Accurate and Efficient Long-Sequence LLM Decoding on Smartphones
Tuowei Wang, Minxing Huang, Fengzu Li +3
As the demand for human-like reasoning, multi-turn dialogues, and long-form responses grows, large language models (LLMs) are increasingly expected to support efficient and effecti…