Lever: Speculative LLM Inference on Smartphones

Tuowei Wang, Fengzu Li, Yanfan Sun +2

Large language models (LLMs) are increasingly needed for interactive mobile applications, but high-quality models exceed the limited DRAM available on smartphones. Flash storage ca…