Scaling Up On-Device LLMs via Active-Weight Swapping Between DRAM and Flash

Fucheng Jia, Zewen Wu, Shiqi Jiang +7

Large language models (LLMs) are increasingly being deployed on mobile devices, but the limited DRAM capacity constrains the deployable model size. This paper introduces ActiveFlow…