Techniques for Peak Memory Reduction for LoRA Fine-tuning of LLMs on Edge Devices

Hassan Dbouk, Matthias Reisser, Prathamesh Mandke +2

Fine-tuning of Large Language Models (LLMs) using Low-Rank Adaptation (LoRA) on an end-user's data offers personalized experiences while keeping data private, but faces severe memo…