Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
Techniques for Peak Memory Reduction for LoRA Fine-tuning of LLMs on Edge Devices
Hassan Dbouk, Matthias Reisser, Prathamesh Mandke +2
Fine-tuning of Large Language Models (LLMs) using Low-Rank Adaptation (LoRA) on an end-user's data offers personalized experiences while keeping data private, but faces severe memo…
cs.LG2026
On Adaptivity in Zeroth-Order Optimization
Hassan Dbouk, Nidham Gazagnadou, Matthias Reisser +1
We investigate the effectiveness of adaptive zeroth-order (ZO) optimization for memory-constrained fine-tuning of large language models (LLMs). Contrary to prior claims, we show th…