3 citations · 3 across the 8 of their papers we have counts for
3 papers · 1 filter
LCSB: Layer-Cyclic Selective Backpropagation for Memory-Efficient On-Device LLM Fine-Tuning
Juneyoung Park, Eunbeen Yoon, Seongwan Kim. Jaeho Lee
Memory-efficient backpropagation (MeBP) has enabled first-order fine-tuning of large language models (LLMs) on mobile devices with less than 1GB memory. However, MeBP requires back…
Memory-Efficient Structured Backpropagation for On-Device LLM Fine-Tuning
Juneyoung Park, Yuri Hong, Seongwan Kim +1
On-device fine-tuning enables privacy-preserving personalization of large language models, but mobile devices impose severe memory constraints, typically 6--12GB shared across all…
Riemannian Optimization for LoRA on the Stiefel Manifold
Juneyoung Park, Minjae Kang, Seongbae Lee +3
While powerful, large language models (LLMs) present significant fine-tuning challenges due to their size. Parameter-efficient fine-tuning (PEFT) methods like LoRA provide solution…