FBLayout: Optimizing Memory Layout for Efficient LLM Finetuning on Mobile GPUs

Kahou Tam, Wei Niu, Yu Bao +3

Transformer-based models have enabled unprecedented capabilities across language, vision, and multimodal tasks. On-device fine-tuning of transformer models offers a privacy-preserv…