5% > 100%: Flatness Preference is All You Need for Multimodal Parameter-Efficient Fine-Tuning

Yifan Zhu, Can Lin, Hangjie Yuan +4

Parameter-Efficient Fine-Tuning (PEFT) methods provide a streamlined and efficient tool for adapting large models to domain-specific multimodal downstream tasks. Although these met…