PEANuT: Parameter-Efficient Adaptation with Weight-aware Neural Tweakers

Yibo Zhong, Haoxiang Jiang, Lincan Li +5

Fine-tuning large pre-trained foundation models often yields excellent downstream performance but is prohibitively expensive when updating all parameters. Parameter-efficient fine-…