On the Scaling of PEFT: Towards Million Personal Models of Trillion Parameters

Mind Lab, :, Vin Bo +64

Parameter-efficient fine-tuning (PEFT) is usually treated as a cheaper alternative to full fine-tuning. We study a broader role: small trainable adapters as persistent local state…