Parameter-Efficient Tuning on Layer Normalization for Pre-trained Language Models

Wang Qi, Yu-Ping Ruan, Yuan Zuo +1

Conventional fine-tuning encounters increasing difficulties given the size of current Pre-trained Language Models, which makes parameter-efficient tuning become the focal point of…