Sensi-BERT: Towards Sensitivity Driven Fine-Tuning for Parameter-Efficient BERT

Souvik Kundu, Sharath Nittur Sridhar, Maciej Szankin +1

Large pre-trained language models have recently gained significant traction due to their improved performance on various down-stream tasks like text classification and question ans…