Evaluating Parameter-Efficient Transfer Learning Approaches on SURE Benchmark for Speech Understanding

Yingting Li, Ambuj Mehrish, Shuai Zhao +5

Fine-tuning is widely used as the default algorithm for transfer learning from pre-trained models. Parameter inefficiency can however arise when, during transfer learning, all the…