EncT5: A Framework for Fine-tuning T5 as Non-autoregressive Models

Frederick Liu, Terry Huang, Shihang Lyu +3

Pre-trained encoder-decoder transformer architectures have become increasingly popular recently with the advent of T5 models. T5 has also become more favorable over other architect…