Simple and Effective Gradient-Based Tuning of Sequence-to-Sequence Models

Jared Lichtarge, Chris Alberti, Shankar Kumar

Recent trends towards training ever-larger language models have substantially improved machine learning performance across linguistic tasks. However, the huge cost of training larg…