4 papers
Simple and Effective Gradient-Based Tuning of Sequence-to-Sequence Models
Jared Lichtarge, Chris Alberti, Shankar Kumar
Recent trends towards training ever-larger language models have substantially improved machine learning performance across linguistic tasks. However, the huge cost of training larg…
Data Weighted Training Strategies for Grammatical Error Correction
Jared Lichtarge, Chris Alberti, Shankar Kumar
Recent progress in the task of Grammatical Error Correction (GEC) has been driven by addressing data sparsity, both through new methods for generating large and noisy pretraining d…
Corpora Generation for Grammatical Error Correction
Jared Lichtarge, Chris Alberti, Shankar Kumar +3
Grammatical Error Correction (GEC) has been recently modeled using the sequence-to-sequence framework. However, unlike sequence transduction problems such as machine translation, G…
Weakly Supervised Grammatical Error Correction using Iterative Decoding
Jared Lichtarge, Christopher Alberti, Shankar Kumar +2
We describe an approach to Grammatical Error Correction (GEC) that is effective at making use of models trained on large amounts of weakly supervised bitext. We train the Transform…