29 citations · 134 across the 10 of their papers we have counts for
Showing 2020Show all
2 papers · 1 filter
cs.CL2020
Multi-timescale Representation Learning in LSTM Language Models
Shivangi Mahto, Vy A. Vo, Javier S. Turek +1
Language models must capture statistical dependencies between words at timescales ranging from very short to very long. Earlier work has demonstrated that dependencies in natural l…
cs.CL2020
Selecting Informative Contexts Improves Language Model Finetuning
Richard Antonello, Nicole Beckage, Javier Turek +1
Language model fine-tuning is essential for modern natural language processing, but is computationally expensive and time-consuming. Further, the effectiveness of fine-tuning is li…