78 citations · 102 across the 15 of their papers we have counts for
Showing 2019Show all
3 papers · 1 filter
cs.CL2019
RNN Architecture Learning with Sparse Regularization
Jesse Dodge, Roy Schwartz, Hao Peng +1
Neural models for NLP typically use large numbers of parameters to reach state-of-the-art performance, which can lead to excessive memory usage and increased runtime. We present a…
cs.CL2019★ 1 cited
PaLM: A Hybrid Parser and Language Model
Hao Peng, Roy Schwartz, Noah A. Smith
We present PaLM, a hybrid parser and neural language model. Building on an RNN language model, PaLM adds an attention layer over text spans in the left context. An unsupervised con…
cs.CY2019★ 78 cited
Green AI
Roy Schwartz, Jesse Dodge, Noah A. Smith +1
The computations required for deep learning research have been doubling every few months, resulting in an estimated 300,000x increase from 2012 to 2018 [2]. These computations have…