activity
20182023
most citedBERT has a Mouth, and It Must Speak: BERT as a Markov Random Field Language Model

144 citations · 324 across the 6 of their papers we have counts for

collaborators
Showing 2018Show all

2 papers · 1 filter

cs.CL2018

Can You Tell Me How to Get Past Sesame Street? Sentence-Level Pretraining Beyond Language Modeling

Alex Wang, Jan Hula, Patrick Xia +13

Natural language understanding has recently seen a surge of progress with the use of sentence encoders like ELMo (Peters et al., 2018a) and BERT (Devlin et al., 2019) which are pre…

cs.CL2018

GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding

Alex Wang, Amanpreet Singh, Julian Michael +3

For natural language understanding (NLU) technology to be maximally useful, both practically and as a scientific object of study, it must be general: it must be able to process lan…