2.3k citations · 2.6k across the 13 of their papers we have counts for
1 paper · 1 filter
Haejun Lee, Drew A. Hudson, Kangwook Lee +1
We introduce Sentence-level Language Modeling, a new pre-training objective for learning a discourse language representation in a fully self-supervised manner. Recent pre-training…