16 citations · 16 across the 4 of their papers we have counts for
1 paper · 1 filter
Tina Behnia, Puneesh Deora, Christos Thrampoulidis
Language models are pretrained on sequences that blend statistical regularities (making text fluent) with factual associations between specific tokens (knowledge of facts). While r…