most citedPredictability and Surprise in Large Generative Models

196 citations

researchers with a paper here

Counting papers with at most 25 authors, so collaboration author lists do not stand in for the people here.

collaborating institutions
Showing cs.CYShow all

1 paper · 1 filter

cs.CY2022★ 196 cited

Predictability and Surprise in Large Generative Models

Deep Ganguli, Danny Hernandez, Liane Lovitt +27

Large-scale pre-training has recently emerged as a technique for creating capable, general purpose, generative models such as GPT-3, Megatron-Turing NLG, Gopher, and many others. I…