196 citations · 218 across the 3 of their papers we have counts for
3 papers
cs.CY2022★ 196 cited
Predictability and Surprise in Large Generative Models
Deep Ganguli, Danny Hernandez, Liane Lovitt +27
Large-scale pre-training has recently emerged as a technique for creating capable, general purpose, generative models such as GPT-3, Megatron-Turing NLG, Gopher, and many others. I…
q-bio.NC2016★ 21 cited
Neural and perceptual signatures of efficient sensory coding
Deep Ganguli, Eero P. Simoncelli
The mammalian brain is a metabolically expensive device, and evolutionary pressures have presumably driven it to make productive use of its resources. For sensory areas, this conce…
q-bio.NC2012★ 1 cited
Implicit embedding of prior probabilities in optimally efficient neural populations
Deep Ganguli, Eero Simoncelli
We examine how the prior probability distribution of a sensory variable in the environment influences the optimal allocation of neurons and spikes in a population that represents t…