20 citations · 57 across the 7 of their papers we have counts for
4 papers · 1 filter
TRACT: Denoising Diffusion Models with Transitive Closure Time-Distillation
David Berthelot, Arnaud Autef, Jierui Lin +6
Denoising Diffusion models have demonstrated their proficiency for generative sampling. However, generating good samples often requires many iterations. Consequently, techniques su…
Deep Connectomics Networks: Neural Network Architectures Inspired by Neuronal Networks
Nicholas Roberts, Dian Ang Yap, Vinay Uday Prabhu
The interplay between inter-neuronal network topology and cognition has been studied deeply by connectomics researchers and network scientists, which is crucial towards understandi…
Grassmannian Packings in Neural Networks: Learning with Maximal Subspace Packings for Diversity and Anti-Sparsity
Dian Ang Yap, Nicholas Roberts, Vinay Uday Prabhu
Kernel sparsity ("dying ReLUs") and lack of diversity are commonly observed in CNN kernels, which decreases model capacity. Drawing inspiration from information theory and wireless…
Understanding Adversarial Robustness Through Loss Landscape Geometries
Vinay Uday Prabhu, Dian Ang Yap, Joyce Xu +1
The pursuit of explaining and improving generalization in deep learning has elicited efforts both in regularization techniques as well as visualization techniques of the loss surfa…