1.3k citations · 1.7k across the 9 of their papers we have counts for
Showing 2023Show all
2 papers · 1 filter
cs.LG2023★ 5 cited
Deep Transformers without Shortcuts: Modifying Self-attention for Faithful Signal Propagation
Bobby He, James Martens, Guodong Zhang +4
Skip connections and normalisation layers form two standard architectural components that are ubiquitous for the training of Deep Neural Networks (DNNs), but whose precise roles ar…
cs.LG2023★ 1 cited
Spatial Functa: Scaling Functa to ImageNet Classification and Generation
Matthias Bauer, Emilien Dupont, Andy Brock +3
Neural fields, also known as implicit neural representations, have emerged as a powerful means to represent complex signals of various modalities. Based on this Dupont et al. (2022…