1.6k citations · 11.3k across the 73 of their papers we have counts for
Showing 2021Show all
2 papers · 1 filter
cs.LG2021★ 3 cited
Pointer Value Retrieval: A new benchmark for understanding the limits of neural network generalization
Chiyuan Zhang, Maithra Raghu, Jon Kleinberg +1
Central to the success of artificial neural networks is their ability to generalize. But does neural network generalization primarily rely on seeing highly similar training example…
cs.LG2021★ 31 cited
Learnable Fourier Features for Multi-Dimensional Spatial Positional Encoding
Yang Li, Si Si, Gang Li +2
Attentional mechanisms are order-invariant. Positional encoding is a crucial component to allow attention-based deep model architectures such as Transformer to address sequences or…