81 citations · 108 across the 29 of their papers we have counts for
1 paper · 2 filters
Jeffrey Wang, Jonathan Gregory, Grigorios G. Chrysos
Modern vision backbones treat pointwise activations (e.g., ReLU, GELU) and exponential softmax as essential sources of nonlinearity, but we demonstrate they are not required within…