27 citations · 93 across the 10 of their papers we have counts for
6 papers · 1 filter
Neural Functional Transformers
Allan Zhou, Kaien Yang, Yiding Jiang +5
The recent success of neural networks as implicit representation of data has driven growing interest in neural functionals: models that can process other neural networks as input b…
Prioritized Training on Points that are Learnable, Worth Learning, and Not Yet Learnt
Sören Mindermann, Jan Brauner, Muhammed Razzak +8
Training on web-scale data can take months. But most computation and time is wasted on redundant and noisy points that are already learnt or not learnable. To accelerate training,…
Self-Similarity Priors: Neural Collages as Differentiable Fractal Representations
Michael Poli, Winnie Xu, Stefano Massaroli +3
Many patterns in nature exhibit self-similarity: they can be compactly described via self-referential transformations. Said patterns commonly appear in natural and artificial objec…
NoisyMix: Boosting Model Robustness to Common Corruptions
N. Benjamin Erichson, Soon Hoe Lim, Winnie Xu +3
For many real-world applications, obtaining stable and robust statistical performance is more important than simply achieving state-of-the-art predictive test accuracy, and thus ro…
Noisy Feature Mixup
Soon Hoe Lim, N. Benjamin Erichson, Francisco Utrera +2
We introduce Noisy Feature Mixup (NFM), an inexpensive yet effective method for data augmentation that combines the best of interpolation based training and noise injection schemes…
Prioritized training on points that are learnable, worth learning, and not yet learned (workshop version)
Sören Mindermann, Muhammed Razzak, Winnie Xu +7
We introduce Goldilocks Selection, a technique for faster model training which selects a sequence of training points that are "just right". We propose an information-theoretic acqu…