5 citations · 6 across the 3 of their papers we have counts for
3 papers
cs.LG2022★ 5 cited
Random Search Hyper-Parameter Tuning: Expected Improvement Estimation and the Corresponding Lower Bound
Dan Navon, Alex M. Bronstein
Hyperparameter tuning is a common technique for improving the performance of neural networks. Most techniques for hyperparameter search involve an iterated process where the model…
cs.CL2022
Transformer Vs. MLP-Mixer: Exponential Expressive Gap For NLP Problems
Dan Navon, Alex M. Bronstein
Vision-Transformers are widely used in various vision tasks. Meanwhile, there is another line of works starting with the MLP-mixer trying to achieve similar performance using mlp-b…
cs.CL2021★ 1 cited
The Inductive Bias of In-Context Learning: Rethinking Pretraining Example Design
Yoav Levine, Noam Wies, Daniel Jannai +3
Pretraining Neural Language Models (NLMs) over a large corpus involves chunking the text into training examples, which are contiguous text segments of sizes processable by the neur…