220 citations
- Hebrew University of JerusalemIL11 papers
- Weizmann Institute of ScienceIL3 papers
- KTH Royal Institute of TechnologySE2 papers
- Physico-Technical InstituteRU2 papers
- Tel Aviv UniversityIL2 papers
- Academy of Sciences Republic of UzbekistanUZ1 paper
- Bar-Ilan UniversityIL1 paper
- Ben-Gurion University of the NegevIL1 paper
- Boise State UniversityUS1 paper
- California Institute of TechnologyUS1 paper
- Columbia UniversityUS1 paper
- Cornell UniversityUS1 paper
6 papers · 1 filter
Which transformer architecture fits my data? A vocabulary bottleneck in self-attention
Noam Wies, Yoav Levine, Daniel Jannai +1
After their successful debut in natural language processing, Transformer architectures are now becoming the de-facto standard in many domains. An obstacle for their deployment over…
Strongly Adaptive Online Learning
Amit Daniely, Alon Gonen, Shai Shalev-Shwartz
Strongly adaptive algorithms are algorithms whose performance on every time interval is close to optimal. We present a reduction that can transform standard low-regret algorithms t…
On the Computational Efficiency of Training Neural Networks
Roi Livni, Shai Shalev-Shwartz, Ohad Shamir
It is well-known that neural networks are computationally hard to train. On the other hand, in practice, modern day neural networks are trained efficiently using SGD and a variety…
"Ideal Parent" Structure Learning for Continuous Variable Networks
Iftach Nachman, Gal Elidan, Nir Friedman
In recent years, there is a growing interest in learning Bayesian networks with continuous variables. Learning the structure of such networks is a computationally expensive procedu…
Bounded Planning in Passive POMDPs
Roy Fox, Naftali Tishby
In Passive POMDPs actions do not affect the world state, but still incur costs. When the agent is bounded by information-processing constraints, it can only keep an approximation o…
Learning the Experts for Online Sequence Prediction
Elad Eban, Aharon Birnbaum, Shai Shalev-Shwartz +1
Online sequence prediction is the problem of predicting the next element of a sequence given previous elements. This problem has been extensively studied in the context of individu…