290 citations · 1.9k across the 78 of their papers we have counts for
Showing cs.NEShow all
2 papers · 1 filter
cs.NE2021★ 5 cited
Learning by Turning: Neural Architecture Aware Optimisation
Yang Liu, Jeremy Bernstein, Markus Meister +1
Descent methods for deep networks are notoriously capricious: they require careful tuning of step size, momentum and weight decay, and which method will work best on a new benchmar…
cs.NE2020★ 5 cited
Learning compositional functions via multiplicative weight updates
Jeremy Bernstein, Jiawei Zhao, Markus Meister +3
Compositionality is a basic structural feature of both biological and artificial neural networks. Learning compositional functions via gradient descent incurs well known problems l…