40 citations · 90 across the 6 of their papers we have counts for
Showing 2017Show all
3 papers · 1 filter
cs.LG2017★ 18 cited
Online Learning with Gated Linear Networks
Joel Veness, Tor Lattimore, Avishkar Bhoopchand +3
This paper describes a family of probabilistic architectures designed for online learning under the logarithmic loss. Rather than relying on non-linear transfer functions, our meth…
cond-mat.stat-mech2017★ 3 cited
Criticality & Deep Learning II: Momentum Renormalisation Group
Dan Oprisa, Peter Toth
Guided by critical systems found in nature we develop a novel mechanism consisting of inhomogeneous polynomial regularisation via which we can induce scale invariance in deep learn…
cs.AI2017★ 2 cited
Criticality & Deep Learning I: Generally Weighted Nets
Dan Oprisa, Peter Toth
Motivated by the idea that criticality and universality of phase transitions might play a crucial role in achieving and sustaining learning and intelligent behaviour in biological…