Showing cs.LGShow all
2 papers · 1 filter
cs.LG2023
Degree-based stratification of nodes in Graph Neural Networks
Ameen Ali, Hakan Cevikalp, Lior Wolf
Despite much research, Graph Neural Networks (GNNs) still do not display the favorable scaling properties of other deep neural networks such as Convolutional Neural Networks and Tr…
cs.LG2023
Revisiting the Noise Model of Stochastic Gradient Descent
Barak Battash, Ofir Lindenbaum
The stochastic gradient noise (SGN) is a significant factor in the success of stochastic gradient descent (SGD). Following the central limit theorem, SGN was initially modeled as G…