3 citations · 5 across the 8 of their papers we have counts for
Showing 2021 · math.STShow all
2 papers · 2 filters
math.ST2021★ 3 cited
Existence, Stability and Scalability of Orthogonal Convolutional Neural Networks
El Mehdi Achour, François Malgouyres, Franck Mamalet
Imposing orthogonality on the layers of neural networks is known to facilitate the learning by limiting the exploding/vanishing of the gradient; decorrelate the features; improve t…
math.ST2021★ 2 cited
The loss landscape of deep linear neural networks: a second-order analysis
El Mehdi Achour, François Malgouyres, Sébastien Gerchinovitz
We study the optimization landscape of deep linear neural networks with the square loss. It is known that, under weak assumptions, there are no spurious local minima and no local m…