Showing 2024Show all
2 papers · 1 filter
cs.LG2024
Only Strict Saddles in the Energy Landscape of Predictive Coding Networks?
Francesco Innocenti, El Mehdi Achour, Ryan Singh +1
Predictive coding (PC) is an energy-based learning algorithm that performs iterative inference over network activities before updating weights. Recent work suggests that PC can con…
math.ST2024
The loss landscape of deep linear neural networks: a second-order analysis
El Mehdi Achour, François Malgouyres, Sébastien Gerchinovitz
We study the optimization landscape of deep linear neural networks with the square loss. It is known that, under weak assumptions, there are no spurious local minima and no local m…