A Study of Hidden-State Optimization Order in Predictive Coding Networks

Xueyuan Li, Danilo Vasconcellos Vargas

Local learning methods offer an alternative to end-to-end backpropagation, but their unstructured local objectives can produce weak feature learning in deep networks. We study whet…