Dataset-learning duality and emergent criticality

Ekaterina Kukleva, Vitaly Vanchurin

In artificial neural networks, the activation dynamics of non-trainable variables is strongly coupled to the learning dynamics of trainable variables. During the activation pass, t…