Critical initialization destabilizes higher input derivatives in wide scalar-input networks

Prashant Singh, Pranav Singh

The edge-of-chaos condition preserves first-order input perturbations in wide randomly initialized networks, but physics-informed losses, score matching and derivative regularizati…