Multifractality and percolation in the coupling space of perceptrons

Abstract

The coupling space of perceptrons with continuous as well as with binary weights gets partitioned into a disordered multifractal by a set of $p={\hat{I}}^{3}N$ random input patterns. The multifractal spectrum $f(\hat{I}\pm )$ can be calculated analytically using the replica formalism. The storage capacity and the generalization behaviour of the perceptron are shown to be related to properties of $f(\hat{I}\pm )$ which are correctly described within the replica symmetric ansatz. Replica symmetry breaking is interpreted geometrically as a transition from percolating to non-percolating cells. The existence of empty cells gives rise to singularities in the multifractal spectrum. The analytical results for binary couplings are corroborated by numerical studies.

13 pages, revtex, 4 eps figures, version accepted for publication in Phys. Rev. E