Invariance of visual operations at the level of receptive fields

Abstract

Receptive field profiles registered by cell recordings have shown that mammalian vision has developed receptive fields tuned to different sizes and orientations in the image domain as well as to different image velocities in space-time. This article presents a theoretical model by which families of idealized receptive field profiles can be derived mathematically from a small set of basic assumptions that correspond to structural properties of the environment. The article also presents a theory for how basic invariance properties to variations in scale, viewing direction and relative motion can be obtained from the output of such receptive fields, using complementary selection mechanisms that operate over the output of families of receptive fields tuned to different parameters. Thereby, the theory shows how basic invariance properties of a visual system can be obtained already at the level of receptive fields, and we can explain the different shapes of receptive field profiles found in biological vision from a requirement that the visual system should be invariant to the natural types of image transformations that occur in its environment.

arXiv comment40 pages, 17 figures

References in corpus (1)

• A constructive mean field analysis of multi population neural networks with random synaptic weights and stochastic inputs

Cited by in corpus (11)

• Time-causal and time-recursive spatio-temporal receptive fields
• Scale-covariant and scale-invariant Gaussian derivative networks
• Normative theory of visual receptive fields
• Idealized computational models for auditory receptive fields
• Provably scale-covariant continuous hierarchical networks based on scale-normalized differential expressions coupled in cascade
• Dynamic texture recognition using time-causal and time-recursive spatio-temporal receptive fields
• Temporal scale selection in time-causal scale space
• Unified theory for joint covariance properties under geometric image transformations for spatio-temporal receptive fields according to the generalized Gaussian derivative model for visual receptive fields
• Relationships between the degrees of freedom in the affine Gaussian derivative model for visual receptive fields and 2-D affine image transformations, with application to covariance properties of simple cells in the primary visual cortex
• Do the receptive fields in the primary visual cortex span a variability over the degree of elongation of the receptive fields?
• Discrete approximations of the affine Gaussian derivative model for visual receptive fields