A time-causal and time-recursive scale-covariant scale-space representation of temporal signals and past time
arXiv:2202.09209 · doi:10.1007/s00422-022-00953-6
Abstract
This article presents an overview of a theory for performing temporal smoothing on temporal signals in such a way that: (i) temporally smoothed signals at coarser temporal scales are guaranteed to constitute simplifications of corresponding temporally smoothed signals at any finer temporal scale (including the original signal) and (ii) the temporal smoothing process is both time-causal and time-recursive, in the sense that it does not require access to future information and can be performed with no other temporal memory buffer of the past than the resulting smoothed temporal scale-space representations themselves. For specific subsets of parameter settings for the classes of linear and shift-invariant temporal smoothing operators that obey this property, it is shown how temporal scale covariance can be additionally obtained, guaranteeing that if the temporal input signal is rescaled by a uniform scaling factor, then also the resulting temporal scale-space representations of the rescaled temporal signal will constitute mere rescalings of the temporal scale-space representations of the original input signal, complemented by a shift along the temporal scale dimension. The resulting time-causal limit kernel that obeys this property constitutes a canonical temporal kernel for processing temporal signal in real-time scenarios when the regular Gaussian kernel cannot be used because of its non-causal access to information from the future and we cannot additionally require the temporal smoothing process to comprise a complementary memory of the past beyond the information contained in the temporal smoothing process itself, which in this way also serves as a multi-scale temporal memory of the past. This theory is generally applicable for both: (i) modelling continuous temporal phenomena over multiple temporal scales and (ii) digital processing of measured temporal signals in real time.
arXiv comment37 pages, 15 figures
References in corpus (7)
- Time-causal and time-recursive spatio-temporal receptive fields
- Normative theory of visual receptive fields
- Idealized computational models for auditory receptive fields
- Dense scale selection over space, time and space-time
- Dynamic texture recognition using time-causal and time-recursive spatio-temporal receptive fields
- Temporal scale selection in time-causal scale space
- Separable time-causal and time-recursive spatio-temporal receptive fields
Cited by in corpus (6)
- Artificial Intelligence-based algorithms in medical image scan seg-mentation and intelligent visual-content generation -- a concise overview
- Covariance properties under natural image transformations for the generalized Gaussian derivative model for visual receptive fields
- Covariant spatio-temporal receptive fields for spiking neural networks
- Unified theory for joint covariance properties under geometric image transformations for spatio-temporal receptive fields according to the generalized Gaussian derivative model for visual receptive fields
- Orientation selectivity properties for the affine Gaussian derivative and the affine Gabor models for visual receptive fields
- A time-causal and time-recursive analogue of the Gabor transform