Dynamic texture recognition using time-causal and time-recursive spatio-temporal receptive fields

Abstract

This work presents a first evaluation of using spatio-temporal receptive fields from a recently proposed time-causal spatio-temporal scale-space framework as primitives for video analysis. We propose a new family of video descriptors based on regional statistics of spatio-temporal receptive field responses and evaluate this approach on the problem of dynamic texture recognition. Our approach generalises a previously used method, based on joint histograms of receptive field responses, from the spatial to the spatio-temporal domain and from object recognition to dynamic texture recognition. The time-recursive formulation enables computationally efficient time-causal recognition. The experimental evaluation demonstrates competitive performance compared to state-of-the-art. Especially, it is shown that binary versions of our dynamic texture descriptors achieve improved performance compared to a large range of similar methods using different primitives either handcrafted or learned from data. Further, our qualitative and quantitative investigation into parameter choices and the use of different sets of receptive fields highlights the robustness and flexibility of our approach. Together, these results support the descriptive power of this family of time-causal spatio-temporal receptive fields, validate our approach for dynamic texture recognition and point towards the possibility of designing a range of video analysis methods based on these new time-causal spatio-temporal primitives.

arXiv comment29 pages, 16 figures

References in corpus (6)

• Time-causal and time-recursive spatio-temporal receptive fields
• Invariance of visual operations at the level of receptive fields
• Spatiotemporal Gabor filters: a new method for dynamic texture recognition
• Dense scale selection over space, time and space-time
• Alignment Distances on Systems of Bags
• Manifold Regularized Slow Feature Analysis for Dynamic Texture Recognition

Cited by in corpus (4)

• A time-causal and time-recursive scale-covariant scale-space representation of temporal signals and past time
• Covariant spatio-temporal receptive fields for spiking neural networks
• A time-causal and time-recursive analogue of the Gabor transform
• Dynamic Texture Recognition via Nuclear Distances on Kernelized Scattering Histogram Spaces