Image Segmentation in Video Sequences: A Probabilistic Approach

Abstract

"Background subtraction" is an old technique for finding moving objects in a video sequence for example, cars driving on a freeway. The idea is that subtracting the current image from a timeaveraged background image will leave only nonstationary objects. It is, however, a crude approximation to the task of classifying each pixel of the current image; it fails with slow-moving objects and does not distinguish shadows from moving objects. The basic idea of this paper is that we can classify each pixel using a model of how that pixel looks when it is part of different classes. We learn a mixture-of-Gaussians classification model for each pixel using an unsupervised technique- an efficient, incremental version of EM. Unlike the standard image-averaging approach, this automatically updates the mixture component for each class according to likelihood of membership; hence slow-moving objects are handled perfectly. Our approach also identifies and eliminates shadows much more effectively than other techniques such as thresholding. Application of this method as part of the Roadwatch traffic surveillance project is expected to result in significant improvements in vehicle identification and tracking.

Appears in Proceedings of the Thirteenth Conference on Uncertainty in Artificial Intelligence (UAI1997)

Cited by in corpus (15)

• Unsupervised Video Object Segmentation for Deep Reinforcement Learning
• On the Binding Problem in Artificial Neural Networks
• Background Subtraction in Real Applications: Challenges, Current Models and Future Directions
• Sparse Camera Network for Visual Surveillance -- A Comprehensive Survey
• Machine Vision for Natural Gas Methane Emissions Detection Using an Infrared Camera
• Industrial Smoke Detection and Visualization
• Deep Segmentation and Registration in X-Ray Angiography Video
• SDM-Car: A Dataset for Small and Dim Moving Vehicles Detection in Satellite Videos
• Video Processing from Electro-optical Sensors for Object Detection and Tracking in Maritime Environment: A Survey
• A Survey of Fish Tracking Techniques Based on Computer Vision
• Adaptive Foreground and Shadow Detection inImage Sequences
• A Community-Based Sampling Method Using DPL for Online Social Network
• Foreground-Background Segmentation Based on Codebook and Edge Detector
• A Foreground-background Parallel Compression with Residual Encoding for Surveillance Video
• A relevance-scalability-interpretability tradeoff with temporally evolving user personas