Accurate Light Field Depth Estimation with Superpixel Regularization over Partially Occluded Regions

Abstract

Depth estimation is a fundamental problem for light field photography applications. Numerous methods have been proposed in recent years, which either focus on crafting cost terms for more robust matching, or on analyzing the geometry of scene structures embedded in the epipolar-plane images. Significant improvements have been made in terms of overall depth estimation error; however, current state-of-the-art methods still show limitations in handling intricate occluding structures and complex scenes with multiple occlusions. To address these challenging issues, we propose a very effective depth estimation framework which focuses on regularizing the initial label confidence map and edge strength weights. Specifically, we first detect partially occluded boundary regions (POBR) via superpixel based regularization. Series of shrinkage/reinforcement operations are then applied on the label confidence map and edge strength weights over the POBR. We show that after weight manipulations, even a low-complexity weighted least squares model can produce much better depth estimation than state-of-the-art methods in terms of average disparity error rate, occlusion boundary precision-recall rate, and the preservation of intricate visual features.

References in corpus (2)

• Light Field Compression with Disparity Guided Sparse Coding based on Structural Key Views
• Occlusion-Model Guided Anti-Occlusion Depth Estimation in Light Field

Cited by in corpus (9)

• Light Field Denoising via Anisotropic Parallax Analysis in a CNN Framework
• Occlusion-aware Unsupervised Learning of Depth from 4-D Light Fields
• LFACon: Introducing Anglewise Attention to No-Reference Quality Assessment in Light Field Space
• Unsupervised Light Field Depth Estimation via Multi-view Feature Matching with Occlusion Prediction
• Probabilistic-based Feature Embedding of 4-D Light Fields for Compressive Imaging and Denoising
• Dynamic Spectral Residual Superpixels
• Scale-Consistent Fusion: from Heterogeneous Local Sampling to Global Immersive Rendering
• Superpixel Cost Volume Excitation for Stereo Matching
• Superpixel Attack: Enhancing Black-box Adversarial Attack with Image-driven Division Areas