D-OccNet: Detailed 3D Reconstruction Using Cross-Domain Learning
arXiv:2104.13854
Abstract
Deep learning based 3D reconstruction of single view 2D image is becoming increasingly popular due to their wide range of real-world applications, but this task is inherently challenging because of the partial observability of an object from a single perspective. Recently, state of the art probability based Occupancy Networks reconstructed 3D surfaces from three different types of input domains: single view 2D image, point cloud and voxel. In this study, we extend the work on Occupancy Networks by exploiting cross-domain learning of image and point cloud domains. Specifically, we first convert the single view 2D image into a simpler point cloud representation, and then reconstruct a 3D surface from it. Our network, the Double Occupancy Network (D-OccNet) outperforms Occupancy Networks in terms of visual quality and details captured in the 3D reconstruction.
References in corpus (6)
- Deep Residual Learning for Image Recognition
- Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modeling
- MarrNet: 3D Shape Reconstruction via 2.5D Sketches
- Learning Efficient Point Cloud Generation for Dense 3D Object Reconstruction
- Pixel2Mesh: Generating 3D Mesh Models from Single RGB Images
- 3D-LMNet: Latent Embedding Matching for Accurate and Diverse 3D Point Cloud Reconstruction from a Single Image