ELLIPSDF: Joint Object Pose and Shape Optimization with a Bi-level Ellipsoid and Signed Distance Function Description
arXiv:2108.00355 · doi:10.1109/ICCV48922.2021.00589
Abstract
Autonomous systems need to understand the semantics and geometry of their surroundings in order to comprehend and safely execute object-level task specifications. This paper proposes an expressive yet compact model for joint object pose and shape optimization, and an associated optimization algorithm to infer an object-level map from multi-view RGB-D camera observations. The model is expressive because it captures the identities, positions, orientations, and shapes of objects in the environment. It is compact because it relies on a low-dimensional latent representation of implicit object shape, allowing onboard storage of large multi-category object maps. Different from other works that rely on a single object representation format, our approach has a bi-level object model that captures both the coarse level scale as well as the fine level shape details. Our approach is evaluated on the large-scale real-world ScanNet dataset and compared against state-of-the-art methods.
arXiv commentAccepted by ICCV 2021
References in corpus (10)
- Auto-Encoding Variational Bayes
- Simple Online and Realtime Tracking
- ShapeNet: An Information-Rich 3D Model Repository
- ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenes
- CubeSLAM: Monocular 3D Object SLAM
- EAO-SLAM: Monocular Semi-Dense Object SLAM Based on Ensemble Data Association
- Learning to Group: A Bottom-Up Framework for 3D Part Discovery in Unseen Categories
- FroDO: From Detections to 3D Objects
- Deep-SLAM++: Object-level RGBD SLAM based on class-specific deep shape priors
- Extending DeepSDF for automatic 3D shape retrieval and similarity transform estimation