UCSG-Net -- Unsupervised Discovering of Constructive Solid Geometry Tree
arXiv:2006.09102
Abstract
Signed distance field (SDF) is a prominent implicit representation of 3D meshes. Methods that are based on such representation achieved state-of-the-art 3D shape reconstruction quality. However, these methods struggle to reconstruct non-convex shapes. One remedy is to incorporate a constructive solid geometry framework (CSG) that represents a shape as a decomposition into primitives. It allows to embody a 3D shape of high complexity and non-convexity with a simple tree representation of Boolean operations. Nevertheless, existing approaches are supervised and require the entire CSG parse tree that is given upfront during the training process. On the contrary, we propose a model that extracts a CSG parse tree without any supervision - UCSG-Net. Our model predicts parameters of primitives and binarizes their SDF representation through differentiable indicator function. It is achieved jointly with discovering the structure of a Boolean operators tree. The model selects dynamically which operator combination over primitives leads to the reconstruction of high fidelity. We evaluate our method on 2D and 3D autoencoding tasks. We show that the predicted parse tree representation is interpretable and can be used in CAD software.
arXiv commentAccepted to Thirty-fourth Conference on Neural Information Processing Systems (NeurIPS 2020). Project page: https://kacperkan.github.io/ucsgnet. Project video: https://www.youtube.com/watch?v=s1p4UHtUG3g&feature=emb_title. Comments: 13 pages, 7 figures; apply reviewers' remarks, fix the reference to the CSG-Net work
References in corpus (7)
- Categorical Reparameterization with Gumbel-Softmax
- PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation
- PointFlow: 3D Point Cloud Generation with Continuous Normalizing Flows
- PolyGen: An Autoregressive Generative Model of 3D Meshes
- Learning Implicit Fields for Generative Shape Modeling
- Learning Shape Abstractions by Assembling Volumetric Primitives
- Conditional Invertible Flow for Point Cloud Generation
Cited by in corpus (11)
- Reconstructing editable prismatic CAD from rounded voxel models
- SketchGen: Generating Constrained CAD Sketches
- 3D objects and scenes classification, recognition, segmentation, and reconstruction using 3D point cloud data: A review
- DeepJoin: Learning a Joint Occupancy, Signed Distance, and Normal Field Function for Shape Repair
- Fusion 360 Gallery: A Dataset and Environment for Programmatic CAD Construction from Human Design Sequences
- Editing Motion Graphics Video via Motion Vectorization and Transformation
- A Unified Differentiable Boolean Operator with Fuzzy Logic
- Inferring CAD Modeling Sequences Using Zone Graphs
- Engineering Sketch Generation for Computer-Aided Design
- On the Complexity of the CSG Tree Extraction Problem
- Unsupervised Program Synthesis for Images By Sampling Without Replacement