Fusion 360 Gallery: A Dataset and Environment for Programmatic CAD Construction from Human Design Sequences
arXiv:2010.02392
Abstract
Parametric computer-aided design (CAD) is a standard paradigm used to design manufactured objects, where a 3D shape is represented as a program supported by the CAD software. Despite the pervasiveness of parametric CAD and a growing interest from the research community, currently there does not exist a dataset of realistic CAD models in a concise programmatic form. In this paper we present the Fusion 360 Gallery, consisting of a simple language with just the sketch and extrude modeling operations, and a dataset of 8,625 human design sequences expressed in this language. We also present an interactive environment called the Fusion 360 Gym, which exposes the sequential construction of a CAD program as a Markov decision process, making it amendable to machine learning approaches. As a use case for our dataset and environment, we define the CAD reconstruction task of recovering a CAD program from a target geometry. We report results of applying state-of-the-art methods of program synthesis with neurally guided search on this task.
arXiv commentAccepted to SIGGRAPH 2021; data/code available at https://github.com/AutodeskAILab/Fusion360GalleryDataset
References in corpus (12)
- Semi-Supervised Classification with Graph Convolutional Networks
- Neural Message Passing for Quantum Chemistry
- Thingi10K: A Dataset of 10,000 3D-Printing Models
- Efficient Graph Generation with Graph Recurrent Attention Networks
- ShapeAssembly: Learning to Generate Programs for 3D Shape Structure Synthesis
- Learning to Infer and Execute 3D Shape Programs
- Reinforcement Learning for Integer Programming: Learning to Cut
- Neural-Guided Deductive Search for Real-Time Program Synthesis from Examples
- PolyGen: An Autoregressive Generative Model of 3D Meshes
- UCSG-Net -- Unsupervised Discovering of Constructive Solid Geometry Tree
- SketchGraphs: A Large-Scale Dataset for Modeling Relational Geometry in Computer-Aided Design
- Write, Execute, Assess: Program Synthesis with a REPL