Bringing Attention to CAD: Boundary Representation Learning via Transformer
arXiv:2504.07134 · doi:10.1016/j.cad.2025.103940
Abstract
The recent rise of generative artificial intelligence (AI), powered by Transformer networks, has achieved remarkable success in natural language processing, computer vision, and graphics. However, the application of Transformers in computer-aided design (CAD), particularly for processing boundary representation (B-rep) models, remains largely unexplored. To bridge this gap, we propose a novel approach for adapting Transformers to B-rep learning, called the Boundary Representation Transformer (BRT). B-rep models pose unique challenges due to their irregular topology and continuous geometric definitions, which are fundamentally different from the structured and discrete data Transformers are designed for. To address this, BRT proposes a continuous geometric embedding method that encodes B-rep surfaces (trimmed and untrimmed) into Bezier triangles, preserving their shape and continuity without discretization. Additionally, BRT employs a topology-aware embedding method that organizes these geometric embeddings into a sequence of discrete tokens suitable for Transformers, capturing both geometric and topological characteristics within B-rep models. This enables the Transformer's attention mechanism to effectively learn shape patterns and contextual semantics of boundary elements in a B-rep model. Extensive experiments demonstrate that BRT achieves state-of-the-art performance in part classification and feature recognition tasks.
References in corpus (9)
- Adam: A Method for Stochastic Optimization
- An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
- O-CNN: Octree-based Convolutional Neural Networks for 3D Shape Analysis
- MeshCNN: A Network with an Edge
- Subdivision-Based Mesh Convolution Networks
- Language-based Photo Color Adjustment for Graphic Designs
- Push-pull direct modeling of solid CAD models
- Parametric/direct CAD integration
- Variational Direct Modeling: A framework towards integration of parametric modeling and direct modeling in CAD