Self-supervised Graph Neural Network for Mechanical CAD Retrieval
2406.08863
0
0
Abstract
CAD (Computer-Aided Design) plays a crucial role in mechanical industry, where large numbers of similar-shaped CAD parts are often created. Efficiently reusing these parts is key to reducing design and production costs for enterprises. Retrieval systems are vital for achieving CAD reuse, but the complex shapes of CAD models are difficult to accurately describe using text or keywords, making traditional retrieval methods ineffective. While existing representation learning approaches have been developed for CAD, manually labeling similar samples in these methods is expensive. Additionally, CAD models' unique parameterized data structure presents challenges for applying existing 3D shape representation learning techniques directly. In this work, we propose GC-CAD, a self-supervised contrastive graph neural network-based method for mechanical CAD retrieval that directly models parameterized CAD raw files. GC-CAD consists of two key modules: structure-aware representation learning and contrastive graph learning framework. The method leverages graph neural networks to extract both geometric and topological information from CAD models, generating feature representations. We then introduce a simple yet effective contrastive graph learning framework approach, enabling the model to train without manual labels and generate retrieval-ready representations. Experimental results on four datasets including human evaluation demonstrate that the proposed method achieves significant accuracy improvements and up to 100 times efficiency improvement over the baseline methods.
Create account to get full access
Overview
ā¢ This research paper introduces a self-supervised graph neural network (GNN) for improved retrieval of mechanical computer-aided design (CAD) models.
ā¢ The method aims to learn useful representations of CAD models by exploiting the inherent graph structure of 3D shapes, without requiring expensive manual annotations.
Plain English Explanation
ā¢ CAD models are digital representations of 3D objects used in engineering and design. Retrieving relevant CAD models from large databases is an important task, but can be challenging due to the complexity of 3D shapes.
ā¢ The researchers developed a self-supervised learning approach that allows a GNN to learn meaningful representations of CAD models by analyzing their underlying graph structure, without needing human-labeled training data.
ā¢ This is an improvement over previous weakly-supervised or semi-supervised methods that require some manual annotations.
ā¢ The learned representations can then be used to more accurately retrieve similar CAD models from a database, which is useful for a variety of engineering and design applications.
Technical Explanation
ā¢ The proposed method uses a graph neural network to encode the graph structure of 3D CAD models, capturing important topological and geometric features.
ā¢ During training, the GNN is tasked with predicting missing edges in the graph, forcing it to learn meaningful representations of the shape structure.
ā¢ The trained GNN can then be used to generate compact embeddings for CAD models, which are evaluated on a retrieval task where the goal is to find similar models in a database given a query.
ā¢ Experiments show that the self-supervised GNN outperforms previous retrieval and representation learning approaches for CAD models.
Critical Analysis
ā¢ While the self-supervised approach is an interesting and promising direction, the paper does not address potential biases or blindspots that may arise from only using the graph structure, without incorporating additional modalities like images or text annotations.
ā¢ The retrieval performance, while improved, is still limited compared to human-level understanding of 3D shapes. Further research is needed to bridge this gap and make the representations more semantically meaningful.
ā¢ The generalization of the method to diverse CAD model datasets and real-world engineering applications is also an area that requires more investigation.
Conclusion
ā¢ This research presents a novel self-supervised GNN approach for learning effective representations of 3D CAD models, which can improve the retrieval of relevant shapes from large databases.
ā¢ The ability to learn shape representations without expensive manual annotations is a significant advantage, and the promising results suggest that self-supervised learning on the inherent graph structure of 3D shapes is a fruitful direction for future work in this area.
ā¢ Continued advancements in this field could have important implications for a wide range of engineering and design applications that rely on efficient CAD model management and retrieval.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
ContrastCAD: Contrastive Learning-based Representation Learning for Computer-Aided Design Models
Minseop Jung, Minseong Kim, Jibum Kim
0
0
The success of Transformer-based models has encouraged many researchers to learn CAD models using sequence-based approaches. However, learning CAD models is still a challenge, because they can be represented as complex shapes with long construction sequences. Furthermore, the same CAD model can be expressed using different CAD construction sequences. We propose a novel contrastive learning-based approach, named ContrastCAD, that effectively captures semantic information within the construction sequences of the CAD model. ContrastCAD generates augmented views using dropout techniques without altering the shape of the CAD model. We also propose a new CAD data augmentation method, called a Random Replace and Extrude (RRE) method, to enhance the learning performance of the model when training an imbalanced training CAD dataset. Experimental results show that the proposed RRE augmentation method significantly enhances the learning performance of Transformer-based autoencoders, even for complex CAD models having very long construction sequences. The proposed ContrastCAD model is shown to be robust to permutation changes of construction sequences and performs better representation learning by generating representation spaces where similar CAD models are more closely clustered. Our codes are available at https://github.com/cm8908/ContrastCAD.
4/3/2024
DiffCAD: Weakly-Supervised Probabilistic CAD Model Retrieval and Alignment from an RGB Image
Daoyi Gao, D'avid Rozenberszki, Stefan Leutenegger, Angela Dai
0
0
Perceiving 3D structures from RGB images based on CAD model primitives can enable an effective, efficient 3D object-based representation of scenes. However, current approaches rely on supervision from expensive annotations of CAD models associated with real images, and encounter challenges due to the inherent ambiguities in the task -- both in depth-scale ambiguity in monocular perception, as well as inexact matches of CAD database models to real observations. We thus propose DiffCAD, the first weakly-supervised probabilistic approach to CAD retrieval and alignment from an RGB image. We formulate this as a conditional generative task, leveraging diffusion to learn implicit probabilistic models capturing the shape, pose, and scale of CAD objects in an image. This enables multi-hypothesis generation of different plausible CAD reconstructions, requiring only a few hypotheses to characterize ambiguities in depth/scale and inexact shape matches. Our approach is trained only on synthetic data, leveraging monocular depth and mask estimates to enable robust zero-shot adaptation to various real target domains. Despite being trained solely on synthetic data, our multi-hypothesis approach can even surpass the supervised state-of-the-art on the Scan2CAD dataset by 5.9% with 8 hypotheses.
6/7/2024
Bayesian Mesh Optimization for Graph Neural Networks to Enhance Engineering Performance Prediction
Jangseop Park, Namwoo Kang
0
0
In engineering design, surrogate models are widely employed to replace computationally expensive simulations by leveraging design variables and geometric parameters from computer-aided design (CAD) models. However, these models often lose critical information when simplified to lower dimensions and face challenges in parameter definition, especially with the complex 3D shapes commonly found in industrial datasets. To address these limitations, we propose a Bayesian graph neural network (GNN) framework for a 3D deep-learning-based surrogate model that predicts engineering performance by directly learning geometric features from CAD using mesh representation. Our framework determines the optimal size of mesh elements through Bayesian optimization, resulting in a high-accuracy surrogate model. Additionally, it effectively handles the irregular and complex structures of 3D CADs, which differ significantly from the regular and uniform pixel structures of 2D images typically used in deep learning. Experimental results demonstrate that the quality of the mesh significantly impacts the prediction accuracy of the surrogate model, with an optimally sized mesh achieving superior performance. We compare the performance of models based on various 3D representations such as voxel, point cloud, and graph, and evaluate the computational costs of Monte Carlo simulation and Bayesian optimization methods to find the optimal mesh size. We anticipate that our proposed framework has the potential to be applied to mesh-based simulations across various engineering fields, leveraging physics-based information commonly used in computer-aided engineering.
6/5/2024
NeurCADRecon: Neural Representation for Reconstructing CAD Surfaces by Enforcing Zero Gaussian Curvature
Qiujie Dong, Rui Xu, Pengfei Wang, Shuangmin Chen, Shiqing Xin, Xiaohong Jia, Wenping Wang, Changhe Tu
0
0
Despite recent advances in reconstructing an organic model with the neural signed distance function (SDF), the high-fidelity reconstruction of a CAD model directly from low-quality unoriented point clouds remains a significant challenge. In this paper, we address this challenge based on the prior observation that the surface of a CAD model is generally composed of piecewise surface patches, each approximately developable even around the feature line. Our approach, named NeurCADRecon, is self-supervised, and its loss includes a developability term to encourage the Gaussian curvature toward 0 while ensuring fidelity to the input points. Noticing that the Gaussian curvature is non-zero at tip points, we introduce a double-trough curve to tolerate the existence of these tip points. Furthermore, we develop a dynamic sampling strategy to deal with situations where the given points are incomplete or too sparse. Since our resulting neural SDFs can clearly manifest sharp feature points/lines, one can easily extract the feature-aligned triangle mesh from the SDF and then decompose it into smooth surface patches, greatly reducing the difficulty of recovering the parametric CAD design. A comprehensive comparison with existing state-of-the-art methods shows the significant advantage of our approach in reconstructing faithful CAD shapes.
4/23/2024