CNN-based Labelled Crack Detection for Image Annotation

Read original: arXiv:2408.11250 - Published 8/22/2024 by Mohsen Asghari Ilani, Leila Amini, Hossein Karimi, Maryam Shavali Kuhshuri
Total Score

0

🔎

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • Numerous image processing techniques (IPTs) have been used to detect cracks in surfaces made through Additive Manufacturing (AM).
  • Traditional IPTs face challenges with diverse real-world scenarios and varying crack types.
  • This paper presents a vision-based approach that uses deep convolutional neural networks (CNNs) for crack detection in AM surfaces.
  • The proposed method leverages CNNs to eliminate the need for extensive feature extraction.
  • Annotation for CNN training is facilitated by LabelImg without requiring additional IPTs.
  • The trained CNN, enhanced by OpenCV preprocessing techniques, achieves 99.54% accuracy on a dataset of 14,982 annotated images.

Plain English Explanation

Crack Detection in Additive Manufacturing Surfaces Using Deep Learning

Detecting cracks and defects in surfaces created through 3D printing (Additive Manufacturing) is important for quality control. Traditionally, this has been done by having human inspectors examine the surfaces. However, this can be time-consuming and inconsistent.

To address this, researchers have explored using image processing techniques to automatically detect cracks. These techniques analyze the images of the surfaces to look for features that indicate cracks. However, these traditional methods can struggle with the diverse range of real-world scenarios and different types of cracks that can occur.

This paper presents a new approach that uses a type of artificial intelligence called deep learning, specifically deep convolutional neural networks (CNNs), to detect cracks in AM surfaces. CNNs are able to automatically learn the relevant features for crack detection, without the need for extensive manual feature engineering.

The researchers trained the CNN model using a large dataset of over 14,000 annotated images of AM surfaces, with and without cracks. They also used some additional image preprocessing techniques from OpenCV to enhance the performance of the CNN.

The final CNN model achieved an impressive 99.54% accuracy on the test dataset. It was also able to maintain high precision (96%), recall (98%), and F1-score (97%), indicating that it can reliably and accurately detect cracks in AM surfaces.

This deep learning-based approach represents a significant improvement over traditional image processing methods, and could help automate the crack detection process in 3D printing quality control.

Technical Explanation

Crack Detection in Additive Manufacturing Surfaces Using Deep Learning

The paper presents a vision-based approach that leverages deep convolutional neural networks (CNNs) for automatic crack detection in surfaces produced through Additive Manufacturing (AM). Traditional image processing techniques (IPTs) have been employed for this task, but they face challenges in handling diverse real-world scenarios and varying crack types.

To address these limitations, the proposed method utilizes CNNs, which can learn relevant features for crack detection without the need for extensive manual feature engineering. The CNN model is trained on a dataset of 14,982 annotated images of AM surfaces, with resolutions of 1536 x 1103 pixels.

The annotation process is facilitated by the LabelImg tool, eliminating the requirement for additional IPTs. The trained CNN model is further enhanced by applying OpenCV preprocessing techniques, such as image normalization and augmentation.

The evaluation of the trained CNN model demonstrates outstanding performance, achieving an accuracy of 99.54% on the test dataset. Additionally, the model exhibits high precision (96%), recall (98%), and F1-score (97%), highlighting its effectiveness in accurately detecting cracks in AM surfaces.

Critical Analysis

Crack Detection in Additive Manufacturing Surfaces Using Deep Learning

The paper presents a robust and effective deep learning-based approach for crack detection in Additive Manufacturing surfaces, outperforming traditional image processing techniques. The researchers have addressed the challenges of diverse real-world scenarios and varying crack types by leveraging the power of convolutional neural networks.

One potential limitation of the study is the lack of information on the diversity of the crack types and surface characteristics within the dataset. It would be beneficial to understand the distribution of crack morphologies, sizes, and orientations, as well as the surface roughness, materials, and manufacturing processes represented in the data. This additional context could provide insights into the generalizability of the model to a wider range of AM applications.

Furthermore, the paper does not discuss the computational requirements or inference time of the proposed CNN-based approach. In a production setting, these factors may be crucial, especially for time-sensitive quality control applications. Providing benchmarks for model size, inference speed, and hardware requirements would help readers evaluate the practical feasibility of deploying this solution.

Overall, the study presents a promising deep learning-based solution for automated crack detection in AM surfaces. Further research exploring the model's robustness to diverse datasets and its practical deployment considerations would strengthen the contribution of this work.

Conclusion

Crack Detection in Additive Manufacturing Surfaces Using Deep Learning

This paper introduces a deep learning-based approach for crack detection in Additive Manufacturing surfaces, which outperforms traditional image processing techniques. By leveraging convolutional neural networks, the proposed method can automatically learn relevant features for crack identification, eliminating the need for extensive manual feature engineering.

The trained CNN model, enhanced by OpenCV preprocessing techniques, achieves an impressive 99.54% accuracy on a large dataset of 14,982 annotated images. The model's high precision, recall, and F1-score further demonstrate its effectiveness in accurately detecting cracks in AM surfaces.

This deep learning-based solution represents a significant advancement in the field of automated quality control for 3D-printed parts, with the potential to streamline the inspection process and improve product reliability. As the adoption of Additive Manufacturing continues to grow, this research provides a valuable tool for ensuring the quality and integrity of 3D-printed components.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

🔎

Total Score

0

CNN-based Labelled Crack Detection for Image Annotation

Mohsen Asghari Ilani, Leila Amini, Hossein Karimi, Maryam Shavali Kuhshuri

Numerous image processing techniques (IPTs) have been employed to detect crack defects, offering an alternative to human-conducted onsite inspections. These IPTs manipulate images to extract defect features, particularly cracks in surfaces produced through Additive Manufacturing (AM). This article presents a vision-based approach that utilizes deep convolutional neural networks (CNNs) for crack detection in AM surfaces. Traditional image processing techniques face challenges with diverse real-world scenarios and varying crack types. To overcome these challenges, our proposed method leverages CNNs, eliminating the need for extensive feature extraction. Annotation for CNN training is facilitated by LabelImg without the requirement for additional IPTs. The trained CNN, enhanced by OpenCV preprocessing techniques, achieves an outstanding 99.54% accuracy on a dataset of 14,982 annotated images with resolutions of 1536 x 1103 pixels. Evaluation metrics exceeding 96% precision, 98% recall, and a 97% F1-score highlight the precision and effectiveness of the entire process.

Read more

8/22/2024

🏷️

Total Score

0

From Classification to Segmentation with Explainable AI: A Study on Crack Detection and Growth Monitoring

Florent Forest, Hugo Porta, Devis Tuia, Olga Fink

Monitoring surface cracks in infrastructure is crucial for structural health monitoring. Automatic visual inspection offers an effective solution, especially in hard-to-reach areas. Machine learning approaches have proven their effectiveness but typically require large annotated datasets for supervised training. Once a crack is detected, monitoring its severity often demands precise segmentation of the damage. However, pixel-level annotation of images for segmentation is labor-intensive. To mitigate this cost, one can leverage explainable artificial intelligence (XAI) to derive segmentations from the explanations of a classifier, requiring only weak image-level supervision. This paper proposes applying this methodology to segment and monitor surface cracks. We evaluate the performance of various XAI methods and examine how this approach facilitates severity quantification and growth monitoring. Results reveal that while the resulting segmentation masks may exhibit lower quality than those produced by supervised methods, they remain meaningful and enable severity monitoring, thus reducing substantial labeling costs.

Read more

6/12/2024

Modeling Multi-Granularity Context Information Flow for Pavement Crack Detection
Total Score

0

Modeling Multi-Granularity Context Information Flow for Pavement Crack Detection

Junbiao Pang, Baocheng Xiong, Jiaqi Wu

Crack detection has become an indispensable, interesting yet challenging task in the computer vision community. Specially, pavement cracks have a highly complex spatial structure, a low contrasting background and a weak spatial continuity, posing a significant challenge to an effective crack detection method. In this paper, we address these problems from a view that utilizes contexts of the cracks and propose an end-to-end deep learning method to model the context information flow. To precisely localize crack from an image, it is critical to effectively extract and aggregate multi-granularity context, including the fine-grained local context around the cracks (in spatial-level) and the coarse-grained semantics (in segment-level). Concretely, in Convolutional Neural Network (CNN), low-level features extracted by the shallow layers represent the local information, while the deep layers extract the semantic features. Additionally, a second main insight in this work is that the semantic context should be an guidance to local context feature. By the above insights, the proposed method we first apply the dilated convolution as the backbone feature extractor to model local context, then we build a context guidance module to leverage semantic context to guide local feature extraction at multiple stages. To handle label alignment between stages, we apply the Multiple Instance Learning (MIL) strategy to align the high-level feature to the low-level ones in the stage-wise context flow. In addition, compared with these public crack datasets, to our best knowledge, we release the largest, most complex and most challenging Bitumen Pavement Crack (BPC) dataset. The experimental results on the three crack datasets demonstrate that the proposed method performs well and outperforms the current state-of-the-art methods.

Read more

4/22/2024

🔎

Total Score

0

Pavement Fatigue Crack Detection and Severity Classification Based on Convolutional Neural Network

Zhen Wang, Dylan G. Ildefonzo, Linbing Wang

Due to the varying intensity of pavement cracks, the complexity of topological structure, and the noise of texture background, image classification for asphalt pavement cracking has proven to be a challenging problem. Fatigue cracking, also known as alligator cracking, is one of the common distresses of asphalt pavement. It is thus important to detect and monitor the condition of alligator cracking on roadway pavements. Most research in this area has typically focused on pixel-level detection of cracking using limited datasets. A novel deep convolutional neural network that can achieve two objectives is proposed. The first objective of the proposed neural network is to classify presence of fatigue cracking based on pavement surface images. The second objective is to classify the fatigue cracking severity level based on the Distress Identification Manual (DIM) standard. In this paper, a databank of 4484 high-resolution pavement surface images is established in which images are taken locally in the Town of Blacksburg, Virginia, USA. In the data pre-preparation, over 4000 images are labeled into 4 categories manually according to DIM standards. A four-layer convolutional neural network model is then built to achieve the goal of classification of images by pavement crack severity category. The trained model reached the highest accuracy among all existing methods. After only 30 epochs of training, the model achieved a crack existence classification accuracy of 96.23% and a severity level classification accuracy of 96.74%. After 20 epochs of training, the model achieved a pavement marking presence classification accuracy of 97.64%.

Read more

7/24/2024