Faster Metallic Surface Defect Detection Using Deep Learning with Channel Shuffling

Read original: arXiv:2406.14582 - Published 6/24/2024 by Siddiqui Muhammad Yasir, Hyunsik Ahn
Total Score

0

🔎

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • Researchers have developed an improved deep learning-based model for detecting small and complex defects on steel surfaces.
  • The model is based on the YOLOv5 architecture and includes modifications to improve performance on small targets.
  • The proposed model outperforms other comparable models in terms of accuracy and detection time.

Plain English Explanation

The paper presents an improved deep learning model for detecting defects on steel surfaces. During steel production, mechanical forces and environmental factors can cause small and complex defects on the surface of the steel. Accurately detecting these defects is crucial for producing high-quality steel, as undetected defects can lead to significant economic losses for manufacturers.

The researchers have developed a new model based on the popular YOLOv5 object detection architecture, with some modifications to better handle the small and intricate features of steel surface defects. The key changes include using a depth-wise convolution and channel shuffle mechanism to better capture small details, and assigning weighted importance to different features in the network's output to improve its ability to characterize the defects.

The researchers tested their improved model on two standard steel defect datasets and found that it outperformed other state-of-the-art models in terms of both accuracy and detection speed. This suggests their approach is a promising solution for the real-time detection of small and complex defects on steel surfaces, which could help manufacturers improve product quality and reduce costly production losses.

Technical Explanation

The researchers propose an enhanced YOLOv5-based model for detecting small and complex defects on steel surfaces. YOLOv5 is a popular object detection architecture known for its fast and accurate performance.

To better handle the small and intricate features of steel surface defects, the researchers made two key modifications to the standard YOLOv5 model:

  1. Depth-wise Convolution and Channel Shuffle: The researchers replaced the conventional convolutional layers with depth-wise convolutions and channel shuffle mechanisms. This allows the model to more effectively capture small details in the input images.

  2. Weighted Feature Fusion: The researchers assigned weighted importance to the features extracted at different scales by the Feature Pyramid Network (FPN) component of the model. This weighted fusion of multi-scale features improves the model's ability to characterize the small and complex defects.

The researchers evaluated their improved model on two standard steel defect datasets, the Northeastern University Dataset (NEU-DET) and the GC10-DET dataset. The results showed that their proposed model outperformed other state-of-the-art approaches in terms of both detection accuracy (77.5% mAP on NEU-DET, 70.18% mAP on GC10-DET) and inference speed.

Critical Analysis

The researchers have presented a well-designed and effective approach for detecting small and complex defects on steel surfaces using deep learning. The modifications to the YOLOv5 architecture, such as the use of depth-wise convolutions and weighted feature fusion, appear to be well-justified and effective based on the experimental results.

However, the paper does not provide much insight into the limitations or potential issues with the proposed model. For example, it would be helpful to understand how the model might perform on more diverse or challenging steel surface defect datasets, or how it compares to human expert inspection in terms of accuracy and reliability.

Additionally, the paper does not discuss any potential ethical or societal implications of the research, such as how the improved defect detection capabilities could impact the steel industry or the workers involved in quality control. A more in-depth discussion of these aspects would help readers better understand the broader context and significance of the work.

Overall, the research presents a promising technical solution, but could benefit from a more comprehensive evaluation and discussion of its limitations and broader implications.

Conclusion

The researchers have developed an improved deep learning-based model for detecting small and complex defects on steel surfaces. By modifying the popular YOLOv5 architecture, they have created a model that outperforms other state-of-the-art approaches in terms of both accuracy and detection speed.

This work has the potential to significantly impact the steel industry by enabling more reliable and efficient quality control, leading to higher-quality products and reduced production losses. The researchers' novel technical contributions, such as the use of depth-wise convolutions and weighted feature fusion, demonstrate the value of continued research and innovation in the field of defect detection using deep learning.

While the paper could benefit from a more comprehensive analysis of the model's limitations and broader implications, the presented work represents an important step forward in addressing the challenge of small and complex defect detection on steel surfaces.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

🔎

Total Score

0

Faster Metallic Surface Defect Detection Using Deep Learning with Channel Shuffling

Siddiqui Muhammad Yasir, Hyunsik Ahn

Deep learning has been constantly improving in recent years and a significant number of researchers have devoted themselves to the research of defect detection algorithms. Detection and recognition of small and complex targets is still a problem that needs to be solved. The authors of this research would like to present an improved defect detection model for detecting small and complex defect targets in steel surfaces. During steel strip production mechanical forces and environmental factors cause surface defects of the steel strip. Therefore the detection of such defects is key to the production of high-quality products. Moreover surface defects of the steel strip cause great economic losses to the high-tech industry. So far few studies have explored methods of identifying the defects and most of the currently available algorithms are not sufficiently effective. Therefore this study presents an improved real-time metallic surface defect detection model based on You Only Look Once (YOLOv5) specially designed for small networks. For the smaller features of the target the conventional part is replaced with a depth-wise convolution and channel shuffle mechanism. Then assigning weights to Feature Pyramid Networks (FPN) output features and fusing them increases feature propagation and the networks characterization ability. The experimental results reveal that the improved proposed model outperforms other comparable models in terms of accuracy and detection time. The precision of the proposed model achieved by @mAP is 77.5% on the Northeastern University Dataset NEU-DET and 70.18% on the GC10-DET datasets

Read more

6/24/2024

🚀

Total Score

0

Modeling & Evaluating the Performance of Convolutional Neural Networks for Classifying Steel Surface Defects

Nadeem Jabbar Chaudhry, M. Bilal Khan, M. Javaid Iqbal, Siddiqui Muhammad Yasir

Recently, outstanding identification rates in image classification tasks were achieved by convolutional neural networks (CNNs). to use such skills, selective CNNs trained on a dataset of well-known images of metal surface defects captured with an RGB camera. Defects must be detected early to take timely corrective action due to production concerns. For image classification up till now, a model-based method has been utilized, which indicated the predicted reflection characteristics of surface defects in comparison to flaw-free surfaces. The problem of detecting steel surface defects has grown in importance as a result of the vast range of steel applications in end-product sectors such as automobiles, households, construction, etc. The manual processes for detections are time-consuming, labor-intensive, and expensive. Different strategies have been used to automate manual processes, but CNN models have proven to be the most effective rather than image processing and machine learning techniques. By using different CNN models with fine-tuning, easily compare their performance and select the best-performing model for the same kinds of tasks. However, it is important that using different CNN models either from fine tuning can be computationally expensive and time-consuming. Therefore, our study helps the upcoming researchers to choose the CNN without considering the issues of model complexity, performance, and computational resources. In this article, the performance of various CNN models with transfer learning techniques are evaluated. These models were chosen based on their popularity and impact in the field of computer vision research, as well as their performance on benchmark datasets. According to the outcomes, DenseNet201 outperformed the other CNN models and had the greatest detection rate on the NEU dataset, falling in at 98.37 percent.

Read more

6/24/2024

YOLO-pdd: A Novel Multi-scale PCB Defect Detection Method Using Deep Representations with Sequential Images
Total Score

0

YOLO-pdd: A Novel Multi-scale PCB Defect Detection Method Using Deep Representations with Sequential Images

Bowen Liu, Dongjie Chen, Xiao Qi

With the rapid growth of the PCB manufacturing industry, there is an increasing demand for computer vision inspection to detect defects during production. Improving the accuracy and generalization of PCB defect detection models remains a significant challenge. This paper proposes a high-precision, robust, and real-time end-to-end method for PCB defect detection based on deep Convolutional Neural Networks (CNN). Traditional methods often suffer from low accuracy and limited applicability. We propose a novel approach combining YOLOv5 and multiscale modules for hierarchical residual-like connections. In PCB defect detection, noise can confuse the background and small targets. The YOLOv5 model provides a strong foundation with its real-time processing and accurate object detection capabilities. The multi-scale module extends traditional approaches by incorporating hierarchical residual-like connections within a single block, enabling multiscale feature extraction. This plug-and-play module significantly enhances performance by extracting features at multiple scales and levels, which are useful for identifying defects of varying sizes and complexities. Our multi-scale architecture integrates feature extraction, defect localization, and classification into a unified network. Experiments on a large-scale PCB dataset demonstrate significant improvements in precision, recall, and F1-score compared to existing methods. This work advances computer vision inspection for PCB defect detection, providing a reliable solution for high-precision, robust, real-time, and domain-adaptive defect detection in the PCB manufacturing industry.

Read more

7/23/2024

MINet: Multi-scale Interactive Network for Real-time Salient Object Detection of Strip Steel Surface Defects
Total Score

0

MINet: Multi-scale Interactive Network for Real-time Salient Object Detection of Strip Steel Surface Defects

Kunye Shen, Xiaofei Zhou, Zhi Liu

The automated surface defect detection is a fundamental task in industrial production, and the existing saliencybased works overcome the challenging scenes and give promising detection results. However, the cutting-edge efforts often suffer from large parameter size, heavy computational cost, and slow inference speed, which heavily limits the practical applications. To this end, we devise a multi-scale interactive (MI) module, which employs depthwise convolution (DWConv) and pointwise convolution (PWConv) to independently extract and interactively fuse features of different scales, respectively. Particularly, the MI module can provide satisfactory characterization for defect regions with fewer parameters. Embarking on this module, we propose a lightweight Multi-scale Interactive Network (MINet) to conduct real-time salient object detection of strip steel surface defects. Comprehensive experimental results on SD-Saliency-900 dataset, which contains three kinds of strip steel surface defect detection images (i.e., inclusion, patches, and scratches), demonstrate that the proposed MINet presents comparable detection accuracy with the state-of-the-art methods while running at a GPU speed of 721FPS and a CPU speed of 6.3FPS for 368*368 images with only 0.28M parameters. The code is available at https://github.com/Kunye-Shen/MINet.

Read more

5/28/2024