Pavement Fatigue Crack Detection and Severity Classification Based on Convolutional Neural Network
0
🔎
Sign in to get full access
Overview
- Detecting and classifying pavement cracks is a challenging problem due to varying crack intensity, complex topological structure, and noisy texture backgrounds.
- Fatigue cracking or "alligator cracking" is a common type of pavement distress that needs to be monitored.
- Previous research has focused on pixel-level crack detection using limited datasets.
- This paper proposes a deep convolutional neural network model that can classify the presence and severity level of fatigue cracking.
Plain English Explanation
The researchers developed a deep learning model to automatically detect and classify the severity of pavement cracks in asphalt roads. Pavement cracks can be difficult to identify reliably because they come in varying shapes and intensities, and the background texture of the road can be noisy and distracting.
One common type of pavement crack is called "fatigue cracking" or "alligator cracking", which looks like a network of cracks that resemble an alligator's skin. Monitoring the condition of these cracks is important for maintaining road infrastructure.
Previous research has focused on using computer vision techniques to detect cracks at the individual pixel level, but this has limitations when working with a diverse range of crack patterns and road conditions.
The researchers in this paper took a different approach. They built a deep convolutional neural network model that can achieve two goals:
- Classify whether a pavement surface image contains fatigue cracking or not.
- Classify the severity level of any fatigue cracking present, based on a standard manual for identifying pavement distresses.
To train and test their model, the researchers collected a dataset of over 4,000 high-resolution pavement surface images from the town of Blacksburg, Virginia. They manually labeled each image into one of four severity categories according to the standard manual.
Technical Explanation
The researchers established a dataset of 4,484 high-resolution pavement surface images collected locally in Blacksburg, Virginia. They manually labeled over 4,000 of these images into four categories of fatigue cracking severity based on the Distress Identification Manual (DIM) standard.
They then built a four-layer convolutional neural network model to classify the images by pavement crack severity category. After just 30 epochs of training, the model achieved a 96.23% accuracy in classifying the presence of fatigue cracking, and a 96.74% accuracy in classifying the crack severity level. The model also achieved a 97.64% accuracy in classifying the presence of pavement markings after 20 epochs of training.
Critical Analysis
The researchers acknowledge that their dataset, while large compared to previous work, is still limited to a specific geographic region. Testing the model's performance on more diverse pavement conditions and crack patterns across different regions would be an important next step.
Additionally, while the model achieves very high classification accuracy, the researchers do not provide much insight into the types of errors the model makes or how it handles ambiguous or borderline cases. Understanding the model's failure modes and limitations would be valuable for assessing its real-world applicability.
Finally, the researchers do not discuss how their approach compares to other recent deep learning techniques for pavement damage detection and classification, such as using unsupervised segmentation or multi-task learning. Situating their work within the broader context of pavement inspection AI would help readers understand the unique contributions and limitations of this specific model.
Conclusion
This paper presents a deep learning-based approach for automatically detecting and classifying the severity of fatigue cracking on asphalt pavement surfaces. By training a convolutional neural network model on a large dataset of labeled pavement images, the researchers achieved very high accuracy in both crack presence and crack severity classification.
While the model's performance is impressive, further research is needed to understand its robustness to diverse pavement conditions and its limitations compared to other state-of-the-art techniques. Nonetheless, this work represents an important step forward in developing practical AI-based tools for monitoring and maintaining road infrastructure.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
🔎
0
Pavement Fatigue Crack Detection and Severity Classification Based on Convolutional Neural Network
Zhen Wang, Dylan G. Ildefonzo, Linbing Wang
Due to the varying intensity of pavement cracks, the complexity of topological structure, and the noise of texture background, image classification for asphalt pavement cracking has proven to be a challenging problem. Fatigue cracking, also known as alligator cracking, is one of the common distresses of asphalt pavement. It is thus important to detect and monitor the condition of alligator cracking on roadway pavements. Most research in this area has typically focused on pixel-level detection of cracking using limited datasets. A novel deep convolutional neural network that can achieve two objectives is proposed. The first objective of the proposed neural network is to classify presence of fatigue cracking based on pavement surface images. The second objective is to classify the fatigue cracking severity level based on the Distress Identification Manual (DIM) standard. In this paper, a databank of 4484 high-resolution pavement surface images is established in which images are taken locally in the Town of Blacksburg, Virginia, USA. In the data pre-preparation, over 4000 images are labeled into 4 categories manually according to DIM standards. A four-layer convolutional neural network model is then built to achieve the goal of classification of images by pavement crack severity category. The trained model reached the highest accuracy among all existing methods. After only 30 epochs of training, the model achieved a crack existence classification accuracy of 96.23% and a severity level classification accuracy of 96.74%. After 20 epochs of training, the model achieved a pavement marking presence classification accuracy of 97.64%.
Read more7/24/2024
🔎
0
Automated Pavement Cracks Detection and Classification Using Deep Learning
Selvia Nafaa, Hafsa Essam, Karim Ashour, Doaa Emad, Rana Mohamed, Mohammed Elhenawy, Huthaifa I. Ashqar, Abdallah A. Hassan, Taqwa I. Alhadidi
Monitoring asset conditions is a crucial factor in building efficient transportation asset management. Because of substantial advances in image processing, traditional manual classification has been largely replaced by semi-automatic/automatic techniques. As a result, automated asset detection and classification techniques are required. This paper proposes a methodology to detect and classify roadway pavement cracks using the well-known You Only Look Once (YOLO) version five (YOLOv5) and version 8 (YOLOv8) algorithms. Experimental results indicated that the precision of pavement crack detection reaches up to 67.3% under different illumination conditions and image sizes. The findings of this study can assist highway agencies in accurately detecting and classifying asset conditions under different illumination conditions. This will reduce the cost and time that are associated with manual inspection, which can greatly reduce the cost of highway asset maintenance.
Read more6/13/2024
0
Modeling Multi-Granularity Context Information Flow for Pavement Crack Detection
Junbiao Pang, Baocheng Xiong, Jiaqi Wu
Crack detection has become an indispensable, interesting yet challenging task in the computer vision community. Specially, pavement cracks have a highly complex spatial structure, a low contrasting background and a weak spatial continuity, posing a significant challenge to an effective crack detection method. In this paper, we address these problems from a view that utilizes contexts of the cracks and propose an end-to-end deep learning method to model the context information flow. To precisely localize crack from an image, it is critical to effectively extract and aggregate multi-granularity context, including the fine-grained local context around the cracks (in spatial-level) and the coarse-grained semantics (in segment-level). Concretely, in Convolutional Neural Network (CNN), low-level features extracted by the shallow layers represent the local information, while the deep layers extract the semantic features. Additionally, a second main insight in this work is that the semantic context should be an guidance to local context feature. By the above insights, the proposed method we first apply the dilated convolution as the backbone feature extractor to model local context, then we build a context guidance module to leverage semantic context to guide local feature extraction at multiple stages. To handle label alignment between stages, we apply the Multiple Instance Learning (MIL) strategy to align the high-level feature to the low-level ones in the stage-wise context flow. In addition, compared with these public crack datasets, to our best knowledge, we release the largest, most complex and most challenging Bitumen Pavement Crack (BPC) dataset. The experimental results on the three crack datasets demonstrate that the proposed method performs well and outperforms the current state-of-the-art methods.
Read more4/22/2024
🔎
0
Advancing Pavement Distress Detection in Developing Countries: A Novel Deep Learning Approach with Locally-Collected Datasets
Blessing Agyei Kyem, Eugene Kofi Okrah Denteh, Joshua Kofi Asamoah, Kenneth Adomako Tutu, Armstrong Aboah
Road infrastructure maintenance in developing countries faces unique challenges due to resource constraints and diverse environmental factors. This study addresses the critical need for efficient, accurate, and locally-relevant pavement distress detection methods in these regions. We present a novel deep learning approach combining YOLO (You Only Look Once) object detection models with a Convolutional Block Attention Module (CBAM) to simultaneously detect and classify multiple pavement distress types. The model demonstrates robust performance in detecting and classifying potholes, longitudinal cracks, alligator cracks, and raveling, with confidence scores ranging from 0.46 to 0.93. While some misclassifications occur in complex scenarios, these provide insights into unique challenges of pavement assessment in developing countries. Additionally, we developed a web-based application for real-time distress detection from images and videos. This research advances automated pavement distress detection and provides a tailored solution for developing countries, potentially improving road safety, optimizing maintenance strategies, and contributing to sustainable transportation infrastructure development.
Read more8/13/2024