From Classification to Segmentation with Explainable AI: A Study on Crack Detection and Growth Monitoring

Overview

• This paper explores using explainable artificial intelligence (XAI) to segment and monitor surface cracks in infrastructure, reducing the need for costly pixel-level image annotations.
• Automatic visual inspection can effectively monitor hard-to-reach areas, but supervised machine learning approaches typically require large annotated datasets.
• The proposed method leverages XAI to derive segmentations from the explanations of a classifier, requiring only weak image-level supervision.

Plain English Explanation

Monitoring cracks in buildings, bridges, and other infrastructure is crucial for ensuring structural safety. Automated visual inspection can be an effective solution, especially in hard-to-reach areas. Machine learning techniques have proven useful for this task, but they usually need large datasets of labeled images to train the models.

Labeling images at the pixel level to show exactly where cracks are located is very time-consuming. To reduce this effort, the researchers in this paper propose using explainable AI (XAI) techniques. With XAI, they can get the model to explain its decisions, and then use those explanations to automatically generate segmentation maps of the cracks, without needing as many labeled images.

The key idea is that the model's explanations can provide useful information about where the cracks are, even if the images aren't fully labeled. This AI-guided feature segmentation approach allows the researchers to monitor the size and growth of the cracks over time, while significantly reducing the amount of manual labeling required.

Technical Explanation

The paper evaluates the performance of various XAI methods for segmenting and monitoring surface cracks. The researchers first train a crack detection classifier using only image-level labels (i.e., whether an image contains a crack or not), rather than the more labor-intensive pixel-level annotations.

They then apply different XAI techniques, such as SHAP and Grad-CAM, to derive segmentation masks from the classifier's explanations. These XAI-based segmentations are compared to ground truth pixel-level annotations, showing that while the quality is lower than fully supervised methods, the segmentations remain meaningful and enable effective monitoring of crack severity and growth over time.

Critical Analysis

The main limitation of this approach is that the XAI-based segmentations are not as precise as those produced by models trained on fully annotated data. However, the researchers argue that the substantial reduction in annotation effort outweighs this trade-off, especially for applications where approximate crack segmentation is sufficient for monitoring purposes.

Additionally, the performance of the XAI-based segmentation may be sensitive to the choice of XAI method and model architecture. Further research could explore ways to optimize the XAI techniques or combine them to improve the segmentation quality.

Overall, this work demonstrates the potential of leveraging XAI to enable effective infrastructure monitoring with reduced annotation costs, which could have significant practical implications for the construction and maintenance industries.

Conclusion

This paper presents a novel approach for segmenting and monitoring surface cracks in infrastructure using explainable AI (XAI) techniques. By deriving segmentation masks from the explanations of a crack detection classifier, the method can achieve meaningful crack segmentation with only weak image-level supervision, significantly reducing the need for labor-intensive pixel-level annotations.

While the segmentation quality may not match that of fully supervised methods, the ability to monitor crack severity and growth over time, coupled with the substantial cost savings, makes this a promising solution for practical infrastructure inspection and maintenance applications.