A multi-stage semi-supervised learning for ankle fracture classification on CT images

Introduction

The ankle joint is susceptible to injuries, with ankle fractures accounting for a significant portion of fractures. However, due to the complexity of the ankle joint and the variety of fracture types, diagnosing and treating ankle fractures can be challenging. Inappropriate treatments can lead to complications such as instability, joint pain, limited mobility, and early degenerative changes.

X-ray imaging remains a crucial diagnostic tool for fractures due to its affordability, speed, and low radiation exposure. Nonetheless, the intricate process of imaging diagnosis and the extensive knowledge required by doctors make machine learning a promising avenue for medical imaging diagnosis in orthopedics.

By integrating machine learning with clinical diagnosis in the orthopedic department, the effectiveness of digital medical treatment in orthopedics can be significantly enhanced.

The paper discusses the application of machine learning in orthopedic imaging diagnosis, particularly for ankle fractures. Previous research has focused on classifying lumbar spine ultrasound images, diagnosing spinal images, and identifying knee injuries on MRI images using machine learning algorithms like SVM and U-NET. However, MRI has drawbacks such as high radiation, lengthy process, and high cost.

While some studies have attempted to recognize ankle fractures in X-ray images using convolutional neural networks and structured report data, the current research is limited to identifying the presence of fractures without identifying the fracture region or type.

To address this gap, the study proposes a novel ankle fracture classification algorithm and constructs a new dataset based on fracture patient images. The algorithm segments the tibia and fibula using deep learning, registers the segmentation mask containing the fracture with a normal bone mask, and preprocesses and classifies the X-ray image of the ankle fracture.

The preprocessing process based on bone segmentation and registration effectively segments bone contours and utilizes unlabeled data and semi-supervised network training to improve fracture classification accuracy. The experimental results demonstrate the feasibility of the proposed algorithm in intelligent diagnosis of ankle fractures.

Related works

The passage discusses various classification methods for ankle fractures. The initial classification by Percival Pott was based on the number of fractured malleoli (unimalleolar, bimalleolar, or trimalleolar). However, it did not distinguish stable and unstable injuries or guide treatment.

The Lauge-Hansen classification correlated fracture lines with trauma mechanisms like supination-adduction, supination-eversion, pronation-eversion, and pronation-abduction. The supination-eversion pattern is the most common.

The Danis-Weber classification was based on the location of the main fibular fracture line - below, at, or above the syndesmosis level (Types A, B, and C). However, it did not predict the extent of injury or consider the medial side structures.

The AO-OTA classification expanded on Danis-Weber by considering fracture lines and the degree of comminution, allowing description of severity and instability.

A previous study applied a CNN for ankle fracture classification but without automated fracture delineation. Ideally, CNNs should combine object detection with segmentation for localization and classification simultaneously, guiding doctors during their learning curve.

The passage then discusses medical image segmentation techniques like U-Net and methods to enlarge the receptive fields of CNNs. It also covers semi-supervised classification, which aims to train classifiers using both labeled and unlabeled data, reducing the need for manual annotations.

Method

The proposed approach divides ankle fracture classification into two main steps. First, a convolutional neural network segments the tibia and fibula bones from the CT scan images. Then, the segmented fracture masks are registered to healthy ankle masks using a rigid registration algorithm to obtain a spatial transformation matrix. The registered and cropped masks focus on the tibia-fibula joint region.

In the second step, a semi-supervised network learns to classify the ankle fracture type from limited labeled data combined with unlabeled data. A pre-trained ResNet extracts features from the images. A relational weight network based on the Squeeze-and-Excitation architecture learns non-linear distance metrics between labeled and unlabeled samples to improve the accuracy of pseudo-labels generated for the unlabeled data. The network is trained by optimizing losses calculated from the labeled data cross-entropy, weighted unlabeled data cross-entropy, and a maximum mean discrepancy loss that reduces the distribution difference between labeled and unlabeled feature representations. This self-training approach leverages unlabeled data to improve ankle fracture classification performance.

Experimental results

The paper describes validating the proposed approach on two datasets - one for tibia and fibula segmentation and another for ankle fracture classification.

The tibia-fibula segmentation dataset consists of 176 CT scans with annotations of tibia and fibula. The dataset was randomly split into 122 training and 55 testing cases. Data augmentation techniques like rotation, scaling, and flipping were applied.

The ankle fracture classification dataset contains 612 CT scans, with 330 labeled and 282 unlabeled cases. The fractures were classified into types A, B, or C based on their location relative to the ankle joint. Three experienced surgeons provided labels for 330 cases, which were split into 285 training and 45 testing cases. The unlabeled 282 cases were used for semi-supervised learning.

The proposed method achieved state-of-the-art performance on the tibia-fibula segmentation task compared to existing methods like U-Net, V-Net, and Transformer-based models. Visualization showed clear segmentation of tibia and fibula, with slight advantages around fracture regions.

For ankle fracture classification, the method outperformed several semi-supervised techniques like MixMatch, FixMatch, and pseudo-labeling methods, especially when labeled data was limited. It also performed competitively against fully supervised methods like ResNet, DenseNet, and Vision Transformers when labeled data was sufficient.

Evaluation metrics like Dice, Hausdorff distance, accuracy, precision, sensitivity, and AUC were used to quantify the segmentation and classification performance comprehensively.

Conclusion

The paper proposes a novel algorithm for classifying ankle fractures to help convolutional neural networks (CNNs) make decisions based on more sensible visual patterns. The approach involves using deep learning to segment the tibia and fibula bones, and registering the segmentation mask containing the fracture with a normal bone mask. This preprocessing step helps effectively segment the bone contours and utilize unlabeled data through a semi-supervised network training strategy, improving fracture classification accuracy.

A new dataset was constructed using images of fracture patients collected from a hospital. The experimental results demonstrate the feasibility of the proposed algorithm for intelligent diagnosis of ankle fractures. This work represents a step towards using explainable artificial intelligence techniques to enhance understanding and improve computer-aided diagnosis.

Currently, the method assumes a simple fracture presence. Future work aims to generalize the approach to handle multiple, complicated, and compound fracture presences.