Uncertainty-aware Evidential Fusion-based Learning for Semi-supervised Medical Image Segmentation
2404.06177
0
0
Abstract
Although the existing uncertainty-based semi-supervised medical segmentation methods have achieved excellent performance, they usually only consider a single uncertainty evaluation, which often fails to solve the problem related to credibility completely. Therefore, based on the framework of evidential deep learning, this paper integrates the evidential predictive results in the cross-region of mixed and original samples to reallocate the confidence degree and uncertainty measure of each voxel, which is realized by emphasizing uncertain information of probability assignments fusion rule of traditional evidence theory. Furthermore, we design a voxel-level asymptotic learning strategy by introducing information entropy to combine with the fused uncertainty measure to estimate voxel prediction more precisely. The model will gradually pay attention to the prediction results with high uncertainty in the learning process, to learn the features that are difficult to master. The experimental results on LA, Pancreas-CT, ACDC and TBAD datasets demonstrate the superior performance of our proposed method in comparison with the existing state of the arts.
Create account to get full access
Overview
- This paper proposes an uncertainty-aware evidential fusion-based learning approach for semi-supervised medical image segmentation.
- The method leverages evidence theory to model the uncertainty in the segmentation process and combines labeled and unlabeled data to improve performance.
- The authors demonstrate the effectiveness of their approach on several medical image segmentation tasks, including brain tumor, cardiac, and lung segmentation.
Plain English Explanation
The paper presents a new method for segmenting medical images, which is the process of dividing an image into different regions or parts that correspond to specific anatomical structures. The key innovation is the use of evidential fusion to model the uncertainty in the segmentation process.
Typically, medical image segmentation relies on supervised learning, where a model is trained on a set of labeled images. However, obtaining high-quality labeled data for medical images can be challenging and time-consuming. The authors' approach allows the model to also use unlabeled data, which is more readily available, to improve its performance.
The key idea is to represent the uncertainty in the segmentation process using a mathematical framework called evidence theory. This allows the model to quantify its confidence in the segmentation of each pixel, which can be used to combine the labeled and unlabeled data effectively.
The authors demonstrate the effectiveness of their approach on several medical image segmentation tasks, such as brain tumor, cardiac, and lung segmentation. They show that their method outperforms traditional supervised learning approaches, especially when the amount of labeled data is limited.
Technical Explanation
The paper proposes an uncertainty-aware evidential fusion-based learning approach for semi-supervised medical image segmentation. The key elements of the proposed method are:
-
Evidential Representation: The authors use evidence theory to model the uncertainty in the segmentation process. They represent the segmentation output as a set of basic belief assignments (BBAs), which quantify the degree of belief in each possible segmentation class for each pixel.
-
Evidential Fusion: The method combines the BBAs from labeled and unlabeled data using an evidential fusion operator. This allows the model to leverage the information from both labeled and unlabeled data to improve the segmentation performance.
-
Uncertainty-Aware Loss: The authors define an uncertainty-aware loss function that takes into account the uncertainty in the segmentation, as captured by the BBAs. This encourages the model to learn segmentations with high confidence.
-
Semi-Supervised Training: The model is trained in a semi-supervised manner, where it alternates between updating the segmentation model and the evidential fusion parameters using both labeled and unlabeled data.
The authors evaluate their approach on several medical image segmentation tasks, including brain tumor, cardiac, and lung segmentation. They show that their method outperforms traditional supervised learning approaches, especially when the amount of labeled data is limited.
Critical Analysis
The paper presents a novel and interesting approach to semi-supervised medical image segmentation, with a solid theoretical foundation in evidence theory. The authors' use of evidential fusion to combine labeled and unlabeled data is a promising direction, as it allows the model to leverage the readily available unlabeled data to improve its performance.
One potential limitation of the approach is the computational complexity of the evidential fusion process, which could limit its scalability to larger datasets or higher-resolution images. The authors acknowledge this and suggest potential ways to address it, such as using approximate fusion techniques.
Additionally, the paper does not provide a comprehensive comparison to other semi-supervised learning methods for medical image segmentation, such as pseudo-labeling or self-training. It would be valuable to see how the evidential fusion-based approach performs relative to these alternative techniques.
Overall, the paper presents a promising new direction for semi-supervised medical image segmentation and demonstrates the potential of evidence theory to model and leverage uncertainty in this domain. Further research and comparison to other state-of-the-art methods could help to fully evaluate the strengths and limitations of the proposed approach.
Conclusion
This paper introduces an uncertainty-aware evidential fusion-based learning method for semi-supervised medical image segmentation. The key innovation is the use of evidence theory to model the uncertainty in the segmentation process and effectively combine labeled and unlabeled data to improve performance.
The authors show that their approach outperforms traditional supervised learning methods, especially when the amount of labeled data is limited. This is a significant finding, as obtaining high-quality labeled data for medical images can be challenging and expensive.
The evidential fusion-based method presented in this paper represents an exciting new direction for semi-supervised medical image segmentation. Further research and comparison to other state-of-the-art techniques could help to fully evaluate the potential of this approach and its broader implications for the field.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
EPL: Evidential Prototype Learning for Semi-supervised Medical Image Segmentation
Yuanpeng He
0
0
Although current semi-supervised medical segmentation methods can achieve decent performance, they are still affected by the uncertainty in unlabeled data and model predictions, and there is currently a lack of effective strategies that can explore the uncertain aspects of both simultaneously. To address the aforementioned issues, we propose Evidential Prototype Learning (EPL), which utilizes an extended probabilistic framework to effectively fuse voxel probability predictions from different sources and achieves prototype fusion utilization of labeled and unlabeled data under a generalized evidential framework, leveraging voxel-level dual uncertainty masking. The uncertainty not only enables the model to self-correct predictions but also improves the guided learning process with pseudo-labels and is able to feed back into the construction of hidden features. The method proposed in this paper has been experimented on LA, Pancreas-CT and TBAD datasets, achieving the state-of-the-art performance in three different labeled ratios, which strongly demonstrates the effectiveness of our strategy.
4/10/2024
An Evidential-enhanced Tri-Branch Consistency Learning Method for Semi-supervised Medical Image Segmentation
Zhenxi Zhang, Heng Zhou, Xiaoran Shi, Ran Ran, Chunna Tian, Feng Zhou
0
0
Semi-supervised segmentation presents a promising approach for large-scale medical image analysis, effectively reducing annotation burdens while achieving comparable performance. This methodology holds substantial potential for streamlining the segmentation process and enhancing its feasibility within clinical settings for translational investigations. While cross-supervised training, based on distinct co-training sub-networks, has become a prevalent paradigm for this task, addressing critical issues such as predication disagreement and label-noise suppression requires further attention and progress in cross-supervised training. In this paper, we introduce an Evidential Tri-Branch Consistency learning framework (ETC-Net) for semi-supervised medical image segmentation. ETC-Net employs three branches: an evidential conservative branch, an evidential progressive branch, and an evidential fusion branch. The first two branches exhibit complementary characteristics, allowing them to address prediction diversity and enhance training stability. We also integrate uncertainty estimation from the evidential learning into cross-supervised training, mitigating the negative impact of erroneous supervision signals. Additionally, the evidential fusion branch capitalizes on the complementary attributes of the first two branches and leverages an evidence-based Dempster-Shafer fusion strategy, supervised by more reliable and accurate pseudo-labels of unlabeled data. Extensive experiments conducted on LA, Pancreas-CT, and ACDC datasets demonstrate that ETC-Net surpasses other state-of-the-art methods for semi-supervised segmentation. The code will be made available in the near future at https://github.com/Medsemiseg.
4/11/2024
🖼️
Semi-supervised Medical Image Segmentation via Geometry-aware Consistency Training
Zihang Liu, Chunhui Zhao
0
0
The performance of supervised deep learning methods for medical image segmentation is often limited by the scarcity of labeled data. As a promising research direction, semi-supervised learning addresses this dilemma by leveraging unlabeled data information to assist the learning process. In this paper, a novel geometry-aware semi-supervised learning framework is proposed for medical image segmentation, which is a consistency-based method. Considering that the hard-to-segment regions are mainly located around the object boundary, we introduce an auxiliary prediction task to learn the global geometric information. Based on the geometric constraint, the ambiguous boundary regions are emphasized through an exponentially weighted strategy for the model training to better exploit both labeled and unlabeled data. In addition, a dual-view network is designed to perform segmentation from different perspectives and reduce the prediction uncertainty. The proposed method is evaluated on the public left atrium benchmark dataset and improves fully supervised method by 8.7% in Dice with 10% labeled images, while 4.3% with 20% labeled images. Meanwhile, our framework outperforms six state-of-the-art semi-supervised segmentation methods.
5/13/2024
🖼️
Towards Reliable Medical Image Segmentation by utilizing Evidential Calibrated Uncertainty
Ke Zou, Yidi Chen, Ling Huang, Xuedong Yuan, Xiaojing Shen, Meng Wang, Rick Siow Mong Goh, Yong Liu, Huazhu Fu
0
0
Medical image segmentation is critical for disease diagnosis and treatment assessment. However, concerns regarding the reliability of segmentation regions persist among clinicians, mainly attributed to the absence of confidence assessment, robustness, and calibration to accuracy. To address this, we introduce DEviS, an easily implementable foundational model that seamlessly integrates into various medical image segmentation networks. DEviS not only enhances the calibration and robustness of baseline segmentation accuracy but also provides high-efficiency uncertainty estimation for reliable predictions. By leveraging subjective logic theory, we explicitly model probability and uncertainty for the problem of medical image segmentation. Here, the Dirichlet distribution parameterizes the distribution of probabilities for different classes of the segmentation results. To generate calibrated predictions and uncertainty, we develop a trainable calibrated uncertainty penalty. Furthermore, DEviS incorporates an uncertainty-aware filtering module, which utilizes the metric of uncertainty-calibrated error to filter reliable data within the dataset. We conducted validation studies to assess both the accuracy and robustness of DEviS segmentation, along with evaluating the efficiency and reliability of uncertainty estimation. These evaluations were performed using publicly available datasets including ISIC2018, LiTS2017, and BraTS2019. Additionally, two potential clinical trials are being conducted at Johns Hopkins OCT, Duke-OCT-DME, and FIVES datasets to demonstrate their efficacy in filtering high-quality or out-of-distribution data. Our code has been released in https://github.com/Cocofeat/DEviS.
4/16/2024