Morphology-Enhanced CAM-Guided SAM for weakly supervised Breast Lesion Segmentation

Read original: arXiv:2311.11176 - Published 5/24/2024 by Xin Yue, Xiaoling Liu, Qing Zhao, Jianqiang Li, Changwei Song, Suqin Liu, Zhikai Yang, Guanghui Fu
Total Score

0

👨‍🏫

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • Ultrasound imaging is crucial for early detection of breast cancer
  • Accurate lesion identification and segmentation are essential for diagnosis
  • Traditional supervised learning methods require extensive manual labeling, which is time-consuming and labor-intensive
  • This study presents a novel framework for weakly supervised lesion segmentation in early breast ultrasound images

Plain English Explanation

Breast cancer is a serious health concern, and catching it early is crucial for effective treatment. Ultrasound imaging plays a key role in detecting breast cancer early on. When doctors analyze these ultrasound images, they need to accurately identify and outline any suspicious lesions or abnormalities. This is an important step in the diagnosis process.

However, the traditional way of doing this involves supervised machine learning models that require a lot of manual labeling work. Medical professionals have to carefully outline the lesions in many ultrasound images, which takes a lot of time and effort.

To address this challenge, the researchers in this study developed a new approach that doesn't need as much manual labeling. Their method uses morphological enhancement and class activation maps to help locate the lesions. Then, it employs a powerful computer vision model called the Segment Anything Model (SAM) to precisely segment the lesions.

This new framework requires much less manual work upfront, making it more efficient and scalable. And it achieves results that are comparable to the traditional supervised learning methods, which is impressive. Overall, this research provides a promising solution for improving breast cancer detection and analysis using ultrasound imaging.

Technical Explanation

The researchers present a novel framework for weakly supervised lesion segmentation in early breast ultrasound images. Their approach integrates several key components:

  1. Morphological Enhancement: They use morphological operations to enhance the features of the lesions in the ultrasound images, making them more distinct and easier to detect.

  2. Class Activation Map (CAM) Guidance: The researchers leverage CAMs, which are visual heatmaps that highlight the image regions most relevant to a particular classification task. They use the CAMs to help localize the lesions.

  3. Segment Anything Model (SAM) Segmentation: The Segment Anything Model, a powerful computer vision foundation model, is employed to perform detailed segmentation of the lesions.

This approach does not require pixel-level annotations, which are typically needed for supervised lesion segmentation methods. By integrating weakly supervised techniques with the SAM model, the researchers are able to reduce the cost and effort of data annotation.

The performance of the proposed framework is evaluated on the BUSI dataset, a popular benchmark for breast ultrasound image analysis. The method achieves a Dice score of 74.39%, which is comparable to supervised learning models that require manual annotations. Furthermore, it outperforms comparative supervised models in terms of Hausdorff distance, a metric that measures the distance between the predicted and ground truth segmentation boundaries.

Critical Analysis

The researchers have presented a compelling approach to address the challenge of manual annotation in breast ultrasound lesion segmentation. By leveraging weakly supervised techniques and powerful computer vision models like SAM, they have demonstrated a promising solution that can reduce the burden on medical professionals.

However, the paper does not provide a comprehensive discussion of the limitations or potential drawbacks of the proposed framework. For example, it would be helpful to understand how the method performs on a wider range of ultrasound data, including images with varying levels of quality, lesion characteristics, or patient demographics. Additionally, the researchers could explore the robustness of the approach to different types of lesions, such as benign and malignant nodules, which may require specialized techniques.

Further research could also investigate the generalization capabilities of the framework, such as its ability to adapt to new ultrasound imaging modalities or to be applied in other medical imaging domains beyond breast cancer.

Conclusion

This study presents a novel framework for weakly supervised lesion segmentation in early breast ultrasound images. By integrating morphological enhancement, class activation maps, and the Segment Anything Model, the researchers have developed an approach that can accurately identify and segment lesions without the need for extensive manual annotation.

The promising results, which match or exceed the performance of supervised learning methods, demonstrate the potential of this framework to streamline the breast cancer detection process and assist medical professionals in their diagnosis and treatment decisions. As the field of medical imaging continues to evolve, this research provides a valuable contribution towards more efficient and scalable solutions for early breast cancer detection.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

👨‍🏫

Total Score

0

Morphology-Enhanced CAM-Guided SAM for weakly supervised Breast Lesion Segmentation

Xin Yue, Xiaoling Liu, Qing Zhao, Jianqiang Li, Changwei Song, Suqin Liu, Zhikai Yang, Guanghui Fu

Ultrasound imaging plays a critical role in the early detection of breast cancer. Accurate identification and segmentation of lesions are essential steps in clinical practice, requiring methods to assist physicians in lesion segmentation. However, ultrasound lesion segmentation models based on supervised learning require extensive manual labeling, which is both time-consuming and labor-intensive. In this study, we present a novel framework for weakly supervised lesion segmentation in early breast ultrasound images. Our method uses morphological enhancement and class activation map (CAM)-guided localization. Finally, we employ the Segment Anything Model (SAM), a computer vision foundation model, for detailed segmentation. This approach does not require pixel-level annotation, thereby reducing the cost of data annotation. The performance of our method is comparable to supervised learning methods that require manual annotations, achieving a Dice score of 74.39% and outperforming comparative supervised models in terms of Hausdorff distance in the BUSI dataset. These results demonstrate that our framework effectively integrates weakly supervised learning with SAM, providing a promising solution for breast cancer image analysis. The code for this study is available at: https://github.com/YueXin18/MorSeg-CAM-SAM.

Read more

5/24/2024

SAM-Driven Weakly Supervised Nodule Segmentation with Uncertainty-Aware Cross Teaching
Total Score

0

SAM-Driven Weakly Supervised Nodule Segmentation with Uncertainty-Aware Cross Teaching

Xingyue Zhao, Peiqi Li, Xiangde Luo, Meng Yang, Shi Chang, Zhongyu Li

Automated nodule segmentation is essential for computer-assisted diagnosis in ultrasound images. Nevertheless, most existing methods depend on precise pixel-level annotations by medical professionals, a process that is both costly and labor-intensive. Recently, segmentation foundation models like SAM have shown impressive generalizability on natural images, suggesting their potential as pseudo-labelers. However, accurate prompts remain crucial for their success in medical images. In this work, we devise a novel weakly supervised framework that effectively utilizes the segmentation foundation model to generate pseudo-labels from aspect ration annotations for automatic nodule segmentation. Specifically, we develop three types of bounding box prompts based on scalable shape priors, followed by an adaptive pseudo-label selection module to fully exploit the prediction capabilities of the foundation model for nodules. We also present a SAM-driven uncertainty-aware cross-teaching strategy. This approach integrates SAM-based uncertainty estimation and label-space perturbations into cross-teaching to mitigate the impact of pseudo-label inaccuracies on model training. Extensive experiments on two clinically collected ultrasound datasets demonstrate the superior performance of our proposed method.

Read more

7/19/2024

🤖

Total Score

0

Ultrasound SAM Adapter: Adapting SAM for Breast Lesion Segmentation in Ultrasound Images

Zhengzheng Tu, Le Gu, Xixi Wang, Bo Jiang

Segment Anything Model (SAM) has recently achieved amazing results in the field of natural image segmentation. However, it is not effective for medical image segmentation, owing to the large domain gap between natural and medical images. In this paper, we mainly focus on ultrasound image segmentation. As we know that it is very difficult to train a foundation model for ultrasound image data due to the lack of large-scale annotated ultrasound image data. To address these issues, in this paper, we develop a novel Breast Ultrasound SAM Adapter, termed Breast Ultrasound Segment Anything Model (BUSSAM), which migrates the SAM to the field of breast ultrasound image segmentation by using the adapter technique. To be specific, we first design a novel CNN image encoder, which is fully trained on the BUS dataset. Our CNN image encoder is more lightweight, and focuses more on features of local receptive field, which provides the complementary information to the ViT branch in SAM. Then, we design a novel Cross-Branch Adapter to allow the CNN image encoder to fully interact with the ViT image encoder in SAM module. Finally, we add both of the Position Adapter and the Feature Adapter to the ViT branch to fine-tune the original SAM. The experimental results on AMUBUS and BUSI datasets demonstrate that our proposed model outperforms other medical image segmentation models significantly. Our code will be available at: https://github.com/bscs12/BUSSAM.

Read more

4/24/2024

Mask-Enhanced Segment Anything Model for Tumor Lesion Semantic Segmentation
Total Score

0

Mask-Enhanced Segment Anything Model for Tumor Lesion Semantic Segmentation

Hairong Shi, Songhao Han, Shaofei Huang, Yue Liao, Guanbin Li, Xiangxing Kong, Hua Zhu, Xiaomu Wang, Si Liu

Tumor lesion segmentation on CT or MRI images plays a critical role in cancer diagnosis and treatment planning. Considering the inherent differences in tumor lesion segmentation data across various medical imaging modalities and equipment, integrating medical knowledge into the Segment Anything Model (SAM) presents promising capability due to its versatility and generalization potential. Recent studies have attempted to enhance SAM with medical expertise by pre-training on large-scale medical segmentation datasets. However, challenges still exist in 3D tumor lesion segmentation owing to tumor complexity and the imbalance in foreground and background regions. Therefore, we introduce Mask-Enhanced SAM (M-SAM), an innovative architecture tailored for 3D tumor lesion segmentation. We propose a novel Mask-Enhanced Adapter (MEA) within M-SAM that enriches the semantic information of medical images with positional data from coarse segmentation masks, facilitating the generation of more precise segmentation masks. Furthermore, an iterative refinement scheme is implemented in M-SAM to refine the segmentation masks progressively, leading to improved performance. Extensive experiments on seven tumor lesion segmentation datasets indicate that our M-SAM not only achieves high segmentation accuracy but also exhibits robust generalization. The code is available at https://github.com/nanase1025/M-SAM.

Read more

7/12/2024