WCEbleedGen: A wireless capsule endoscopy dataset and its benchmarking for automatic bleeding classification, detection, and segmentation

Read original: arXiv:2408.12466 - Published 8/23/2024 by Palak Handa, Manas Dhir, Amirreza Mahbod, Florian Schwarzhans, Ramona Woitek, Nidhi Goel, Deepak Gunjan
Total Score

0

WCEbleedGen: A wireless capsule endoscopy dataset and its benchmarking for automatic bleeding classification, detection, and segmentation

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • This paper introduces a new open-source dataset called WCEBleedGen for wireless capsule endoscopy (WCE) images.
  • The dataset is designed for benchmarking automatic bleeding classification, detection, and segmentation in WCE.
  • The authors provide a comprehensive evaluation of state-of-the-art deep learning models on the WCEBleedGen dataset.

Plain English Explanation

The paper describes a new open-source dataset called WCEBleedGen that can be used to help develop and test AI models for automatically detecting and classifying bleeding in wireless capsule endoscopy (WCE) images.

Wireless capsule endoscopy is a medical procedure where a patient swallows a small camera that takes pictures of the gastrointestinal tract as it travels through the body. Analyzing these images to detect signs of bleeding is an important task, but can be time-consuming for doctors. Developing automated systems to help with this could save time and improve patient care.

The WCEBleedGen dataset contains a large number of WCE images, some of which show signs of bleeding and some which do not. The authors used this dataset to evaluate how well various deep learning models can classify whether an image shows bleeding, detect the location of any bleeding, and segment the exact areas of bleeding. Their results provide a benchmark that future AI models in this area can be compared against.

Technical Explanation

The paper introduces the WCEBleedGen dataset, which contains a large collection of wireless capsule endoscopy (WCE) images. The dataset is designed to support three key tasks: binary classification (determining if an image shows gastrointestinal bleeding or not), detection (locating the position of any bleeding regions), and segmentation (precisely outlining the boundaries of bleeding areas).

To create the dataset, the authors collected over 100,000 WCE images from multiple medical institutions. They then manually annotated a subset of these images, labeling the presence, location, and extent of any bleeding regions. This annotated subset forms the core of the WCEBleedGen dataset.

The authors evaluate the performance of several state-of-the-art deep learning models on the WCEBleedGen dataset, including popular architectures like ResNet, U-Net, and Mask R-CNN. They measure metrics like accuracy, precision, recall, and intersection-over-union to compare how well the models can classify, detect, and segment bleeding in the test images.

The results show that the deep learning models are generally quite effective at these tasks, with the best models achieving over 90% accuracy on the binary classification problem and strong performance on detection and segmentation as well. However, the authors also identify areas for improvement, such as better generalization to unseen bleeding types and more robust handling of ambiguous or difficult cases.

Critical Analysis

The WCEBleedGen dataset and benchmarking presented in this paper represent a valuable contribution to the field of medical image analysis, particularly for applications in wireless capsule endoscopy. The dataset's large size, diversity of bleeding cases, and carefully curated annotations provide an important resource for developing and evaluating automated bleeding detection and segmentation systems.

One potential limitation of the work is the reliance on manually-annotated ground truth, which can be prone to human error or inconsistencies. The authors acknowledge this and suggest incorporating techniques like crowdsourcing to further refine the annotations. Additionally, the dataset only covers a subset of the full spectrum of gastrointestinal conditions visible in WCE, so expanding its scope could be an area for future work.

While the deep learning models evaluated demonstrated strong performance, the authors note that there is still room for improvement, especially in handling challenging or ambiguous cases. Exploring novel network architectures, data augmentation strategies, and multi-task learning approaches could potentially lead to more robust and generalizable models.

Overall, this paper lays important groundwork for advancing the state of the art in automated WCE analysis. The WCEBleedGen dataset and benchmarking results provide a solid foundation for future research, and the insights gained can help drive the development of more accurate and clinically-relevant AI systems for this critical medical application.

Conclusion

This paper presents a new open-source dataset called WCEBleedGen that can be used to develop and evaluate AI models for automatically detecting and classifying bleeding in wireless capsule endoscopy images. The authors provide a comprehensive evaluation of state-of-the-art deep learning models on this dataset, demonstrating strong performance but also identifying areas for further improvement.

The WCEBleedGen dataset and benchmarking results represent an important step forward in advancing the field of automated medical image analysis, with the potential to significantly streamline the process of diagnosing gastrointestinal conditions and improve patient outcomes. By making this dataset publicly available, the authors have opened the door for broader collaboration and accelerated progress in this critical area of research.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

WCEbleedGen: A wireless capsule endoscopy dataset and its benchmarking for automatic bleeding classification, detection, and segmentation
Total Score

0

WCEbleedGen: A wireless capsule endoscopy dataset and its benchmarking for automatic bleeding classification, detection, and segmentation

Palak Handa, Manas Dhir, Amirreza Mahbod, Florian Schwarzhans, Ramona Woitek, Nidhi Goel, Deepak Gunjan

Computer-based analysis of Wireless Capsule Endoscopy (WCE) is crucial. However, a medically annotated WCE dataset for training and evaluation of automatic classification, detection, and segmentation of bleeding and non-bleeding frames is currently lacking. The present work focused on development of a medically annotated WCE dataset called WCEbleedGen for automatic classification, detection, and segmentation of bleeding and non-bleeding frames. It comprises 2,618 WCE bleeding and non-bleeding frames which were collected from various internet resources and existing WCE datasets. A comprehensive benchmarking and evaluation of the developed dataset was done using nine classification-based, three detection-based, and three segmentation-based deep learning models. The dataset is of high-quality, is class-balanced and contains single and multiple bleeding sites. Overall, our standard benchmark results show that Visual Geometric Group (VGG) 19, You Only Look Once version 8 nano (YOLOv8n), and Link network (Linknet) performed best in automatic classification, detection, and segmentation-based evaluations, respectively. Automatic bleeding diagnosis is crucial for WCE video interpretations. This diverse dataset will aid in developing of real-time, multi-task learning-based innovative solutions for automatic bleeding diagnosis in WCE. The dataset and code are publicly available at https://zenodo.org/records/10156571 and https://github.com/misahub2023/Benchmarking-Codes-of-the-WCEBleedGen-dataset.

Read more

8/23/2024

A Robust Pipeline for Classification and Detection of Bleeding Frames in Wireless Capsule Endoscopy using Swin Transformer and RT-DETR
Total Score

0

A Robust Pipeline for Classification and Detection of Bleeding Frames in Wireless Capsule Endoscopy using Swin Transformer and RT-DETR

Sasidhar Alavala, Anil Kumar Vadde, Aparnamala Kancheti, Subrahmanyam Gorthi

In this paper, we present our approach to the Auto WCEBleedGen Challenge V2 2024. Our solution combines the Swin Transformer for the initial classification of bleeding frames and RT-DETR for further detection of bleeding in Wireless Capsule Endoscopy (WCE), enhanced by a series of image preprocessing steps. These steps include converting images to Lab colour space, applying Contrast Limited Adaptive Histogram Equalization (CLAHE) for better contrast, and using Gaussian blur to suppress artefacts. The Swin Transformer utilizes a tiered architecture with shifted windows to efficiently manage self-attention calculations, focusing on local windows while enabling cross-window interactions. RT-DETR features an efficient hybrid encoder for fast processing of multi-scale features and an uncertainty-minimal query selection for enhanced accuracy. The class activation maps by Ablation-CAM are plausible to the model's decisions. On the validation set, this approach achieves a classification accuracy of 98.5% (best among the other state-of-the-art models) compared to 91.7% without any pre-processing and an $text{AP}_{50}$ of 66.7% compared to 65.0% with state-of-the-art YOLOv8. On the test set, this approach achieves a classification accuracy and F1 score of 87.0% and 89.0% respectively.

Read more

6/13/2024

Artificial Intelligence in Gastrointestinal Bleeding Analysis for Video Capsule Endoscopy: Insights, Innovations, and Prospects (2008-2023)
Total Score

0

Artificial Intelligence in Gastrointestinal Bleeding Analysis for Video Capsule Endoscopy: Insights, Innovations, and Prospects (2008-2023)

Tanisha Singh, Shreshtha Jha, Nidhi Bhatt, Palak Handa, Nidhi Goel, Sreedevi Indu

The escalating global mortality and morbidity rates associated with gastrointestinal (GI) bleeding, compounded by the complexities and limitations of traditional endoscopic methods, underscore the urgent need for a critical review of current methodologies used for addressing this condition. With an estimated 300,000 annual deaths worldwide, the demand for innovative diagnostic and therapeutic strategies is paramount. The introduction of Video Capsule Endoscopy (VCE) has marked a significant advancement, offering a comprehensive, non-invasive visualization of the digestive tract that is pivotal for detecting bleeding sources unattainable by traditional methods. Despite its benefits, the efficacy of VCE is hindered by diagnostic challenges, including time-consuming analysis and susceptibility to human error. This backdrop sets the stage for exploring Machine Learning (ML) applications in automating GI bleeding detection within capsule endoscopy, aiming to enhance diagnostic accuracy, reduce manual labor, and improve patient outcomes. Through an exhaustive analysis of 113 papers published between 2008 and 2023, this review assesses the current state of ML methodologies in bleeding detection, highlighting their effectiveness, challenges, and prospective directions. It contributes an in-depth examination of AI techniques in VCE frame analysis, offering insights into open-source datasets, mathematical performance metrics, and technique categorization. The paper sets a foundation for future research to overcome existing challenges, advancing gastrointestinal diagnostics through interdisciplinary collaboration and innovation in ML applications.

Read more

9/4/2024

HemoSet: The First Blood Segmentation Dataset for Automation of Hemostasis Management
Total Score

0

HemoSet: The First Blood Segmentation Dataset for Automation of Hemostasis Management

Albert J. Miao, Shan Lin, Jingpei Lu, Florian Richter, Benjamin Ostrander, Emily K. Funk, Ryan K. Orosco, Michael C. Yip

Hemorrhaging occurs in surgeries of all types, forcing surgeons to quickly adapt to the visual interference that results from blood rapidly filling the surgical field. Introducing automation into the crucial surgical task of hemostasis management would offload mental and physical tasks from the surgeon and surgical assistants while simultaneously increasing the efficiency and safety of the operation. The first step in automation of hemostasis management is detection of blood in the surgical field. To propel the development of blood detection algorithms in surgeries, we present HemoSet, the first blood segmentation dataset based on bleeding during a live animal robotic surgery. Our dataset features vessel hemorrhage scenarios where turbulent flow leads to abnormal pooling geometries in surgical fields. These pools are formed in conditions endemic to surgical procedures -- uneven heterogeneous tissue, under glossy lighting conditions and rapid tool movement. We benchmark several state-of-the-art segmentation models and provide insight into the difficulties specific to blood detection. We intend for HemoSet to spur development of autonomous blood suction tools by providing a platform for training and refining blood segmentation models, addressing the precision needed for such robotics.

Read more

6/4/2024