MRISegmentator-Abdomen: A Fully Automated Multi-Organ and Structure Segmentation Tool for T1-weighted Abdominal MRI

Read original: arXiv:2405.05944 - Published 6/26/2024 by Yan Zhuang, Tejas Sudharshan Mathai, Pritam Mukherjee, Brandon Khoury, Boah Kim, Benjamin Hou, Nusrat Rabbee, Abhinav Suri, Ronald M. Summers
Total Score

0

🛸

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • Developed a dataset of 195 abdominal MRI scans with detailed annotations of 62 organs and structures
  • Trained a 3D neural network model, MRISegmentator-Abdomen, to automatically segment these structures
  • Evaluated the model on internal and external datasets, achieving high accuracy

Plain English Explanation

Analyzing medical images like MRI scans is important for diagnosing diseases and planning treatments. However, manually outlining all the different organs and structures in these images can be tedious and time-consuming. Researchers have developed segmentation tools to automate this process, but most have focused on a limited set of around 13 structures.

This paper presents a more comprehensive solution. The researchers created a dataset of 195 abdominal MRI scans, with each scan annotated at the individual voxel (3D pixel) level to delineate 62 different organs and structures. They then trained a deep learning model, called MRISegmentator-Abdomen, to automatically segment these structures in new MRI scans.

When tested on both internal and external datasets, MRISegmentator achieved very high accuracy, with average Dice similarity scores above 0.8 and low surface distance errors. This suggests the model can provide reliable, detailed segmentations to support a variety of clinical applications, such as disease detection, radiotherapy planning, and tumor analysis.

Technical Explanation

The researchers curated a dataset of 195 abdominal MRI scans from the NIH Clinical Center, with each scan containing four different contrast phases (pre-contrast, arterial, venous, and delayed). In total, the dataset comprises 69,248 2D slices across 780 series, with voxel-level annotations of 62 different organs and structures.

They then trained a 3D version of the popular nnUNet model, which they dubbed MRISegmentator-Abdomen, on this dataset. nnUNet is a robust and flexible architecture that has shown strong performance on a variety of medical image segmentation tasks.

To evaluate the model, the researchers used an internal test set as well as two large external datasets: AMOS22 and Duke Liver. On the internal test set, MRISegmentator achieved an average Dice similarity coefficient (DSC) of 0.861 ± 0.170 and a normalized surface distance (NSD) of 0.924 ± 0.163. On the AMOS22 dataset, the model attained a DSC of 0.829 ± 0.133 and an NSD of 0.908 ± 0.067. For the Duke Liver dataset, the average DSC was 0.933 ± 0.015 and the NSD was 0.929 ± 0.021.

These results demonstrate that MRISegmentator can provide accurate and robust segmentations of a wide range of abdominal structures, outperforming previous methods that focused on a more limited set of structures. The availability of this comprehensive segmentation tool, along with the annotated dataset, has the potential to accelerate research in areas like abnormality detection, radiotherapy planning, and disease classification.

Critical Analysis

The researchers provide a thorough evaluation of their MRISegmentator model, demonstrating its strong performance on both internal and external datasets. However, they do acknowledge some limitations in their work. For example, the dataset was collected from a single institution, which may limit the model's generalization to scans from other medical centers or with different scanning protocols.

Additionally, while the model can segment a large number of structures, the clinical relevance and importance of each structure may vary. Further research could explore the relative significance of different structures for specific clinical applications, and potentially focus the model's training on the most critical ones.

The paper also does not provide much detail on the computational efficiency of the MRISegmentator model, which could be an important consideration for real-world deployment in clinical settings. Future work could investigate ways to optimize the model's speed and resource requirements without compromising its segmentation accuracy.

Overall, this research represents an important step forward in abdominal MRI segmentation, providing a comprehensive tool that could have a significant impact on various medical applications. Continued refinement and validation of the model, as well as exploration of its clinical utility, will be crucial next steps.

Conclusion

This paper presents a novel dataset and deep learning model for segmenting a comprehensive set of 62 organs and structures in abdominal MRI scans. The MRISegmentator-Abdomen model, trained on the curated dataset, demonstrates high accuracy and robustness when evaluated on both internal and external test sets.

The availability of this powerful segmentation tool, along with the underlying dataset, has the potential to accelerate research and clinical applications in areas like disease diagnosis, radiotherapy planning, and tumor analysis. As the field continues to advance, further refinements and validations of the model, as well as exploration of its clinical applications, will be important next steps.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

🛸

Total Score

0

MRISegmentator-Abdomen: A Fully Automated Multi-Organ and Structure Segmentation Tool for T1-weighted Abdominal MRI

Yan Zhuang, Tejas Sudharshan Mathai, Pritam Mukherjee, Brandon Khoury, Boah Kim, Benjamin Hou, Nusrat Rabbee, Abhinav Suri, Ronald M. Summers

Background: Segmentation of organs and structures in abdominal MRI is useful for many clinical applications, such as disease diagnosis and radiotherapy. Current approaches have focused on delineating a limited set of abdominal structures (13 types). To date, there is no publicly available abdominal MRI dataset with voxel-level annotations of multiple organs and structures. Consequently, a segmentation tool for multi-structure segmentation is also unavailable. Methods: We curated a T1-weighted abdominal MRI dataset consisting of 195 patients who underwent imaging at National Institutes of Health (NIH) Clinical Center. The dataset comprises of axial pre-contrast T1, arterial, venous, and delayed phases for each patient, thereby amounting to a total of 780 series (69,248 2D slices). Each series contains voxel-level annotations of 62 abdominal organs and structures. A 3D nnUNet model, dubbed as MRISegmentator-Abdomen (MRISegmentator in short), was trained on this dataset, and evaluation was conducted on an internal test set and two large external datasets: AMOS22 and Duke Liver. The predicted segmentations were compared against the ground-truth using the Dice Similarity Coefficient (DSC) and Normalized Surface Distance (NSD). Findings: MRISegmentator achieved an average DSC of 0.861$pm$0.170 and a NSD of 0.924$pm$0.163 in the internal test set. On the AMOS22 dataset, MRISegmentator attained an average DSC of 0.829$pm$0.133 and a NSD of 0.908$pm$0.067. For the Duke Liver dataset, an average DSC of 0.933$pm$0.015 and a NSD of 0.929$pm$0.021 was obtained. Interpretation: The proposed MRISegmentator provides automatic, accurate, and robust segmentations of 62 organs and structures in T1-weighted abdominal MRI sequences. The tool has the potential to accelerate research on various clinical topics, such as abnormality detection, radiotherapy, disease classification among others.

Read more

6/26/2024

🐍

Total Score

0

TotalSegmentator MRI: Sequence-Independent Segmentation of 59 Anatomical Structures in MR images

Tugba Akinci D'Antonoli, Lucas K. Berger, Ashraya K. Indrakanti, Nathan Vishwanathan, Jakob Wei{ss}, Matthias Jung, Zeynep Berkarda, Alexander Rau, Marco Reisert, Thomas Kustner, Alexandra Walter, Elmar M. Merkle, Martin Segeroth, Joshy Cyriac, Shan Yang, Jakob Wasserthal

Purpose: To develop an open-source and easy-to-use segmentation model that can automatically and robustly segment most major anatomical structures in MR images independently of the MR sequence. Materials and Methods: In this study we extended the capabilities of TotalSegmentator to MR images. 298 MR scans and 227 CT scans were used to segment 59 anatomical structures (20 organs, 18 bones, 11 muscles, 7 vessels, 3 tissue types) relevant for use cases such as organ volumetry, disease characterization, and surgical planning. The MR and CT images were randomly sampled from routine clinical studies and thus represent a real-world dataset (different ages, pathologies, scanners, body parts, sequences, contrasts, echo times, repetition times, field strengths, slice thicknesses and sites). We trained an nnU-Net segmentation algorithm on this dataset and calculated Dice similarity coefficients (Dice) to evaluate the model's performance. Results: The model showed a Dice score of 0.824 (CI: 0.801, 0.842) on the test set, which included a wide range of clinical data with major pathologies. The model significantly outperformed two other publicly available segmentation models (Dice score, 0.824 versus 0.762; p<0.001 and 0.762 versus 0.542; p<0.001). On the CT image test set of the original TotalSegmentator paper it almost matches the performance of the original TotalSegmentator (Dice score, 0.960 versus 0.970; p<0.001). Conclusion: Our proposed model extends the capabilities of TotalSegmentator to MR images. The annotated dataset (https://zenodo.org/doi/10.5281/zenodo.11367004) and open-source toolkit (https://www.github.com/wasserth/TotalSegmentator) are publicly available.

Read more

5/31/2024

↗️

Total Score

0

MRSegmentator: Robust Multi-Modality Segmentation of 40 Classes in MRI and CT Sequences

Hartmut Hantze, Lina Xu, Felix J. Dorfner, Leonhard Donle, Daniel Truhn, Hugo Aerts, Mathias Prokop, Bram van Ginneken, Alessa Hering, Lisa C. Adams, Keno K. Bressem

Purpose: To introduce a deep learning model capable of multi-organ segmentation in MRI scans, offering a solution to the current limitations in MRI analysis due to challenges in resolution, standardized intensity values, and variability in sequences. Materials and Methods: he model was trained on 1,200 manually annotated MRI scans from the UK Biobank, 221 in-house MRI scans and 1228 CT scans, leveraging cross-modality transfer learning from CT segmentation models. A human-in-the-loop annotation workflow was employed to efficiently create high-quality segmentations. The model's performance was evaluated on NAKO and the AMOS22 dataset containing 600 and 60 MRI examinations. Dice Similarity Coefficient (DSC) and Hausdorff Distance (HD) was used to assess segmentation accuracy. The model will be open sourced. Results: The model showcased high accuracy in segmenting well-defined organs, achieving Dice Similarity Coefficient (DSC) scores of 0.97 for the right and left lungs, and 0.95 for the heart. It also demonstrated robustness in organs like the liver (DSC: 0.96) and kidneys (DSC: 0.95 left, 0.95 right), which present more variability. However, segmentation of smaller and complex structures such as the portal and splenic veins (DSC: 0.54) and adrenal glands (DSC: 0.65 left, 0.61 right) revealed the need for further model optimization. Conclusion: The proposed model is a robust, tool for accurate segmentation of 40 anatomical structures in MRI and CT images. By leveraging cross-modality learning and interactive annotation, the model achieves strong performance and generalizability across diverse datasets, making it a valuable resource for researchers and clinicians. It is open source and can be downloaded from https://github.com/hhaentze/MRSegmentator.

Read more

5/14/2024

Automatic Organ and Pan-cancer Segmentation in Abdomen CT: the FLARE 2023 Challenge
Total Score

0

Automatic Organ and Pan-cancer Segmentation in Abdomen CT: the FLARE 2023 Challenge

Jun Ma, Yao Zhang, Song Gu, Cheng Ge, Ershuai Wang, Qin Zhou, Ziyan Huang, Pengju Lyu, Jian He, Bo Wang

Organ and cancer segmentation in abdomen Computed Tomography (CT) scans is the prerequisite for precise cancer diagnosis and treatment. Most existing benchmarks and algorithms are tailored to specific cancer types, limiting their ability to provide comprehensive cancer analysis. This work presents the first international competition on abdominal organ and pan-cancer segmentation by providing a large-scale and diverse dataset, including 4650 CT scans with various cancer types from over 40 medical centers. The winning team established a new state-of-the-art with a deep learning-based cascaded framework, achieving average Dice Similarity Coefficient scores of 92.3% for organs and 64.9% for lesions on the hidden multi-national testing set. The dataset and code of top teams are publicly available, offering a benchmark platform to drive further innovations https://codalab.lisn.upsaclay.fr/competitions/12239.

Read more

8/23/2024