Automated classification of multi-parametric body MRI series

Read original: arXiv:2405.08247 - Published 5/15/2024 by Boah Kim, Tejas Sudharshan Mathai, Kimberly Helm, Ronald M. Summers
Total Score

0

🏷️

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • Researchers propose an automated framework to classify different series types in multi-parametric MRI (mpMRI) studies
  • Trained a DenseNet-121 model on 1,363 mpMRI studies from three Siemens scanners, achieving high performance on a held-out test set
  • Aims to address inaccuracies in DICOM header fields that prevent automated hanging protocol arrangement, requiring manual intervention

Plain English Explanation

Multi-parametric MRI (mpMRI) scans are commonly used to diagnose various medical conditions. As the number of these scans increases each year, there can be errors in the information stored in the digital image files (DICOM headers). This makes it difficult for radiologists to automatically organize the different "series" or types of images that are part of an mpMRI exam, requiring them to manually correct the issues.

To address this problem, the researchers developed an automated framework to classify the series type in mpMRI studies. They used a deep learning model called DenseNet-121 to analyze a large dataset of 1,363 mpMRI scans from three different MRI scanners. Through this training process, the model learned to accurately identify the different series types, such as T1-weighted, T2-weighted, and diffusion-weighted images.

When tested on a separate set of 313 mpMRI studies, the model achieved very high performance, correctly classifying the series types with an average precision, sensitivity, and F1 score of around 97%. This demonstrates the model's capability to automate the organization of mpMRI exams, which could save radiologists time and effort in their clinical practice.

Technical Explanation

The researchers used a dataset of 1,363 mpMRI studies acquired by three Siemens scanners to train a DenseNet-121 model for the task of MRI series classification. DenseNet-121 is a type of deep convolutional neural network that has been shown to perform well on a variety of image recognition tasks.

The dataset was split into training, validation, and test sets using 5-fold cross-validation. This means the model was trained and evaluated multiple times on different subsets of the data to ensure robust performance.

When evaluated on the held-out test set of 313 mpMRI studies, the DenseNet-121 ensemble model achieved an average precision of 96.6%, sensitivity of 96.6%, specificity of 99.6%, and F1 score of 96.6% for the MRI series classification task. These metrics indicate the model was able to accurately identify the different series types, such as T1-weighted, T2-weighted, and diffusion-weighted images, which are commonly found in mpMRI exams of the chest, abdomen, and pelvis.

Critical Analysis

The researchers acknowledge that their study is a pilot work and that further validation on larger, more diverse datasets would be needed to fully assess the robustness of their approach. Additionally, the mpMRI studies were all acquired using Siemens scanners, so the model's performance on data from other manufacturers' scanners is unclear.

While the reported classification performance is impressive, the researchers do not provide much insight into the types of errors or misclassifications made by the model. Understanding the failure modes could help inform future improvements to the classification system or identify specific series types that are more challenging to distinguish.

Overall, this work demonstrates the potential for deep learning-based automation of MRI series classification, which could have significant practical benefits for radiologists and clinicians in terms of streamlining their workflow and reducing the need for manual intervention.

Conclusion

This pilot study presents an automated framework for classifying the series type in multi-parametric MRI (mpMRI) studies, which can help address the issue of inaccuracies in DICOM header fields that currently require manual correction by radiologists. The researchers trained a DenseNet-121 model on a large dataset of mpMRI scans and demonstrated high classification performance on a held-out test set.

If further validated on larger and more diverse datasets, this automated approach could be a valuable tool for improving the efficiency and consistency of radiological workflows in modern clinical practice. By reducing the need for manual intervention, it could free up radiologists' time to focus on more complex diagnostic tasks and enhance patient care.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

🏷️

Total Score

0

Automated classification of multi-parametric body MRI series

Boah Kim, Tejas Sudharshan Mathai, Kimberly Helm, Ronald M. Summers

Multi-parametric MRI (mpMRI) studies are widely available in clinical practice for the diagnosis of various diseases. As the volume of mpMRI exams increases yearly, there are concomitant inaccuracies that exist within the DICOM header fields of these exams. This precludes the use of the header information for the arrangement of the different series as part of the radiologist's hanging protocol, and clinician oversight is needed for correction. In this pilot work, we propose an automated framework to classify the type of 8 different series in mpMRI studies. We used 1,363 studies acquired by three Siemens scanners to train a DenseNet-121 model with 5-fold cross-validation. Then, we evaluated the performance of the DenseNet-121 ensemble on a held-out test set of 313 mpMRI studies. Our method achieved an average precision of 96.6%, sensitivity of 96.6%, specificity of 99.6%, and F1 score of 96.6% for the MRI series classification task. To the best of our knowledge, we are the first to develop a method to classify the series type in mpMRI studies acquired at the level of the chest, abdomen, and pelvis. Our method has the capability for robust automation of hanging protocols in modern radiology practice.

Read more

5/15/2024

Automatic classification of prostate MR series type using image content and metadata
Total Score

0

Automatic classification of prostate MR series type using image content and metadata

Deepa Krishnaswamy, B'alint Kov'acs, Stefan Denner, Steve Pieper, David Clunie, Christopher P. Bridge, Tina Kapur, Klaus H. Maier-Hein, Andrey Fedorov

With the wealth of medical image data, efficient curation is essential. Assigning the sequence type to magnetic resonance images is necessary for scientific studies and artificial intelligence-based analysis. However, incomplete or missing metadata prevents effective automation. We therefore propose a deep-learning method for classification of prostate cancer scanning sequences based on a combination of image data and DICOM metadata. We demonstrate superior results compared to metadata or image data alone, and make our code publicly available at https://github.com/deepakri201/DICOMScanClassification.

Read more

8/1/2024

Towards Non-invasive and Personalized Management of Breast Cancer Patients from Multiparametric MRI via A Large Mixture-of-Modality-Experts Model
Total Score

0

Towards Non-invasive and Personalized Management of Breast Cancer Patients from Multiparametric MRI via A Large Mixture-of-Modality-Experts Model

Luyang Luo, Mingxiang Wu, Mei Li, Yi Xin, Qiong Wang, Varut Vardhanabhuti, Winnie CW Chu, Zhenhui Li, Juan Zhou, Pranav Rajpurkar, Hao Chen

Breast magnetic resonance imaging (MRI) is the imaging technique with the highest sensitivity for detecting breast cancer and is routinely used for women at high risk. Despite the comprehensive multiparametric protocol of breast MRI, existing artificial intelligence-based studies predominantly rely on single sequences and have limited validation. Here we report a large mixture-of-modality-experts model (MOME) that integrates multiparametric MRI information within a unified structure, offering a noninvasive method for personalized breast cancer management. We have curated the largest multiparametric breast MRI dataset, involving 5,205 patients from three hospitals in the north, southeast, and southwest of China, for the development and extensive evaluation of our model. MOME demonstrated accurate and robust identification of breast cancer. It achieved comparable performance for malignancy recognition to that of four senior radiologists and significantly outperformed a junior radiologist, with 0.913 AUROC, 0.948 AUPRC, 0.905 F1 score, and 0.723 MCC. Our findings suggest that MOME could reduce the need for biopsies in BI-RADS 4 patients with a ratio of 7.3%, classify triple-negative breast cancer with an AUROC of 0.709, and predict pathological complete response to neoadjuvant chemotherapy with an AUROC of 0.694. The model further supports scalable and interpretable inference, adapting to missing modalities and providing decision explanations by highlighting lesions and measuring modality contributions. MOME exemplifies a discriminative, robust, scalable, and interpretable multimodal model, paving the way for noninvasive, personalized management of breast cancer patients based on multiparametric breast imaging data.

Read more

9/4/2024

📈

Total Score

0

Enhanced Self-supervised Learning for Multi-modality MRI Segmentation and Classification: A Novel Approach Avoiding Model Collapse

Linxuan Han, Sa Xiao, Zimeng Li, Haidong Li, Xiuchao Zhao, Fumin Guo, Yeqing Han, Xin Zhou

Multi-modality magnetic resonance imaging (MRI) can provide complementary information for computer-aided diagnosis. Traditional deep learning algorithms are suitable for identifying specific anatomical structures segmenting lesions and classifying diseases with magnetic resonance images. However, manual labels are limited due to high expense, which hinders further improvement of model accuracy. Self-supervised learning (SSL) can effectively learn feature representations from unlabeled data by pre-training and is demonstrated to be effective in natural image analysis. Most SSL methods ignore the similarity of multi-modality MRI, leading to model collapse. This limits the efficiency of pre-training, causing low accuracy in downstream segmentation and classification tasks. To solve this challenge, we establish and validate a multi-modality MRI masked autoencoder consisting of hybrid mask pattern (HMP) and pyramid barlow twin (PBT) module for SSL on multi-modality MRI analysis. The HMP concatenates three masking steps forcing the SSL to learn the semantic connections of multi-modality images by reconstructing the masking patches. We have proved that the proposed HMP can avoid model collapse. The PBT module exploits the pyramidal hierarchy of the network to construct barlow twin loss between masked and original views, aligning the semantic representations of image patches at different vision scales in latent space. Experiments on BraTS2023, PI-CAI, and lung gas MRI datasets further demonstrate the superiority of our framework over the state-of-the-art. The performance of the segmentation and classification is substantially enhanced, supporting the accurate detection of small lesion areas. The code is available at https://github.com/LinxuanHan/M2-MAE.

Read more

7/18/2024