Automated Lesion Segmentation in Whole-Body PET/CT in a multitracer setting

Read original: arXiv:2409.09766 - Published 9/17/2024 by Qiaoyi Xue, Youdan Feng, Jiayi Liu, Tianming Xu, Kaixin Shen, Chuyun Shen, Yuhang Shi
Total Score

0

Automated Lesion Segmentation in Whole-Body PET/CT in a multitracer setting

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • Automated lesion segmentation in whole-body PET/CT scans using a multi-tracer approach
  • Leverages deep learning techniques to accurately identify and delineate lesions across different PET tracers
  • Potential to improve diagnosis, treatment planning, and monitoring for various diseases like cancer

Plain English Explanation

Positron Emission Tomography (PET) and Computed Tomography (CT) scans are important medical imaging techniques used to detect and monitor diseases like cancer. In this research, the authors developed a new automated lesion segmentation method that can analyze whole-body PET/CT scans and accurately identify and outline lesions (areas of abnormal tissue) using different PET tracers.

PET tracers are radioactive compounds that are injected into the body and accumulate in areas with high metabolic activity, such as tumors. By using multiple PET tracers, doctors can gain a more comprehensive understanding of a patient's condition. However, manually analyzing and segmenting lesions from these complex scans can be time-consuming and prone to variability.

The researchers' deep learning approach automates this process, allowing for faster and more consistent lesion identification across different PET tracers. This could lead to improved diagnosis, treatment planning, and monitoring of various diseases, especially cancer.

Technical Explanation

The proposed method uses a multi-task deep learning architecture to simultaneously segment lesions in whole-body PET/CT scans acquired using different PET tracers. The model takes as input the PET and CT images and outputs a segmentation mask indicating the location and extent of the lesions.

The key components of the architecture include:

  • Encoder: A shared encoder network that extracts features from the input PET and CT images
  • Decoder: Multiple decoder networks, each specialized for a specific PET tracer, that generate the final segmentation masks
  • Multi-task Loss: A loss function that combines the segmentation losses for each PET tracer, encouraging the model to learn a shared representation that generalizes across tracers

The model was trained and evaluated on a large dataset of whole-body PET/CT scans from multiple institutions, using several common PET tracers such as FDG, PSMA, and DOTATATE. The researchers demonstrated that their approach outperformed various baseline methods in terms of segmentation accuracy, highlighting the benefits of the multi-tracer learning strategy.

Critical Analysis

The authors acknowledge several limitations of their work, including the need for larger and more diverse datasets to further improve the model's generalization capabilities. Additionally, the study focuses on static lesion segmentation, and future research could explore dynamic lesion tracking to support longitudinal disease monitoring.

While the results are promising, the authors do not discuss the potential for biases in the training data or the model, which could lead to systematic errors in lesion detection and segmentation. Validation on more diverse patient populations and addressing potential algorithmic biases would be important next steps.

Conclusion

This research presents a novel automated lesion segmentation approach for whole-body PET/CT scans that leverages deep learning to accurately identify and delineate lesions across different PET tracers. The multi-tracer learning strategy demonstrates the potential to improve disease diagnosis, treatment planning, and monitoring, with potential applications in various medical domains, such as oncology. Future work should focus on expanding the dataset, addressing potential biases, and exploring dynamic lesion tracking capabilities to further enhance the clinical utility of this technology.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

Automated Lesion Segmentation in Whole-Body PET/CT in a multitracer setting
Total Score

0

New!Automated Lesion Segmentation in Whole-Body PET/CT in a multitracer setting

Qiaoyi Xue, Youdan Feng, Jiayi Liu, Tianming Xu, Kaixin Shen, Chuyun Shen, Yuhang Shi

This study explores a workflow for automated segmentation of lesions in FDG and PSMA PET/CT images. Due to the substantial differences in image characteristics between FDG and PSMA, specialized preprocessing steps are required. Utilizing YOLOv8 for data classification, the FDG and PSMA images are preprocessed separately before feeding them into the segmentation models, aiming to improve lesion segmentation accuracy. The study focuses on evaluating the performance of automated segmentation workflow for multitracer PET images. The findings are expected to provide critical insights for enhancing diagnostic workflows and patient-specific treatment plans. Our code will be open-sourced and available at https://github.com/jiayiliu-pku/AP2024.

Read more

9/17/2024

Enhancing Lesion Segmentation in PET/CT Imaging with Deep Learning and Advanced Data Preprocessing Techniques
Total Score

0

New!Enhancing Lesion Segmentation in PET/CT Imaging with Deep Learning and Advanced Data Preprocessing Techniques

Jiayi Liu, Qiaoyi Xue, Youdan Feng, Tianming Xu, Kaixin Shen, Chuyun Shen, Yuhang Shi

The escalating global cancer burden underscores the critical need for precise diagnostic tools in oncology. This research employs deep learning to enhance lesion segmentation in PET/CT imaging, utilizing a dataset of 900 whole-body FDG-PET/CT and 600 PSMA-PET/CT studies from the AutoPET challenge III. Our methodical approach includes robust preprocessing and data augmentation techniques to ensure model robustness and generalizability. We investigate the influence of non-zero normalization and modifications to the data augmentation pipeline, such as the introduction of RandGaussianSharpen and adjustments to the Gamma transform parameter. This study aims to contribute to the standardization of preprocessing and augmentation strategies in PET/CT imaging, potentially improving the diagnostic accuracy and the personalized management of cancer patients. Our code will be open-sourced and available at https://github.com/jiayiliu-pku/DC2024.

Read more

9/17/2024

From FDG to PSMA: A Hitchhiker's Guide to Multitracer, Multicenter Lesion Segmentation in PET/CT Imaging
Total Score

0

New!From FDG to PSMA: A Hitchhiker's Guide to Multitracer, Multicenter Lesion Segmentation in PET/CT Imaging

Maximilian Rokuss, Balint Kovacs, Yannick Kirchhoff, Shuhan Xiao, Constantin Ulrich, Klaus H. Maier-Hein, Fabian Isensee

Automated lesion segmentation in PET/CT scans is crucial for improving clinical workflows and advancing cancer diagnostics. However, the task is challenging due to physiological variability, different tracers used in PET imaging, and diverse imaging protocols across medical centers. To address this, the autoPET series was created to challenge researchers to develop algorithms that generalize across diverse PET/CT environments. This paper presents our solution for the autoPET III challenge, targeting multitracer, multicenter generalization using the nnU-Net framework with the ResEncL architecture. Key techniques include misalignment data augmentation and multi-modal pretraining across CT, MR, and PET datasets to provide an initial anatomical understanding. We incorporate organ supervision as a multitask approach, enabling the model to distinguish between physiological uptake and tracer-specific patterns, which is particularly beneficial in cases where no lesions are present. Compared to the default nnU-Net, which achieved a Dice score of 57.61, or the larger ResEncL (65.31) our model significantly improved performance with a Dice score of 68.40, alongside a reduction in false positive (FPvol: 7.82) and false negative (FNvol: 10.35) volumes. These results underscore the effectiveness of combining advanced network design, augmentation, pretraining, and multitask learning for PET/CT lesion segmentation. Code is publicly available at https://github.com/MIC-DKFZ/autopet-3-submission.

Read more

9/17/2024

Towards AI Lesion Tracking in PET/CT Imaging: A Siamese-based CNN Pipeline applied on PSMA PET/CT Scans
Total Score

0

Towards AI Lesion Tracking in PET/CT Imaging: A Siamese-based CNN Pipeline applied on PSMA PET/CT Scans

Stefan P. Hein, Manuel Schultheiss, Andrei Gafita, Raphael Zaum, Farid Yagubbayli, Robert Tauber, Isabel Rauscher, Matthias Eiber, Franz Pfeiffer, Wolfgang A. Weber

Assessing tumor response to systemic therapies is one of the main applications of PET/CT. Routinely, only a small subset of index lesions out of multiple lesions is analyzed. However, this operator dependent selection may bias the results due to possible significant inter-metastatic heterogeneity of response to therapy. Automated, AI based approaches for lesion tracking hold promise in enabling the analysis of many more lesions and thus providing a better assessment of tumor response. This work introduces a Siamese CNN approach for lesion tracking between PET/CT scans. Our approach is applied on the laborious task of tracking a high number of bone lesions in full-body baseline and follow-up [68Ga]Ga- or [18F]F-PSMA PET/CT scans after two cycles of [177Lu]Lu-PSMA therapy of metastatic castration resistant prostate cancer patients. Data preparation includes lesion segmentation and affine registration. Our algorithm extracts suitable lesion patches and forwards them into a Siamese CNN trained to classify the lesion patch pairs as corresponding or non-corresponding lesions. Experiments have been performed with different input patch types and a Siamese network in 2D and 3D. The CNN model successfully learned to classify lesion assignments, reaching a lesion tracking accuracy of 83 % in its best configuration with an AUC = 0.91. For remaining lesions the pipeline accomplished a re-identification rate of 89 %. We proved that a CNN may facilitate the tracking of multiple lesions in PSMA PET/CT scans. Future clinical studies are necessary if this improves the prediction of the outcome of therapies.

Read more

7/9/2024