Image registration based automated lesion correspondence pipeline for longitudinal CT data
0
🖼️
Sign in to get full access
Overview
- Patients with metastatic breast cancer often have multiple lesions in different organs, making it important to accurately track changes in these lesions during treatment.
- Manually matching lesions across different scans is a time-consuming and error-prone process.
- This paper introduces an automated algorithm to precisely track both target and non-target lesions in longitudinal imaging data.
- The algorithm uses a two-step process: (1) establishing correspondence between lesions within a single scan, and (2) applying 3D rigid registration to match lesions across different scans.
Plain English Explanation
Patients with a serious form of breast cancer called metastatic breast cancer often have tumors that have spread to other parts of the body. To understand how well the cancer is responding to treatment, doctors need to carefully track changes in these tumors over time using medical imaging scans. Manually matching the same tumors across different scans is a tedious and error-prone process.
The researchers developed a new computer algorithm to automate this tumor tracking process. First, the algorithm matches up the different tumors that are identified within a single scan by different radiologists. Then, it uses a technique called 3D rigid registration to align the scans from different time points, allowing it to automatically track the same tumors over time. This makes it much easier for doctors to see how the cancer is responding to treatment.
Technical Explanation
The paper describes an automated lesion correspondence algorithm designed to track both target and non-target lesions in longitudinal imaging data for patients with metastatic breast cancer. The algorithm uses a two-step approach:
-
Intra-Scan Lesion Correspondence: An adaptive Hungarian algorithm is employed to establish correspondence between lesions that have been annotated by multiple radiologists within a single volumetric image series at a specific timepoint. This matching process assigns unique identifiers to the lesions.
-
Inter-Scan Lesion Correspondence: After establishing intra-scan correspondence, 3D rigid registration is applied to align different image series from the same timepoint. The adaptive Hungarian algorithm is then used again to update the lesion identifiers based on the registered scans, enabling accurate longitudinal tracking.
The researchers validated their algorithm using triaxial plots to confirm the accuracy of the lesion matching across different views (axial, sagittal, coronal). This demonstrates the efficacy of their approach in automating the lesion tracking process compared to manual methods.
Critical Analysis
The paper provides a robust and well-designed algorithm for automating the challenging task of lesion correspondence in longitudinal imaging data for metastatic breast cancer patients. The use of 3D rigid registration to align scans across timepoints is a key innovation that enables accurate tracking of lesions.
However, the paper does not discuss the potential limitations of the algorithm, such as how it may perform with more complex deformations or changes in lesion shape over time. Additionally, the validation was limited to a single dataset, and further testing on a broader range of patient cases would help demonstrate the general applicability of the approach.
It would also be valuable to understand the computational efficiency and processing time of the algorithm, as this is an important consideration for integrating such tools into clinical workflows. Exploring the integration of this algorithm with other deep learning-based segmentation and analysis techniques could also lead to further advancements in automated cancer assessment.
Conclusion
This paper presents a novel automated algorithm for precisely tracking both target and non-target lesions in longitudinal imaging data for metastatic breast cancer patients. By combining intra-scan lesion correspondence with 3D rigid registration, the algorithm is able to accurately match lesions across different timepoints, overcoming the limitations of manual matching approaches.
The validation results demonstrate the efficacy of this approach, which has the potential to significantly streamline the process of assessing disease progression and treatment response for clinicians. Further research to address the identified limitations and explore integration with other advanced imaging analysis techniques could lead to even more powerful tools for managing metastatic breast cancer.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
🖼️
0
Image registration based automated lesion correspondence pipeline for longitudinal CT data
Subrata Mukherjee, Thibaud Coroller, Craig Wang, Ravi K. Samala, Tingting Hu, Didem Gokcay, Nicholas Petrick, Berkman Sahiner, Qian Cao
Patients diagnosed with metastatic breast cancer (mBC) typically undergo several radiographic assessments during their treatment. mBC often involves multiple metastatic lesions in different organs, it is imperative to accurately track and assess these lesions to gain a comprehensive understanding of the disease's response to treatment. Computerized analysis methods that rely on lesion-level tracking have often used manual matching of corresponding lesions, a time-consuming process that is prone to errors. This paper introduces an automated lesion correspondence algorithm designed to precisely track both targets' lesions and non-targets' lesions in longitudinal data. Here we demonstrate the applicability of our algorithm on the anonymized data from two Phase III trials. The dataset contains imaging data of patients for different follow-up timepoints and the radiologist annotations for the patients enrolled in the trials. Target and non-target lesions are annotated by either one or two groups of radiologists. To facilitate accurate tracking, we have developed a registration-assisted lesion correspondence algorithm. The algorithm employs a sequential two-step pipeline: (a) Firstly, an adaptive Hungarian algorithm is used to establish correspondence among lesions within a single volumetric image series which have been annotated by multiple radiologists at a specific timepoint. (b) Secondly, after establishing correspondence and assigning unique names to the lesions, three-dimensional rigid registration is applied to various image series at the same timepoint. Registration is followed by ongoing lesion correspondence based on the adaptive Hungarian algorithm and updating lesion names for accurate tracking. Validation of our automated lesion correspondence algorithm is performed through triaxial plots based on axial, sagittal, and coronal views, confirming its efficacy in matching lesions.
Read more4/26/2024
0
Towards AI Lesion Tracking in PET/CT Imaging: A Siamese-based CNN Pipeline applied on PSMA PET/CT Scans
Stefan P. Hein, Manuel Schultheiss, Andrei Gafita, Raphael Zaum, Farid Yagubbayli, Robert Tauber, Isabel Rauscher, Matthias Eiber, Franz Pfeiffer, Wolfgang A. Weber
Assessing tumor response to systemic therapies is one of the main applications of PET/CT. Routinely, only a small subset of index lesions out of multiple lesions is analyzed. However, this operator dependent selection may bias the results due to possible significant inter-metastatic heterogeneity of response to therapy. Automated, AI based approaches for lesion tracking hold promise in enabling the analysis of many more lesions and thus providing a better assessment of tumor response. This work introduces a Siamese CNN approach for lesion tracking between PET/CT scans. Our approach is applied on the laborious task of tracking a high number of bone lesions in full-body baseline and follow-up [68Ga]Ga- or [18F]F-PSMA PET/CT scans after two cycles of [177Lu]Lu-PSMA therapy of metastatic castration resistant prostate cancer patients. Data preparation includes lesion segmentation and affine registration. Our algorithm extracts suitable lesion patches and forwards them into a Siamese CNN trained to classify the lesion patch pairs as corresponding or non-corresponding lesions. Experiments have been performed with different input patch types and a Siamese network in 2D and 3D. The CNN model successfully learned to classify lesion assignments, reaching a lesion tracking accuracy of 83 % in its best configuration with an AUC = 0.91. For remaining lesions the pipeline accomplished a re-identification rate of 89 %. We proved that a CNN may facilitate the tracking of multiple lesions in PSMA PET/CT scans. Future clinical studies are necessary if this improves the prediction of the outcome of therapies.
Read more7/9/2024
🤷
0
Adaptive Correspondence Scoring for Unsupervised Medical Image Registration
Xiaoran Zhang, John C. Stendahl, Lawrence Staib, Albert J. Sinusas, Alex Wong, James S. Duncan
We propose an adaptive training scheme for unsupervised medical image registration. Existing methods rely on image reconstruction as the primary supervision signal. However, nuisance variables (e.g. noise and covisibility), violation of the Lambertian assumption in physical waves (e.g. ultrasound), and inconsistent image acquisition can all cause a loss of correspondence between medical images. As the unsupervised learning scheme relies on intensity constancy between images to establish correspondence for reconstruction, this introduces spurious error residuals that are not modeled by the typical training objective. To mitigate this, we propose an adaptive framework that re-weights the error residuals with a correspondence scoring map during training, preventing the parametric displacement estimator from drifting away due to noisy gradients, which leads to performance degradation. To illustrate the versatility and effectiveness of our method, we tested our framework on three representative registration architectures across three medical image datasets along with other baselines. Our adaptive framework consistently outperforms other methods both quantitatively and qualitatively. Paired t-tests show that our improvements are statistically significant. Code available at: url{https://voldemort108x.github.io/AdaCS/}.
Read more7/19/2024
0
Automatic Quantification of Serial PET/CT Images for Pediatric Hodgkin Lymphoma Patients Using a Longitudinally-Aware Segmentation Network
Xin Tie, Muheon Shin, Changhee Lee, Scott B. Perlman, Zachary Huemann, Amy J. Weisman, Sharon M. Castellino, Kara M. Kelly, Kathleen M. McCarten, Adina L. Alazraki, Junjie Hu, Steve Y. Cho, Tyler J. Bradshaw
$textbf{Purpose}$: Automatic quantification of longitudinal changes in PET scans for lymphoma patients has proven challenging, as residual disease in interim-therapy scans is often subtle and difficult to detect. Our goal was to develop a longitudinally-aware segmentation network (LAS-Net) that can quantify serial PET/CT images for pediatric Hodgkin lymphoma patients. $textbf{Materials and Methods}$: This retrospective study included baseline (PET1) and interim (PET2) PET/CT images from 297 patients enrolled in two Children's Oncology Group clinical trials (AHOD1331 and AHOD0831). LAS-Net incorporates longitudinal cross-attention, allowing relevant features from PET1 to inform the analysis of PET2. Model performance was evaluated using Dice coefficients for PET1 and detection F1 scores for PET2. Additionally, we extracted and compared quantitative PET metrics, including metabolic tumor volume (MTV) and total lesion glycolysis (TLG) in PET1, as well as qPET and $Delta$SUVmax in PET2, against physician measurements. We quantified their agreement using Spearman's $rho$ correlations and employed bootstrap resampling for statistical analysis. $textbf{Results}$: LAS-Net detected residual lymphoma in PET2 with an F1 score of 0.606 (precision/recall: 0.615/0.600), outperforming all comparator methods (P<0.01). For baseline segmentation, LAS-Net achieved a mean Dice score of 0.772. In PET quantification, LAS-Net's measurements of qPET, $Delta$SUVmax, MTV and TLG were strongly correlated with physician measurements, with Spearman's $rho$ of 0.78, 0.80, 0.93 and 0.96, respectively. The performance remained high, with a slight decrease, in an external testing cohort. $textbf{Conclusion}$: LAS-Net achieved high performance in quantifying PET metrics across serial scans, highlighting the value of longitudinal awareness in evaluating multi-time-point imaging datasets.
Read more4/15/2024