A comprehensive liver CT landmark pair dataset for evaluating deformable image registration algorithms
0
🖼️
Sign in to get full access
Overview
- This paper introduces a comprehensive liver computed tomography (CT) dataset for evaluating deformable image registration (DIR) algorithms.
- DIR is crucial for improving algorithm performance and gaining clinical acceptance, but there is a lack of reliable benchmark datasets for assessing DIR performance, especially for liver images.
- The authors aim to address this gap by creating a large-scale liver CT DIR landmark dataset.
Plain English Explanation
Deformable image registration (DIR) is a technique used in medical imaging to align two images that may have slight differences, such as a patient's body position changing between scans. Evaluating the performance of DIR algorithms is important for improving their accuracy and getting them accepted for clinical use. However, there are not many reliable datasets available for testing DIR algorithms, especially when it comes to images of the liver.
To address this issue, the researchers in this study created a comprehensive dataset of liver CT images with landmarks that can be used to assess DIR algorithms. They acquired 30 pairs of liver CT images from various sources and used a semi-automated process to identify landmarks, or specific points, within the images. These landmarks were then validated manually to ensure their accuracy.
The researchers found that their landmark detection process was quite accurate, with an average error of less than 1 millimeter. This dataset can now be used by other researchers working on DIR algorithms to test how well their methods perform on real liver CT scans, which is an important step in improving chest CT image understanding and automating data labeling for facial recognition.
Technical Explanation
The authors acquired 30 pairs of liver CT images from various public and institutional sources, with the appropriate institutional review board approvals. They used a semi-automatic process to generate landmark pairs within the images:
- Liver vessels were automatically segmented in one image of each pair.
- Landmarks were automatically detected at the vessel bifurcations.
- Corresponding landmarks in the second image were placed using a deformable image registration method.
- Manual validation was performed to remove any outliers and confirm the accuracy of the landmark positions.
This process resulted in an average of ~68 landmark pairs per image pair, for a total of 2,028 landmarks across all 30 cases. The accuracy of this landmarking procedure was evaluated using digital phantoms, which estimated a mean target registration error (TRE) of 0.64 mm and a standard deviation of 0.40 mm. Additionally, 99% of the landmark pairs had TREs below 2 mm.
The dataset and associated MATLAB code are publicly available on Zenodo and GitHub, respectively. This is the first large-scale liver CT DIR landmark dataset prepared on real patient images, which can provide researchers with a comprehensive set of ground truth benchmarks for evaluating DIR algorithms within the liver, as well as aid in quantifying and visualizing liver fat using ultrasound.
Critical Analysis
The authors have done a thorough job of creating a high-quality, publicly available dataset for evaluating DIR algorithms on liver CT images. The use of digital phantoms to assess the accuracy of the landmarking process is a strength, as it provides a reliable estimate of the overall landmark positioning error.
One potential limitation of the dataset is the relatively small sample size of 30 image pairs. While this is a substantial increase over the lack of publicly available liver DIR datasets, a larger dataset could provide even more robust benchmarking opportunities. Additionally, the authors do not address the potential impact of factors such as image quality, liver disease state, or other patient-specific characteristics on the performance of DIR algorithms using this dataset.
Further research could explore the use of this dataset in conjunction with other liver-related datasets, such as the Comprehensive Robotic Cholecystectomy Dataset, to provide a more comprehensive evaluation of DIR algorithms in the context of liver imaging and analysis.
Conclusion
This study introduces a valuable, publicly available dataset of liver CT images with dense landmark pairs that can be used to evaluate the performance of deformable image registration algorithms. The dataset is the first of its kind and provides researchers with a robust set of ground truth benchmarks for assessing DIR algorithms within the liver. This resource can contribute to the development of more accurate and clinically-accepted DIR methods, which are crucial for improving segmentation of small volumes in CT images and advancing various liver-related medical imaging applications.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
🖼️
0
A comprehensive liver CT landmark pair dataset for evaluating deformable image registration algorithms
Zhendong Zhang, Edward Robert Criscuolo, Yao Hao, Deshan Yang
Purpose: Evaluating deformable image registration (DIR) algorithms is vital for enhancing algorithm performance and gaining clinical acceptance. However, there's a notable lack of dependable DIR benchmark datasets for assessing DIR performance except for lung images. To address this gap, we aim to introduce our comprehensive liver computed tomography (CT) DIR landmark dataset library. Acquisition and Validation Methods: Thirty CT liver image pairs were acquired from several publicly available image archives as well as authors' institutions under institutional review board approval. The images were processed with a semi-automatic procedure to generate landmark pairs: 1) for each case, liver vessels were automatically segmented on one image; 2) landmarks were automatically detected at vessel bifurcations; 3) corresponding landmarks in the second image were placed using the deformable image registration method; 4) manual validation was applied to reject outliers and confirm the landmarks' positional accuracy. This workflow resulted in an average of ~68 landmark pairs per image pair, in a total of 2028 landmarks for all 30 cases. The general landmarking accuracy of this procedure was evaluated using digital phantoms. Estimates of the mean and standard deviation of landmark pair target registration errors (TRE) on digital phantoms were 0.64 and 0.40 mm. 99% of landmark pairs had TREs below 2 mm. Data Format and Usage Notes: All data are publicly available at Zenodo. Instructions for using our data and MATLAB code can be found on our GitHub page. Potential Applications: The landmark dataset generated in this work is the first collection of large-scale liver CT DIR landmarks prepared on real patient images. This dataset can provide researchers with a dense set of ground truth benchmarks for the quantitative evaluation of DIR algorithms within the liver.
Read more4/9/2024
0
Depth-Driven Geometric Prompt Learning for Laparoscopic Liver Landmark Detection
Jialun Pei, Ruize Cui, Yaoqian Li, Weixin Si, Jing Qin, Pheng-Ann Heng
Laparoscopic liver surgery poses a complex intraoperative dynamic environment for surgeons, where remains a significant challenge to distinguish critical or even hidden structures inside the liver. Liver anatomical landmarks, e.g., ridge and ligament, serve as important markers for 2D-3D alignment, which can significantly enhance the spatial perception of surgeons for precise surgery. To facilitate the detection of laparoscopic liver landmarks, we collect a novel dataset called L3D, which comprises 1,152 frames with elaborated landmark annotations from surgical videos of 39 patients across two medical sites. For benchmarking purposes, 12 mainstream detection methods are selected and comprehensively evaluated on L3D. Further, we propose a depth-driven geometric prompt learning network, namely D2GPLand. Specifically, we design a Depth-aware Prompt Embedding (DPE) module that is guided by self-supervised prompts and generates semantically relevant geometric information with the benefit of global depth cues extracted from SAM-based features. Additionally, a Semantic-specific Geometric Augmentation (SGA) scheme is introduced to efficiently merge RGB-D spatial and geometric information through reverse anatomic perception. The experimental results indicate that D2GPLand obtains state-of-the-art performance on L3D, with 63.52% DICE and 48.68% IoU scores. Together with 2D-3D fusion technology, our method can directly provide the surgeon with intuitive guidance information in laparoscopic scenarios.
Read more6/28/2024
🖼️
0
Diffeomorphic Transformer-based Abdomen MRI-CT Deformable Image Registration
Yang Lei, Luke A. Matkovic, Justin Roper, Tonghe Wang, Jun Zhou, Beth Ghavidel, Mark McDonald, Pretesh Patel, Xiaofeng Yang
This paper aims to create a deep learning framework that can estimate the deformation vector field (DVF) for directly registering abdominal MRI-CT images. The proposed method assumed a diffeomorphic deformation. By using topology-preserved deformation features extracted from the probabilistic diffeomorphic registration model, abdominal motion can be accurately obtained and utilized for DVF estimation. The model integrated Swin transformers, which have demonstrated superior performance in motion tracking, into the convolutional neural network (CNN) for deformation feature extraction. The model was optimized using a cross-modality image similarity loss and a surface matching loss. To compute the image loss, a modality-independent neighborhood descriptor (MIND) was used between the deformed MRI and CT images. The surface matching loss was determined by measuring the distance between the warped coordinates of the surfaces of contoured structures on the MRI and CT images. The deformed MRI image was assessed against the CT image using the target registration error (TRE), Dice similarity coefficient (DSC), and mean surface distance (MSD) between the deformed contours of the MRI image and manual contours of the CT image. When compared to only rigid registration, DIR with the proposed method resulted in an increase of the mean DSC values of the liver and portal vein from 0.850 and 0.628 to 0.903 and 0.763, a decrease of the mean MSD of the liver from 7.216 mm to 3.232 mm, and a decrease of the TRE from 26.238 mm to 8.492 mm. The proposed deformable image registration method based on a diffeomorphic transformer provides an effective and efficient way to generate an accurate DVF from an MRI-CT image pair of the abdomen. It could be utilized in the current treatment planning workflow for liver radiotherapy.
Read more5/7/2024
0
The ULS23 Challenge: a Baseline Model and Benchmark Dataset for 3D Universal Lesion Segmentation in Computed Tomography
M. J. J. de Grauw, E. Th. Scholten, E. J. Smit, M. J. C. M. Rutten, M. Prokop, B. van Ginneken, A. Hering
Size measurements of tumor manifestations on follow-up CT examinations are crucial for evaluating treatment outcomes in cancer patients. Efficient lesion segmentation can speed up these radiological workflows. While numerous benchmarks and challenges address lesion segmentation in specific organs like the liver, kidneys, and lungs, the larger variety of lesion types encountered in clinical practice demands a more universal approach. To address this gap, we introduced the ULS23 benchmark for 3D universal lesion segmentation in chest-abdomen-pelvis CT examinations. The ULS23 training dataset contains 38,693 lesions across this region, including challenging pancreatic, colon and bone lesions. For evaluation purposes, we curated a dataset comprising 775 lesions from 284 patients. Each of these lesions was identified as a target lesion in a clinical context, ensuring diversity and clinical relevance within this dataset. The ULS23 benchmark is publicly accessible via uls23.grand-challenge.org, enabling researchers worldwide to assess the performance of their segmentation methods. Furthermore, we have developed and publicly released our baseline semi-supervised 3D lesion segmentation model. This model achieved an average Dice coefficient of 0.703 $pm$ 0.240 on the challenge test set. We invite ongoing submissions to advance the development of future ULS models.
Read more6/24/2024