The ULS23 Challenge: a Baseline Model and Benchmark Dataset for 3D Universal Lesion Segmentation in Computed Tomography
0
Sign in to get full access
Overview
• This paper introduces the ULS23 Challenge, a new benchmark dataset and baseline model for 3D universal lesion segmentation in computed tomography (CT) images. • The ULS23 Challenge aims to advance the field of medical image analysis by providing a standardized dataset and evaluation framework for automated lesion detection and segmentation across various anatomical regions and pathologies. • The paper presents a baseline deep learning model for this task and evaluates its performance on the ULS23 dataset, establishing a benchmark for future research.
Plain English Explanation
The researchers have created a new dataset and computer model to help improve the ability of AI systems to automatically detect and outline areas of disease or injury (lesions) in 3D CT scans of the body. Currently, there is a lack of standardized datasets and benchmarks for this important medical imaging task, which the ULS23 Challenge aims to address.
The ULS23 dataset contains 3D CT scans of patients with a variety of lesions, such as tumors, infections, and organ damage. The researchers developed a baseline deep learning model that can analyze these 3D scans and automatically identify and delineate the boundaries of any lesions present.
By establishing this benchmark model and dataset, the researchers hope to spur further advancements in automated lesion segmentation - a capability that could significantly streamline medical diagnosis and treatment planning. The ULS23 Challenge provides a standardized way to evaluate and compare the performance of different AI models on this task.
Technical Explanation
The paper introduces the ULS23 Challenge, a new benchmark dataset and baseline model for 3D universal lesion segmentation in computed tomography (CT) images. The ULS23 dataset contains over 1,000 3D CT scans of patients with a diverse range of lesions, including tumors, infections, and organ damage, across multiple anatomical regions. This dataset aims to serve as a standardized evaluation framework for automated lesion detection and segmentation models.
The authors present a baseline deep learning model for the ULS23 task, based on a 3D U-Net architecture. The model takes a 3D CT volume as input and outputs a 3D segmentation map of all lesions present. The model is trained and evaluated on the ULS23 dataset using standard medical image segmentation metrics such as Dice score and Hausdorff distance.
The baseline model achieves a mean Dice score of 0.72 on the ULS23 dataset, establishing an initial benchmark for this task. The authors provide a detailed analysis of the model's performance across different lesion types, sizes, and anatomical locations, identifying areas for potential improvement.
Critical Analysis
The ULS23 Challenge and baseline model presented in this paper represent an important step towards advancing the state-of-the-art in automated lesion segmentation from 3D medical imaging data. By providing a large-scale, diverse dataset and standardized evaluation framework, the researchers have created a valuable resource for the medical imaging community.
However, the authors acknowledge several limitations of the current work. The dataset, while substantial, may not capture the full diversity of lesion types and presentations seen in clinical practice. Additionally, the baseline model, while performing reasonably well, still has room for improvement, particularly in segmenting smaller or harder-to-detect lesions.
Further research is needed to develop more robust and generalizable lesion segmentation models that can reliably detect and outline a wide range of pathologies across different anatomical regions. Incorporating additional context, such as multi-modal imaging data or patient clinical information, may help improve model performance.
Conclusion
The ULS23 Challenge introduced in this paper represents a significant advancement in the field of medical image analysis. By providing a standardized dataset and baseline model for 3D universal lesion segmentation, the researchers have laid the groundwork for future progress in this important area of AI-assisted diagnostics and treatment planning.
The availability of the ULS23 dataset and benchmark model will enable researchers and clinicians to develop and evaluate more accurate and robust lesion detection and segmentation algorithms, ultimately leading to improvements in patient care and outcomes. The authors' work serves as a valuable contribution to the ongoing effort to harness the power of AI for enhancing medical decision-making and patient management.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
0
The ULS23 Challenge: a Baseline Model and Benchmark Dataset for 3D Universal Lesion Segmentation in Computed Tomography
M. J. J. de Grauw, E. Th. Scholten, E. J. Smit, M. J. C. M. Rutten, M. Prokop, B. van Ginneken, A. Hering
Size measurements of tumor manifestations on follow-up CT examinations are crucial for evaluating treatment outcomes in cancer patients. Efficient lesion segmentation can speed up these radiological workflows. While numerous benchmarks and challenges address lesion segmentation in specific organs like the liver, kidneys, and lungs, the larger variety of lesion types encountered in clinical practice demands a more universal approach. To address this gap, we introduced the ULS23 benchmark for 3D universal lesion segmentation in chest-abdomen-pelvis CT examinations. The ULS23 training dataset contains 38,693 lesions across this region, including challenging pancreatic, colon and bone lesions. For evaluation purposes, we curated a dataset comprising 775 lesions from 284 patients. Each of these lesions was identified as a target lesion in a clinical context, ensuring diversity and clinical relevance within this dataset. The ULS23 benchmark is publicly accessible via uls23.grand-challenge.org, enabling researchers worldwide to assess the performance of their segmentation methods. Furthermore, we have developed and publicly released our baseline semi-supervised 3D lesion segmentation model. This model achieved an average Dice coefficient of 0.703 $pm$ 0.240 on the challenge test set. We invite ongoing submissions to advance the development of future ULS models.
Read more6/24/2024
0
Universal and Extensible Language-Vision Models for Organ Segmentation and Tumor Detection from Abdominal Computed Tomography
Jie Liu, Yixiao Zhang, Kang Wang, Mehmet Can Yavuz, Xiaoxi Chen, Yixuan Yuan, Haoliang Li, Yang Yang, Alan Yuille, Yucheng Tang, Zongwei Zhou
The advancement of artificial intelligence (AI) for organ segmentation and tumor detection is propelled by the growing availability of computed tomography (CT) datasets with detailed, per-voxel annotations. However, these AI models often struggle with flexibility for partially annotated datasets and extensibility for new classes due to limitations in the one-hot encoding, architectural design, and learning scheme. To overcome these limitations, we propose a universal, extensible framework enabling a single model, termed Universal Model, to deal with multiple public datasets and adapt to new classes (e.g., organs/tumors). Firstly, we introduce a novel language-driven parameter generator that leverages language embeddings from large language models, enriching semantic encoding compared with one-hot encoding. Secondly, the conventional output layers are replaced with lightweight, class-specific heads, allowing Universal Model to simultaneously segment 25 organs and six types of tumors and ease the addition of new classes. We train our Universal Model on 3,410 CT volumes assembled from 14 publicly available datasets and then test it on 6,173 CT volumes from four external datasets. Universal Model achieves first place on six CT tasks in the Medical Segmentation Decathlon (MSD) public leaderboard and leading performance on the Beyond The Cranial Vault (BTCV) dataset. In summary, Universal Model exhibits remarkable computational efficiency (6x faster than other dataset-specific models), demonstrates strong generalization across different hospitals, transfers well to numerous downstream tasks, and more importantly, facilitates the extensibility to new classes while alleviating the catastrophic forgetting of previously learned classes. Codes, models, and datasets are available at https://github.com/ljwztc/CLIP-Driven-Universal-Model
Read more5/29/2024
0
Dual channel CW nnU-Net for 3D PET-CT Lesion Segmentation in 2024 autoPET III Challenge
Ching-Wei Wang, Ting-Sheng Su, Keng-Wei Liu
PET/CT is extensively used in imaging malignant tumors because it highlights areas of increased glucose metabolism, indicative of cancerous activity. Accurate 3D lesion segmentation in PET/CT imaging is essential for effective oncological diagnostics and treatment planning. In this study, we developed an advanced 3D residual U-Net model for the Automated Lesion Segmentation in Whole-Body PET/CT - Multitracer Multicenter Generalization (autoPET III) Challenge, which will be held jointly with 2024 Medical Image Computing and Computer Assisted Intervention (MICCAI) conference at Marrakesh, Morocco. Proposed model incorporates a novel sample attention boosting technique to enhance segmentation performance by adjusting the contribution of challenging cases during training, improving generalization across FDG and PSMA tracers. The proposed model outperformed the challenge baseline model in the preliminary test set on the Grand Challenge platform, and our team is currently ranking in the 2nd place among 497 participants worldwide from 53 countries (accessed date: 2024/9/4), with Dice score of 0.8700, False Negative Volume of 19.3969 and False Positive Volume of 1.0857.
Read more9/12/2024
0
Automatic Organ and Pan-cancer Segmentation in Abdomen CT: the FLARE 2023 Challenge
Jun Ma, Yao Zhang, Song Gu, Cheng Ge, Ershuai Wang, Qin Zhou, Ziyan Huang, Pengju Lyu, Jian He, Bo Wang
Organ and cancer segmentation in abdomen Computed Tomography (CT) scans is the prerequisite for precise cancer diagnosis and treatment. Most existing benchmarks and algorithms are tailored to specific cancer types, limiting their ability to provide comprehensive cancer analysis. This work presents the first international competition on abdominal organ and pan-cancer segmentation by providing a large-scale and diverse dataset, including 4650 CT scans with various cancer types from over 40 medical centers. The winning team established a new state-of-the-art with a deep learning-based cascaded framework, achieving average Dice Similarity Coefficient scores of 92.3% for organs and 64.9% for lesions on the hidden multi-national testing set. The dataset and code of top teams are publicly available, offering a benchmark platform to drive further innovations https://codalab.lisn.upsaclay.fr/competitions/12239.
Read more8/23/2024