LiverUSRecon: Automatic 3D Reconstruction and Volumetry of the Liver with a Few Partial Ultrasound Scans

Read original: arXiv:2406.19336 - Published 7/1/2024 by Kaushalya Sivayogaraj, Sahan T. Guruge, Udari Liyanage, Jeevani Udupihille, Saroj Jayasinghe, Gerard Fernando, Ranga Rodrigo, M. Rukshani Liyanaarachchi
Total Score

0

LiverUSRecon: Automatic 3D Reconstruction and Volumetry of the Liver with a Few Partial Ultrasound Scans

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • Presents a method called LiverUSRecon for automatically reconstructing a 3D model of the liver from a few partial ultrasound scans
  • Utilizes a deep learning approach called TransUNet to segment the liver from the ultrasound images
  • Employs Statistical Shape Modeling (SSM) to generate a complete 3D liver shape from the partial scans
  • Provides an efficient way to obtain 3D liver volumetry measurements without the need for extensive imaging

Plain English Explanation

The LiverUSRecon method addresses a challenge in medical imaging - how to quickly and accurately measure the size of a patient's liver using ultrasound scans. Traditionally, this has required taking many ultrasound images from different angles to build up a complete 3D model of the organ.

The researchers developed a new approach that can reconstruct a 3D liver shape from just a few partial ultrasound scans. It works by first using a deep learning model called TransUNet to identify the liver in each ultrasound image. Then, it applies a technique called Statistical Shape Modeling (SSM) to generate a complete 3D model of the liver's shape from the partial scans.

This allows doctors to quickly measure the liver's volume, which is an important diagnostic tool for conditions like liver cancer or cirrhosis, without needing to take many time-consuming ultrasound scans. The 3D reconstruction can be generated from just a handful of partial scans, making the process much more efficient.

Technical Explanation

The LiverUSRecon method first uses a deep learning model called TransUNet to segment the liver region from each 2D ultrasound image. TransUNet is a convolutional neural network architecture that can accurately identify organs and tissues in medical scans.

After segmenting the liver in the partial ultrasound scans, the researchers employ Statistical Shape Modeling (SSM) to reconstruct a complete 3D model of the liver. SSM is a technique that creates a statistical description of the shape variations in a population of 3D objects, in this case livers. By fitting the partial liver scans to the SSM, LiverUSRecon can generate a plausible 3D shape that represents the full organ.

This combined approach of segmentation and shape modeling allows LiverUSRecon to efficiently generate an accurate 3D reconstruction of the liver from just a few 2D ultrasound scans. The researchers validated their method on a dataset of liver ultrasound images, demonstrating that the 3D liver volumes computed by LiverUSRecon closely matched those obtained from more extensive imaging.

Critical Analysis

The LiverUSRecon paper presents a promising approach for rapid 3D liver reconstruction from limited ultrasound data. However, the authors acknowledge that their method has some limitations.

Firstly, the accuracy of the 3D reconstruction is dependent on the quality and coverage of the initial ultrasound scans. If the scans do not capture key anatomical features of the liver, the shape modeling component may not be able to generate an accurate 3D model. Additionally, the SSM was built from a relatively small dataset of healthy liver shapes, so its ability to handle livers with significant pathological changes is unclear.

The authors also note that LiverUSRecon currently does not account for factors like liver deformation due to body positioning during the ultrasound exam. Incorporating biomechanical modeling could help improve the realism of the 3D reconstructions in the future.

Further research is needed to validate LiverUSRecon's performance on larger and more diverse patient populations, including those with liver diseases. Exploring ways to integrate LiverUSRecon with robotic ultrasound systems could also enhance its practical utility for clinical liver monitoring and follow-up.

Conclusion

The LiverUSRecon method presents an efficient approach for automatically reconstructing 3D models of the liver from limited ultrasound scan data. By combining deep learning for liver segmentation with Statistical Shape Modeling, the technique can generate accurate 3D liver volumetry measurements without the need for extensive imaging.

This innovation has the potential to streamline clinical liver assessment and monitoring, particularly for conditions like liver cancer or cirrhosis where regular volumetric measurements are important. Further development and validation of the LiverUSRecon approach could lead to more widespread adoption of rapid, ultrasound-based 3D liver reconstruction in healthcare settings.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

LiverUSRecon: Automatic 3D Reconstruction and Volumetry of the Liver with a Few Partial Ultrasound Scans
Total Score

0

LiverUSRecon: Automatic 3D Reconstruction and Volumetry of the Liver with a Few Partial Ultrasound Scans

Kaushalya Sivayogaraj, Sahan T. Guruge, Udari Liyanage, Jeevani Udupihille, Saroj Jayasinghe, Gerard Fernando, Ranga Rodrigo, M. Rukshani Liyanaarachchi

3D reconstruction of the liver for volumetry is important for qualitative analysis and disease diagnosis. Liver volumetry using ultrasound (US) scans, although advantageous due to less acquisition time and safety, is challenging due to the inherent noisiness in US scans, blurry boundaries, and partial liver visibility. We address these challenges by using the segmentation masks of a few incomplete sagittal-plane US scans of the liver in conjunction with a statistical shape model (SSM) built using a set of CT scans of the liver. We compute the shape parameters needed to warp this canonical SSM to fit the US scans through a parametric regression network. The resulting 3D liver reconstruction is accurate and leads to automatic liver volume calculation. We evaluate the accuracy of the estimated liver volumes with respect to CT segmentation volumes using RMSE. Our volume computation is statistically much closer to the volume estimated using CT scans than the volume computed using Childs' method by radiologists: p-value of 0.094 (>0.05) says that there is no significant difference between CT segmentation volumes and ours in contrast to Childs' method. We validate our method using investigations (ablation studies) on the US image resolution, the number of CT scans used for SSM, the number of principal components, and the number of input US scans. To the best of our knowledge, this is the first automatic liver volumetry system using a few incomplete US scans given a set of CT scans of livers for SSM.

Read more

7/1/2024

RapidVol: Rapid Reconstruction of 3D Ultrasound Volumes from Sensorless 2D Scans
Total Score

0

RapidVol: Rapid Reconstruction of 3D Ultrasound Volumes from Sensorless 2D Scans

Mark C. Eid, Pak-Hei Yeung, Madeleine K. Wyburd, Jo~ao F. Henriques, Ana I. L. Namburete

Two-dimensional (2D) freehand ultrasonography is one of the most commonly used medical imaging modalities, particularly in obstetrics and gynaecology. However, it only captures 2D cross-sectional views of inherently 3D anatomies, losing valuable contextual information. As an alternative to requiring costly and complex 3D ultrasound scanners, 3D volumes can be constructed from 2D scans using machine learning. However this usually requires long computational time. Here, we propose RapidVol: a neural representation framework to speed up slice-to-volume ultrasound reconstruction. We use tensor-rank decomposition, to decompose the typical 3D volume into sets of tri-planes, and store those instead, as well as a small neural network. A set of 2D ultrasound scans, with their ground truth (or estimated) 3D position and orientation (pose) is all that is required to form a complete 3D reconstruction. Reconstructions are formed from real fetal brain scans, and then evaluated by requesting novel cross-sectional views. When compared to prior approaches based on fully implicit representation (e.g. neural radiance fields), our method is over 3x quicker, 46% more accurate, and if given inaccurate poses is more robust. Further speed-up is also possible by reconstructing from a structural prior rather than from scratch.

Read more

4/17/2024

🤿

Total Score

0

Deep Learning Segmentation of Ascites on Abdominal CT Scans for Automatic Volume Quantification

Benjamin Hou, Sung-Won Lee, Jung-Min Lee, Christopher Koh, Jing Xiao, Perry J. Pickhardt, Ronald M. Summers

Purpose: To evaluate the performance of an automated deep learning method in detecting ascites and subsequently quantifying its volume in patients with liver cirrhosis and ovarian cancer. Materials and Methods: This retrospective study included contrast-enhanced and non-contrast abdominal-pelvic CT scans of patients with cirrhotic ascites and patients with ovarian cancer from two institutions, National Institutes of Health (NIH) and University of Wisconsin (UofW). The model, trained on The Cancer Genome Atlas Ovarian Cancer dataset (mean age, 60 years +/- 11 [s.d.]; 143 female), was tested on two internal (NIH-LC and NIH-OV) and one external dataset (UofW-LC). Its performance was measured by the Dice coefficient, standard deviations, and 95% confidence intervals, focusing on ascites volume in the peritoneal cavity. Results: On NIH-LC (25 patients; mean age, 59 years +/- 14 [s.d.]; 14 male) and NIH-OV (166 patients; mean age, 65 years +/- 9 [s.d.]; all female), the model achieved Dice scores of 0.855 +/- 0.061 (CI: 0.831-0.878) and 0.826 +/- 0.153 (CI: 0.764-0.887), with median volume estimation errors of 19.6% (IQR: 13.2-29.0) and 5.3% (IQR: 2.4-9.7) respectively. On UofW-LC (124 patients; mean age, 46 years +/- 12 [s.d.]; 73 female), the model had a Dice score of 0.830 +/- 0.107 (CI: 0.798-0.863) and median volume estimation error of 9.7% (IQR: 4.5-15.1). The model showed strong agreement with expert assessments, with r^2 values of 0.79, 0.98, and 0.97 across the test sets. Conclusion: The proposed deep learning method performed well in segmenting and quantifying the volume of ascites in concordance with expert radiologist assessments.

Read more

6/26/2024

🤯

Total Score

0

Autonomous Robotic Ultrasound System for Liver Follow-up Diagnosis: Pilot Phantom Study

Tianpeng Zhang (SEAS, Harvard University), Sekeun Kim (CAMCA, Massachusetts General Hospital and Harvard Medical School), Jerome Charton (CAMCA, Massachusetts General Hospital and Harvard Medical School), Haitong Ma (SEAS, Harvard University), Kyungsang Kim (CAMCA, Massachusetts General Hospital and Harvard Medical School), Na Li (SEAS, Harvard University), Quanzheng Li (CAMCA, Massachusetts General Hospital and Harvard Medical School)

The paper introduces a novel autonomous robot ultrasound (US) system targeting liver follow-up scans for outpatients in local communities. Given a computed tomography (CT) image with specific target regions of interest, the proposed system carries out the autonomous follow-up scan in three steps: (i) initial robot contact to surface, (ii) coordinate mapping between CT image and robot, and (iii) target US scan. Utilizing 3D US-CT registration and deep learning-based segmentation networks, we can achieve precise imaging of 3D hepatic veins, facilitating accurate coordinate mapping between CT and the robot. This enables the automatic localization of follow-up targets within the CT image, allowing the robot to navigate precisely to the target's surface. Evaluation of the ultrasound phantom confirms the quality of the US-CT registration and shows the robot reliably locates the targets in repeated trials. The proposed framework holds the potential to significantly reduce time and costs for healthcare providers, clinicians, and follow-up patients, thereby addressing the increasing healthcare burden associated with chronic disease in local communities.

Read more

5/10/2024