Automatic facial axes standardization of 3D fetal ultrasound images
0
Sign in to get full access
Overview
- This paper presents an approach for automatically standardizing the facial axes of 3D fetal ultrasound images.
- The goal is to align the facial features of the fetus in a consistent coordinate system to enable better analysis and comparison across different scans.
- The method uses 3D transformation and facial landmark detection to automatically orient the fetal face in a standard position.
Plain English Explanation
The researchers developed a way to automatically align the facial features of a fetus in 3D ultrasound images. This is important because it allows doctors and researchers to more easily compare and analyze different scans of the same fetus over time.
Typically, the orientation of the fetus can vary a lot between ultrasound scans, making it difficult to line up the facial features consistently. The new method uses 3D transformations and facial landmark detection to automatically adjust the images so that the fetal face is in a standardized position. This makes it easier to track changes in the facial features as the fetus develops.
By having a consistent way to view the fetal face, the research can provide more reliable data for assessing fetal health and development. This could lead to improved prenatal care and earlier detection of any issues.
Technical Explanation
The key innovation of this work is an automated pipeline to standardize the facial axes of 3D fetal ultrasound images. First, the method detects facial landmarks on the fetal face to determine its orientation. It then applies a 3D transformation to align the facial features to a predefined coordinate system.
The experiments show that this approach can successfully standardize the facial axes across multiple 3D ultrasound scans of the same fetus. The researchers evaluated the method on a dataset of over 1,000 fetal ultrasound volumes and found that it was able to accurately align the facial features compared to manual annotations by medical experts.
Critical Analysis
The paper acknowledges that the automatic facial axes standardization is an important but challenging task, as the fetal face can appear quite different across scans due to changes in position, facial expressions, and image quality.
While the proposed method seems effective overall, the authors note that it may struggle in cases where the fetal face is partially occluded or obscured. Further research would be needed to improve the robustness of the technique in these more difficult scenarios.
Additionally, the evaluation was limited to a single dataset, so more testing on diverse patient populations would help validate the generalizability of the approach.
Conclusion
This research presents a valuable contribution to the field of fetal ultrasound analysis by automating the standardization of facial axes. By consistently aligning the fetal facial features, this technique can enable more reliable comparisons and monitoring of fetal development over time.
The method has shown promising results and could potentially lead to improved prenatal care and earlier detection of any facial or developmental abnormalities. Further research to address the noted limitations would help strengthen the practical impact of this work.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
0
Automatic facial axes standardization of 3D fetal ultrasound images
Antonia Alomar, Ricardo Rubio, Laura Salort, Gerard Albaiges, Antoni Pay`a, Gemma Piella, Federico Sukno
Craniofacial anomalies indicate early developmental disturbances and are usually linked to many genetic syndromes. Early diagnosis is critical, yet ultrasound (US) examinations often fail to identify these features. This study presents an AI-driven tool to assist clinicians in standardizing fetal facial axes/planes in 3D US, reducing sonographer workload and facilitating the facial evaluation. Our network, structured into three blocks-feature extractor, rotation and translation regression, and spatial transformer-processes three orthogonal 2D slices to estimate the necessary transformations for standardizing the facial planes in the 3D US. These transformations are applied to the original 3D US using a differentiable module (the spatial transformer block), yielding a standardized 3D US and the corresponding 2D facial standard planes. The dataset used consists of 1180 fetal facial 3D US images acquired between weeks 20 and 35 of gestation. Results show that our network considerably reduces inter-observer rotation variability in the test set, with a mean geodesic angle difference of 14.12$^{circ}$ $pm$ 18.27$^{circ}$ and an Euclidean angle error of 7.45$^{circ}$ $pm$ 14.88$^{circ}$. These findings demonstrate the network's ability to effectively standardize facial axes, crucial for consistent fetal facial assessments. In conclusion, the proposed network demonstrates potential for improving the consistency and accuracy of fetal facial assessments in clinical settings, facilitating early evaluation of craniofacial anomalies.
Read more9/5/2024
0
Geometric Transformation Uncertainty for Improving 3D Fetal Brain Pose Prediction from Freehand 2D Ultrasound Videos
Jayroop Ramesh, Nicola K Dinsdale, the INTERGROWTH-21st Consortium, Pak-Hei Yeung, Ana IL Namburete
Accurately localizing two-dimensional (2D) ultrasound (US) fetal brain images in the 3D brain, using minimal computational resources, is an important task for automated US analysis of fetal growth and development. We propose an uncertainty-aware deep learning model for automated 3D plane localization in 2D fetal brain images. Specifically, a multi-head network is trained to jointly regress 3D plane pose from 2D images in terms of different geometric transformations. The model explicitly learns to predict uncertainty to allocate higher weight to inputs with low variances across different transformations to improve performance. Our proposed method, QAERTS, demonstrates superior pose estimation accuracy than the state-of-the-art and most of the uncertainty-based approaches, leading to 9% improvement on plane angle (PA) for localization accuracy, and 8% on normalized cross-correlation (NCC) for sampled image quality. QAERTS also demonstrates efficiency, containing 5$times$ fewer parameters than ensemble-based approach, making it advantageous in resource-constrained settings. In addition, QAERTS proves to be more robust to noise effects observed in freehand US scanning by leveraging rotational discontinuities and explicit output uncertainties.
Read more7/9/2024
0
Pose-GuideNet: Automatic Scanning Guidance for Fetal Head Ultrasound from Pose Estimation
Qianhui Men, Xiaoqing Guo, Aris T. Papageorghiou, J. Alison Noble
3D pose estimation from a 2D cross-sectional view enables healthcare professionals to navigate through the 3D space, and such techniques initiate automatic guidance in many image-guided radiology applications. In this work, we investigate how estimating 3D fetal pose from freehand 2D ultrasound scanning can guide a sonographer to locate a head standard plane. Fetal head pose is estimated by the proposed Pose-GuideNet, a novel 2D/3D registration approach to align freehand 2D ultrasound to a 3D anatomical atlas without the acquisition of 3D ultrasound. To facilitate the 2D to 3D cross-dimensional projection, we exploit the prior knowledge in the atlas to align the standard plane frame in a freehand scan. A semantic-aware contrastive-based approach is further proposed to align the frames that are off standard planes based on their anatomical similarity. In the experiment, we enhance the existing assessment of freehand image localization by comparing the transformation of its estimated pose towards standard plane with the corresponding probe motion, which reflects the actual view change in 3D anatomy. Extensive results on two clinical head biometry tasks show that Pose-GuideNet not only accurately predicts pose but also successfully predicts the direction of the fetal head. Evaluations with probe motions further demonstrate the feasibility of adopting Pose-GuideNet for freehand ultrasound-assisted navigation in a sensor-free environment.
Read more8/20/2024
0
Measuring proximity to standard planes during fetal brain ultrasound scanning
Chiara Di Vece, Antonio Cirigliano, Meala Le Lous, Raffaele Napolitano, Anna L. David, Donald Peebles, Pierre Jannin, Francisco Vasconcelos, Danail Stoyanov
This paper introduces a novel pipeline designed to bring ultrasound (US) plane pose estimation closer to clinical use for more effective navigation to the standard planes (SPs) in the fetal brain. We propose a semi-supervised segmentation model utilizing both labeled SPs and unlabeled 3D US volume slices. Our model enables reliable segmentation across a diverse set of fetal brain images. Furthermore, the model incorporates a classification mechanism to identify the fetal brain precisely. Our model not only filters out frames lacking the brain but also generates masks for those containing it, enhancing the relevance of plane pose regression in clinical settings. We focus on fetal brain navigation from 2D ultrasound (US) video analysis and combine this model with a US plane pose regression network to provide sensorless proximity detection to SPs and non-SPs planes; we emphasize the importance of proximity detection to SPs for guiding sonographers, offering a substantial advantage over traditional methods by allowing earlier and more precise adjustments during scanning. We demonstrate the practical applicability of our approach through validation on real fetal scan videos obtained from sonographers of varying expertise levels. Our findings demonstrate the potential of our approach to complement existing fetal US technologies and advance prenatal diagnostic practices.
Read more4/11/2024