Accurate Patient Alignment without Unnecessary Imaging Dose via Synthesizing Patient-specific 3D CT Images from 2D kV Images

Read original: arXiv:2405.19338 - Published 5/31/2024 by Yuzhen Ding, Jason M. Holmes, Hongying Feng, Baoxin Li, Lisa A. McGee, Jean-Claude M. Rwigema, Sujay A. Vora, Daniel J. Ma, Robert L. Foote, Samir H. Patel and 1 other
Total Score

0

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • In radiotherapy, 2D X-ray images are commonly used to align patients when 3D imaging is unavailable, but this can lead to setup errors due to the projection of anatomy onto a 2D plane.
  • 3D cone-beam CT (CBCT) imaging in the treatment room provides better visibility, but the field of view is limited and the imaging dose can be high, especially for pediatric patients.
  • The proposed solution is to reconstruct 3D CT scans from the 2D X-ray images taken at the treatment position, using a dual-model framework with hierarchical Vision Transformer (ViT) blocks.

Plain English Explanation

Radiotherapy is a common cancer treatment that uses high-energy radiation to destroy tumor cells. During radiotherapy, it's important to accurately align the patient's body with the radiation beams to ensure the tumor receives the full dose while healthy tissues are spared.

When advanced 3D imaging systems like cone-beam CT (CBCT) are not available in the treatment room, doctors often rely on 2D X-ray images to align the patient. However, because the patient's 3D anatomy is projected onto a 2D plane, this can lead to errors in the patient's positioning, potentially missing the tumor or exposing healthy tissue to radiation.

While CBCT imaging provides a better 3D view of the patient's anatomy in the treatment room, the field of view is limited, and the radiation dose can be too high, especially for pediatric patients. To address this dilemma, the researchers proposed a new method to reconstruct 3D CT scans from the 2D X-ray images taken during the treatment session.

Their approach uses a dual-model framework with specialized Vision Transformer (ViT) blocks to generate accurate, full-size 3D CT scans in real-time (within milliseconds). This allows the doctors to see a faithful 3D representation of the patient's anatomy at the exact treatment position, improving the setup accuracy and minimizing the radiation dose.

The researchers tested their method on 10 patients with head and neck cancer and found that it achieved high image quality (97% accuracy) and minimal patient position uncertainty (less than 0.4 mm shift). This technology could significantly enhance the precision of radiotherapy treatments, especially for sensitive cases like pediatric cancer.

Technical Explanation

The proposed framework for reconstructing 3D CT scans from 2D X-ray images consists of a dual-model architecture built with hierarchical ViT blocks. Unlike previous proof-of-concept approaches, this framework takes the 2D X-ray images as the sole input and can generate accurate, full-size 3D CT scans in real-time (within milliseconds).

The first model in the framework is responsible for encoding the 2D X-ray images into a compact latent representation. This model uses a series of ViT blocks, which are well-suited for capturing the complex spatial relationships within the 2D images.

The second model in the framework is tasked with decoding the latent representation into a full-size 3D CT scan. This model also employs ViT blocks, but in a hierarchical fashion to progressively refine the 3D reconstruction. The hierarchical structure allows the model to efficiently capture both local and global features, leading to high-fidelity 3D reconstructions.

The researchers evaluated the proposed framework on 10 patients with head and neck cancer, assessing both the image quality (mean absolute error of 97%) and the patient position uncertainty (shift error of less than 0.4 mm). These results demonstrate the feasibility and accuracy of the approach, which can faithfully mirror the real-time patient position and significantly improve the setup accuracy for radiotherapy treatments.

Critical Analysis

The researchers have presented a promising solution to the challenge of aligning patients for radiotherapy treatments when advanced 3D imaging systems are not available. By reconstructing 3D CT scans from 2D X-ray images, their approach can provide a faithful representation of the patient's anatomy in the treatment position, which is crucial for improving setup accuracy and minimizing radiation exposure to healthy tissues.

One potential limitation of the study is the relatively small sample size of 10 patients with head and neck cancer. While the results are encouraging, it would be valuable to validate the approach on a larger and more diverse patient population, including other cancer types and body regions.

Additionally, the researchers did not provide detailed information on the computational resources required to run the dual-model framework in real-time. The ability to generate accurate 3D CT scans within milliseconds is a significant feat, but the practical implementation in a clinical setting may depend on the available hardware and computational power.

Further research could also explore the potential for this approach to be integrated with other advanced imaging techniques, such as MRI-CT registration or 4D imaging, to provide even more comprehensive and accurate patient information for radiotherapy planning and delivery.

Conclusion

The proposed dual-model framework with hierarchical ViT blocks represents a promising solution to the challenge of patient alignment in radiotherapy when 3D imaging is unavailable. By reconstructing accurate, full-size 3D CT scans from 2D X-ray images in real-time, this approach can significantly improve the setup accuracy and minimize radiation exposure, especially for sensitive cases like pediatric cancer.

The high-quality 3D reconstructions and minimal patient position uncertainty demonstrated in the study suggest that this technology could have a transformative impact on radiotherapy practices, enhancing the precision and safety of cancer treatments. As the researchers continue to refine and validate the approach, it could pave the way for more personalized and effective radiation therapy tailored to each patient's unique anatomy and tumor characteristics.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

Total Score

0

Accurate Patient Alignment without Unnecessary Imaging Dose via Synthesizing Patient-specific 3D CT Images from 2D kV Images

Yuzhen Ding, Jason M. Holmes, Hongying Feng, Baoxin Li, Lisa A. McGee, Jean-Claude M. Rwigema, Sujay A. Vora, Daniel J. Ma, Robert L. Foote, Samir H. Patel, Wei Liu

In radiotherapy, 2D orthogonally projected kV images are used for patient alignment when 3D-on-board imaging(OBI) unavailable. But tumor visibility is constrained due to the projection of patient's anatomy onto a 2D plane, potentially leading to substantial setup errors. In treatment room with 3D-OBI such as cone beam CT(CBCT), the field of view(FOV) of CBCT is limited with unnecessarily high imaging dose, thus unfavorable for pediatric patients. A solution to this dilemma is to reconstruct 3D CT from kV images obtained at the treatment position. Here, we propose a dual-models framework built with hierarchical ViT blocks. Unlike a proof-of-concept approach, our framework considers kV images as the solo input and can synthesize accurate, full-size 3D CT in real time(within milliseconds). We demonstrate the feasibility of the proposed approach on 10 patients with head and neck (H&N) cancer using image quality(MAE: 97%) and patient position uncertainty(shift error: <0.4mm). The proposed framework can generate accurate 3D CT faithfully mirroring real-time patient position, thus significantly improving patient setup accuracy, keeping imaging dose minimum, and maintaining treatment veracity.

Read more

5/31/2024

Panorama Tomosynthesis from Head CBCT with Simulated Projection Geometry
Total Score

0

Panorama Tomosynthesis from Head CBCT with Simulated Projection Geometry

Anusree P. S., Bikram Keshari Parida, Seong Yong Moon, Wonsang You

Cone Beam Computed Tomography (CBCT) and Panoramic X-rays are the most commonly used imaging modalities in dental health care. CBCT can produce three-dimensional views of a patient's head, providing clinicians with better diagnostic capability, whereas Panoramic X-ray can capture the entire maxillofacial region in a single image. If the CBCT is already available, it can be beneficial to synthesize a Panoramic X-ray, thereby avoiding an immediate additional scan and extra radiation exposure. Existing methods focus on delineating an approximate dental arch and creating orthogonal projections along this arch. However, no golden standard is available for such dental arch extractions, and this choice can affect the quality of synthesized X-rays. To avoid such issues, we propose a novel method for synthesizing Panoramic X-rays from diverse head CBCTs, employing a simulated projection geometry and dynamic rotation centers. Our method effectively synthesized panoramic views from CBCT, even for patients with missing or nonexistent teeth and in the presence of severe metal implants. Our results demonstrate that this method can generate high-quality panoramic images irrespective of the CBCT scanner geometry.

Read more

8/21/2024

Multi-view X-ray Image Synthesis with Multiple Domain Disentanglement from CT Scans
Total Score

0

Multi-view X-ray Image Synthesis with Multiple Domain Disentanglement from CT Scans

Lixing Tan, Shuang Song, Kangneng Zhou, Chengbo Duan, Lanying Wang, Huayang Ren, Linlin Liu, Wei Zhang, Ruoxiu Xiao

X-ray images play a vital role in the intraoperative processes due to their high resolution and fast imaging speed and greatly promote the subsequent segmentation, registration and reconstruction. However, over-dosed X-rays superimpose potential risks to human health to some extent. Data-driven algorithms from volume scans to X-ray images are restricted by the scarcity of paired X-ray and volume data. Existing methods are mainly realized by modelling the whole X-ray imaging procedure. In this study, we propose a learning-based approach termed CT2X-GAN to synthesize the X-ray images in an end-to-end manner using the content and style disentanglement from three different image domains. Our method decouples the anatomical structure information from CT scans and style information from unpaired real X-ray images/ digital reconstructed radiography (DRR) images via a series of decoupling encoders. Additionally, we introduce a novel consistency regularization term to improve the stylistic resemblance between synthesized X-ray images and real X-ray images. Meanwhile, we also impose a supervised process by computing the similarity of computed real DRR and synthesized DRR images. We further develop a pose attention module to fully strengthen the comprehensive information in the decoupled content code from CT scans, facilitating high-quality multi-view image synthesis in the lower 2D space. Extensive experiments were conducted on the publicly available CTSpine1K dataset and achieved 97.8350, 0.0842 and 3.0938 in terms of FID, KID and defined user-scored X-ray similarity, respectively. In comparison with 3D-aware methods ($pi$-GAN, EG3D), CT2X-GAN is superior in improving the synthesis quality and realistic to the real X-ray images.

Read more

8/1/2024

Edge Projection-Based Adaptive View Selection for Cone-Beam CT
Total Score

0

Edge Projection-Based Adaptive View Selection for Cone-Beam CT

Jingsong Lin, Singanallur Venkatakrishnan, Gregery Buzzard, Amir Koushyar Ziabari, Charles Bouman

Industrial cone-beam X-ray computed tomography (CT) scans of additively manufactured components produce a 3D reconstruction from projection measurements acquired at multiple predetermined rotation angles of the component about a single axis. Typically, a large number of projections are required to achieve a high-quality reconstruction, a process that can span several hours or days depending on the part size, material composition, and desired resolution. This paper introduces a novel real-time system designed to optimize the scanning process by intelligently selecting the best next angle based on the object's geometry and computer-aided design (CAD) model. This selection process strategically balances the need for measurements aligned with the part's long edges against the need for maintaining a diverse set of overall measurements. Through simulations, we demonstrate that our algorithm significantly reduces the number of projections needed to achieve high-quality reconstructions compared to traditional methods.

Read more

7/19/2024