Sparse Reconstruction of Optical Doppler Tomography Based on State Space Model

Read original: arXiv:2404.17484 - Published 4/29/2024 by Zhenghong Li, Jiaxiang Ren, Wensheng Cheng, Congwu Du, Yingtian Pan, Haibin Ling
Total Score

0

šŸ“ˆ

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • Optical Doppler Tomography (ODT) is a blood flow imaging technique used in bioengineering applications.
  • ODT constructs 2D images (B-scans) from 1D frequency responses (raw A-scans) along the depth.
  • Current methods require dense A-scan sampling, leading to computational and storage challenges.
  • This paper proposes a novel sparse reconstruction framework to address these issues.

Plain English Explanation

Optical Doppler Tomography (ODT) is a technique that allows scientists to image the flow of blood in the body. It works by first collecting 1D measurements of the frequency response at different depths, called raw A-scans. These A-scans are then combined to create a 2D image, or B-scan, that shows the blood flow.

The current way of doing this requires taking a lot of A-scans very close together, which creates a lot of data to process and store. This paper proposes a new method that can reconstruct the B-scan from fewer A-scans, reducing the computational and storage demands.

The key ideas are:

  1. Fusing magnitude and phase information: The method combines the complementary information in the magnitude and phase of the A-scans to get a richer understanding of the data.
  2. Learning a state space model: The method uses a state space model to capture the sequential patterns within each A-scan and the relationships between A-scans.
  3. Using an Inception-based network: An Inception-based neural network is used to further process the state space representation and boost the reconstruction quality.
  4. Reconstructing the final B-scan: A special layer called a B-line Pixel Shuffle is used to efficiently reconstruct the final 2D B-scan image from the processed data.

This novel approach shows promising results in reconstructing accurate blood flow images from fewer measurements, which could lead to faster and more efficient ODT imaging in real-world applications.

Technical Explanation

The fundamental unit of ODT is the 1D frequency response along the depth, called a raw A-scan. A 2D ODT image, or B-scan, is obtained by first sensing raw A-scans along the width, and then constructing the B-scan from these A-scans through magnitude-phase analysis and post-processing.

To obtain a high-resolution B-scan with an accurate flow map, current methods require densely sampled A-scans, leading to significant computational and storage burdens. This paper proposes a novel sparse reconstruction framework to address these challenges, with four main sequential steps:

  1. Early magnitude-phase fusion: The method encourages rich interaction between the complementary information in the magnitude and phase of the A-scans.
  2. State Space Model (SSM)-based representation learning: Inspired by recent successes in Mamba and VMamba, the method uses an SSM to naturally capture both the intra-A-scan sequential information and the between-A-scan interactions.
  3. Inception-based Feedforward Network (IncFFN): This module further boosts the performance of the SSM-based representation.
  4. B-line Pixel Shuffle (BPS) layer: This layer effectively reconstructs the final 2D B-scan from the processed data.

In experiments on real-world animal data, the proposed method demonstrates clear effectiveness in reconstruction accuracy compared to existing approaches. As the first application of SSM for image reconstruction tasks, the authors expect this work to inspire related explorations in efficient ODT imaging and beyond.

Critical Analysis

The paper presents a promising approach to address the computational and storage challenges in current ODT imaging techniques. The proposed sparse reconstruction framework leverages state-of-the-art deep learning methods, such as state space models and Inception-based networks, to effectively reconstruct high-quality B-scans from fewer A-scans.

However, the paper does not provide a detailed analysis of the limitations or potential issues with the proposed method. For example, it would be helpful to understand the sensitivity of the method to factors like noise, signal-to-noise ratio, or variations in the underlying blood flow dynamics. Additionally, the authors could have compared their approach to alternative sparse reconstruction techniques, such as compressed sensing or dictionary learning, to better situate their contribution within the broader literature.

Despite these minor shortcomings, the paper represents an important step forward in improving the efficiency and practicality of ODT imaging. The novel application of state space models to image reconstruction tasks is particularly intriguing and could inspire further research in this direction. Readers are encouraged to critically evaluate the presented ideas and consider how they might be extended or improved upon in future work.

Conclusion

This paper introduces a novel sparse reconstruction framework for Optical Doppler Tomography (ODT), a blood flow imaging technique used in bioengineering. The proposed method addresses the computational and storage challenges of current ODT imaging approaches by leveraging a combination of deep learning techniques, including early magnitude-phase fusion, state space model-based representation learning, and an Inception-based network.

The experimental results on real-world animal data demonstrate the effectiveness of the proposed framework in reconstructing accurate B-scan images from fewer input A-scans. As the first application of state space models to image reconstruction tasks, this work is expected to inspire further research into efficient and high-quality ODT imaging, as well as potential extensions to other imaging modalities and reconstruction problems.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on š• ā†’

Related Papers

šŸ“ˆ

Total Score

0

Sparse Reconstruction of Optical Doppler Tomography Based on State Space Model

Zhenghong Li, Jiaxiang Ren, Wensheng Cheng, Congwu Du, Yingtian Pan, Haibin Ling

Optical Doppler Tomography (ODT) is a blood flow imaging technique popularly used in bioengineering applications. The fundamental unit of ODT is the 1D frequency response along the A-line (depth), named raw A-scan. A 2D ODT image (B-scan) is obtained by first sensing raw A-scans along the B-line (width), and then constructing the B-scan from these raw A-scans via magnitude-phase analysis and post-processing. To obtain a high-resolution B-scan with a precise flow map, densely sampled A-scans are required in current methods, causing both computational and storage burdens. To address this issue, in this paper we propose a novel sparse reconstruction framework with four main sequential steps: 1) early magnitude-phase fusion that encourages rich interaction of the complementary information in magnitude and phase, 2) State Space Model (SSM)-based representation learning, inspired by recent successes in Mamba and VMamba, to naturally capture both the intra-A-scan sequential information and between-A-scan interactions, 3) an Inception-based Feedforward Network module (IncFFN) to further boost the SSM-module, and 4) a B-line Pixel Shuffle (BPS) layer to effectively reconstruct the final results. In the experiments on real-world animal data, our method shows clear effectiveness in reconstruction accuracy. As the first application of SSM for image reconstruction tasks, we expect our work to inspire related explorations in not only efficient ODT imaging techniques but also generic image enhancement.

Read more

4/29/2024

OmniSSR: Zero-shot Omnidirectional Image Super-Resolution using Stable Diffusion Model
Total Score

0

OmniSSR: Zero-shot Omnidirectional Image Super-Resolution using Stable Diffusion Model

Runyi Li, Xuhan Sheng, Weiqi Li, Jian Zhang

Omnidirectional images (ODIs) are commonly used in real-world visual tasks, and high-resolution ODIs help improve the performance of related visual tasks. Most existing super-resolution methods for ODIs use end-to-end learning strategies, resulting in inferior realness of generated images and a lack of effective out-of-domain generalization capabilities in training methods. Image generation methods represented by diffusion model provide strong priors for visual tasks and have been proven to be effectively applied to image restoration tasks. Leveraging the image priors of the Stable Diffusion (SD) model, we achieve omnidirectional image super-resolution with both fidelity and realness, dubbed as OmniSSR. Firstly, we transform the equirectangular projection (ERP) images into tangent projection (TP) images, whose distribution approximates the planar image domain. Then, we use SD to iteratively sample initial high-resolution results. At each denoising iteration, we further correct and update the initial results using the proposed Octadecaplex Tangent Information Interaction (OTII) and Gradient Decomposition (GD) technique to ensure better consistency. Finally, the TP images are transformed back to obtain the final high-resolution results. Our method is zero-shot, requiring no training or fine-tuning. Experiments of our method on two benchmark datasets demonstrate the effectiveness of our proposed method.

Read more

4/17/2024

Sparse-view Signal-domain Photoacoustic Tomography Reconstruction Method Based on Neural Representation
Total Score

0

Sparse-view Signal-domain Photoacoustic Tomography Reconstruction Method Based on Neural Representation

Bowei Yao, Yi Zeng, Haizhao Dai, Qing Wu, Youshen Xiao, Fei Gao, Yuyao Zhang, Jingyi Yu, Xiran Cai

Photoacoustic tomography is a hybrid biomedical technology, which combines the advantages of acoustic and optical imaging. However, for the conventional image reconstruction method, the image quality is affected obviously by artifacts under the condition of sparse sampling. in this paper, a novel model-based sparse reconstruction method via implicit neural representation was proposed for improving the image quality reconstructed from sparse data. Specially, the initial acoustic pressure distribution was modeled as a continuous function of spatial coordinates, and parameterized by a multi-layer perceptron. The weights of multi-layer perceptron were determined by training the network in self-supervised manner. And the total variation regularization term was used to offer the prior knowledge. We compared our result with some ablation studies, and the results show that out method outperforms existing methods on simulation and experimental data. Under the sparse sampling condition, our method can suppress the artifacts and avoid the ill-posed problem effectively, which reconstruct images with higher signal-to-noise ratio and contrast-to-noise ratio than traditional methods. The high-quality results for sparse data make the proposed method hold the potential for further decreasing the hardware cost of photoacoustic tomography system.

Read more

6/26/2024

CT-SDM: A Sampling Diffusion Model for Sparse-View CT Reconstruction across All Sampling Rates
Total Score

0

CT-SDM: A Sampling Diffusion Model for Sparse-View CT Reconstruction across All Sampling Rates

Liutao Yang, Jiahao Huang, Guang Yang, Daoqiang Zhang

Sparse views X-ray computed tomography has emerged as a contemporary technique to mitigate radiation dose. Because of the reduced number of projection views, traditional reconstruction methods can lead to severe artifacts. Recently, research studies utilizing deep learning methods has made promising progress in removing artifacts for Sparse-View Computed Tomography (SVCT). However, given the limitations on the generalization capability of deep learning models, current methods usually train models on fixed sampling rates, affecting the usability and flexibility of model deployment in real clinical settings. To address this issue, our study proposes a adaptive reconstruction method to achieve high-performance SVCT reconstruction at any sampling rate. Specifically, we design a novel imaging degradation operator in the proposed sampling diffusion model for SVCT (CT-SDM) to simulate the projection process in the sinogram domain. Thus, the CT-SDM can gradually add projection views to highly undersampled measurements to generalize the full-view sinograms. By choosing an appropriate starting point in diffusion inference, the proposed model can recover the full-view sinograms from any sampling rate with only one trained model. Experiments on several datasets have verified the effectiveness and robustness of our approach, demonstrating its superiority in reconstructing high-quality images from sparse-view CT scans across various sampling rates.

Read more

9/4/2024