Application of RESNET50 Convolution Neural Network for the Extraction of Optical Parameters in Scattering Media

Read original: arXiv:2404.16647 - Published 4/26/2024 by Bowen Deng, Yihan Zhang, Andrew Parkes, Alex Bentley, Amanda Wright, Michael Pound, Michael Somekh
Total Score

0

🧠

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • Estimating the optical properties of scattering media like tissue is important for medical diagnostics and imaging techniques.
  • Light scattering events can degrade image quality, but the distribution of scattered light can also provide information about the optical properties of the sample.
  • Inverting scattering patterns to recover optical properties is challenging, especially when the light is partially randomized.
  • The paper explores using a convolutional neural network, RESNET 50, to recover optical properties from simulated scattering data.

Plain English Explanation

Imagine you have a piece of material, like tissue, and you want to learn about its properties by shining light on it. As the light passes through, it gets scattered in random directions. This scattering can make it harder to see what's inside the material, but it also carries information about the material's optical properties, like how much the light is absorbed or scattered.

The researchers in this paper trained a type of artificial intelligence called a neural network to analyze the scattered light and figure out the optical properties of the material. They used computer simulations to generate lots of examples of how light would scatter in different materials, and then trained the neural network to recognize patterns in the scattering and predict the optical properties.

The key advantage of this approach is that it can work even when the light is heavily scattered and partially randomized, which makes it hard to use traditional methods. The researchers showed that their neural network could estimate the optical properties fairly accurately, using less training data than previous methods.

Technical Explanation

The paper presents a convolutional neural network approach, using a RESNET 50 architecture, to recover optical properties such as the reduced scattering coefficient and absorption coefficient from simulated scattering data.

The authors trained the neural network on a dataset of simulated scattering patterns generated using Monte Carlo simulations. They explored different input modalities, including the intensity distribution at multiple planes, the exit angle and spatial distribution, and combinations thereof. The results show that using multiple input modalities can improve the reconstruction accuracy compared to training on a single input.

Importantly, the authors were able to achieve comparable or better reconstruction accuracy than previous work, while using a much smaller training dataset. This suggests the neural network was able to learn the underlying relationships between the scattering patterns and the optical properties effectively.

However, the authors also identify limitations in their approach, particularly in accurately recovering the absorption coefficient. They discuss potential ways to enhance the method, such as incorporating more physical constraints or using more sophisticated network architectures like U-Net or Direct Zernike Coefficient Prediction.

Critical Analysis

The paper presents a promising approach for recovering optical properties from scattering data using deep learning, with some important caveats. The ability to achieve good reconstruction accuracy with a smaller dataset is a significant advantage, as collecting large, high-quality experimental scattering data can be challenging.

However, the authors acknowledge that accurately estimating the absorption coefficient remains an issue, which is an important limitation given the relevance of both scattering and absorption properties in many applications. They suggest incorporating more physical constraints or using more advanced network architectures as potential avenues for improvement.

Additionally, while the simulated data used for training may capture many relevant aspects of light scattering, there are always questions about how well such simulations reflect real-world conditions. Validating the approach on experimental data would be an important next step to ensure the method's practical applicability.

Overall, the research presents an interesting application of deep learning to a challenging problem in optics and medical imaging. The insights and limitations discussed provide a useful foundation for further developments in this area, which could have significant impacts on techniques for deeper tissue imaging and other diagnostic applications.

Conclusion

This paper explores the use of a convolutional neural network, specifically a RESNET 50 architecture, to estimate the optical properties of scattering media from simulated light scattering data. The results demonstrate that this approach can achieve comparable or better reconstruction accuracy than previous methods, while using a much smaller training dataset.

The ability to recover optical properties from partially randomized scattering patterns is an important capability, as it can help advance medical diagnostics and imaging techniques that rely on light propagation in tissue. While the authors identify limitations in accurately estimating the absorption coefficient, the insights and methods presented in this work provide a valuable foundation for further research and development in this area.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

🧠

Total Score

0

Application of RESNET50 Convolution Neural Network for the Extraction of Optical Parameters in Scattering Media

Bowen Deng, Yihan Zhang, Andrew Parkes, Alex Bentley, Amanda Wright, Michael Pound, Michael Somekh

Estimation of the optical properties of scattering media such as tissue is important in diagnostics as well as in the development of techniques to image deeper. As light penetrates the sample scattering events occur that alter the propagation direction of the photons in a random manner leading degradation of image quality. The distribution of the scattered light does, however, give a measure of the optical properties such as the reduced scattering coefficient and the absorption coefficient. Unfortunately, inverting scattering patterns to recover the optical properties is not simple, especially in the regime where the light is partially randomized. Machine learning has been proposed by several authors as a means of recovering these properties from either the back scattered or the transmitted light. In the present paper, we train a general purpose convolutional neural network RESNET 50 with simulated data based on Monte Carlo simulations. We show that compared with previous work our approach gives comparable or better reconstruction accuracy with training on a much smaller dataset. Moreover, by training on multiple parameters such as the intensity distribution at multiple planes or the exit angle and spatial distribution one achieves improved performance compared to training on a single input such as the intensity distribution captured at the sample surface. While our approach gives good parameter reconstruction, we identify factors that limit the accuracy of the recovered properties, particularly the absorption coefficient. In the light of these limitations, we suggest how the present approach may be enhanced for even better performance.

Read more

4/26/2024

Solving the inverse problem of microscopy deconvolution with a residual Beylkin-Coifman-Rokhlin neural network
Total Score

0

Solving the inverse problem of microscopy deconvolution with a residual Beylkin-Coifman-Rokhlin neural network

Rui Li, Mikhail Kudryashev, Artur Yakimovich

Optic deconvolution in light microscopy (LM) refers to recovering the object details from images, revealing the ground truth of samples. Traditional explicit methods in LM rely on the point spread function (PSF) during image acquisition. Yet, these approaches often fall short due to inaccurate PSF models and noise artifacts, hampering the overall restoration quality. In this paper, we approached the optic deconvolution as an inverse problem. Motivated by the nonstandard-form compression scheme introduced by Beylkin, Coifman, and Rokhlin (BCR), we proposed an innovative physics-informed neural network Multi-Stage Residual-BCR Net (m-rBCR) to approximate the optic deconvolution. We validated the m-rBCR model on four microscopy datasets - two simulated microscopy datasets from ImageNet and BioSR, real dSTORM microscopy images, and real widefield microscopy images. In contrast to the explicit deconvolution methods (e.g. Richardson-Lucy) and other state-of-the-art NN models (U-Net, DDPM, CARE, DnCNN, ESRGAN, RCAN, Noise2Noise, MPRNet, and MIMO-U-Net), the m-rBCR model demonstrates superior performance to other candidates by PSNR and SSIM in two real microscopy datasets and the simulated BioSR dataset. In the simulated ImageNet dataset, m-rBCR ranks the second-best place (right after MIMO-U-Net). With the backbone from the optical physics, m-rBCR exploits the trainable parameters with better performances (from ~30 times fewer than the benchmark MIMO-U-Net to ~210 times than ESRGAN). This enables m-rBCR to achieve a shorter runtime (from ~3 times faster than MIMO-U-Net to ~300 times faster than DDPM). To summarize, by leveraging physics constraints our model reduced potentially redundant parameters significantly in expertise-oriented NN candidates and achieved high efficiency with superior performance.

Read more

7/16/2024

📊

Total Score

0

Quantifying the effect of X-ray scattering for data generation in real-time defect detection

Vladyslav Andriiashen, Robert van Liere, Tristan van Leeuwen, K. Joost Batenburg

Background: X-ray imaging is widely used for the non-destructive detection of defects in industrial products on a conveyor belt. In-line detection requires highly accurate, robust, and fast algorithms. Deep Convolutional Neural Networks (DCNNs) satisfy these requirements when a large amount of labeled data is available. To overcome the challenge of collecting these data, different methods of X-ray image generation are considered. Objective: Depending on the desired degree of similarity to real data, different physical effects should either be simulated or can be ignored. X-ray scattering is known to be computationally expensive to simulate, and this effect can greatly affect the accuracy of a generated X-ray image. We aim to quantitatively evaluate the effect of scattering on defect detection. Methods: Monte-Carlo simulation is used to generate X-ray scattering distribution. DCNNs are trained on the data with and without scattering and applied to the same test datasets. Probability of Detection (POD) curves are computed to compare their performance, characterized by the size of the smallest detectable defect. Results: We apply the methodology to a model problem of defect detection in cylinders. When trained on data without scattering, DCNNs reliably detect defects larger than 1.3 mm, and using data with scattering improves performance by less than 5%. If the analysis is performed on the cases with large scattering-to-primary ratio ($1 < SPR < 5$), the difference in performance could reach 15% (approx. 0.4 mm). Conclusion: Excluding the scattering signal from the training data has the largest effect on the smallest detectable defects, and the difference decreases for larger defects. The scattering-to-primary ratio has a significant effect on detection performance and the required accuracy of data generation.

Read more

8/22/2024

👨‍🏫

Total Score

0

Scattering-induced entropy boost for highly-compressed optical sensing and encryption

Xinrui Zhan, Xuyang Chang, Daoyu Li, Rong Yan, Yinuo Zhang, Liheng Bian

Image sensing often relies on a high-quality machine vision system with a large field of view and high resolution. It requires fine imaging optics, has high computational costs, and requires a large communication bandwidth between image sensors and computing units. In this paper, we propose a novel image-free sensing framework for resource-efficient image classification, where the required number of measurements can be reduced by up to two orders of magnitude. In the proposed framework for single-pixel detection, the optical field for a target is first scattered by an optical diffuser and then two-dimensionally modulated by a spatial light modulator. The optical diffuser simultaneously serves as a compressor and an encryptor for the target information, effectively narrowing the field of view and improving the system's security. The one-dimensional sequence of intensity values, which is measured with time-varying patterns on the spatial light modulator, is then used to extract semantic information based on end-to-end deep learning. The proposed sensing framework is shown to obtain over a 95% accuracy at sampling rates of 1% and 5% for classification on the MNIST dataset and the recognition of Chinese license plates, respectively, and the framework is up to 24% more efficient than the approach without an optical diffuser. The proposed framework represents a significant breakthrough in high-throughput machine intelligence for scene analysis with low bandwidth, low costs, and strong encryption.

Read more

9/9/2024