A high-performance reconstruction method for partially coherent ptychography
2406.06640
0
0
↗️
Abstract
Ptychography is now integrated as a tool in mainstream microscopy allowing quantitative and high-resolution imaging capabilities over a wide field of view. However, its ultimate performance is inevitably limited by the available coherent flux when implemented using electrons or laboratory X-ray sources. We present a universal reconstruction algorithm with high tolerance to low coherence for both far-field and near-field ptychography. The approach is practical for partial temporal and spatial coherence and requires no prior knowledge of the source properties. Our initial visible-light and electron data show that the method can dramatically improve the reconstruction quality and accelerate the convergence rate of the reconstruction. The approach also integrates well into existing ptychographic engines. It can also improve mixed-state and numerical monochromatisation methods, requiring a smaller number of coherent modes or lower dimensionality of Krylov subspace while providing more stable and faster convergence. We propose that this approach could have significant impact on ptychography of weakly scattering samples.
Create account to get full access
Overview
- Ptychography is a powerful microscopy technique that allows for high-resolution, quantitative imaging over a wide field of view.
- However, its performance is limited by the available coherent flux when using electrons or laboratory X-ray sources.
- The paper presents a "universal reconstruction algorithm" that can work with low coherence for both far-field and near-field ptychography.
- The approach can improve reconstruction quality and convergence rate, and integrate well with existing ptychographic engines.
- It can also enhance mixed-state and numerical monochromatization methods, requiring fewer coherent modes or lower dimensionality of the Krylov subspace.
- The authors suggest this approach could significantly impact ptychography of weakly scattering samples.
Plain English Explanation
Ptychography is a type of microscopy that can create high-quality, detailed images over a wide area. Predicting Ptychography Probe Positions Using Single-Shot and Coordinate-Based Neural Representations for Computational Adaptive Optics are examples of related research in this field.
However, the performance of ptychography is limited by the amount of coherent (or focused) light or electrons that are available. The paper presents a new algorithm that can work well even when the light or electrons are not perfectly coherent. This "universal reconstruction algorithm" can be used for both far-field and near-field ptychography.
The new algorithm can significantly improve the quality of the reconstructed images and speed up the reconstruction process. It also integrates well with existing ptychography systems. Additionally, it can enhance other related techniques, like mixed-state and numerical monochromatization, by requiring fewer components or a simpler setup while still providing stable and fast results.
The authors believe this approach could be very useful for studying samples that don't scatter light or electrons very strongly, which is an important application of ptychography.
Technical Explanation
The paper introduces a "universal reconstruction algorithm" that can handle low levels of spatial and temporal coherence in both far-field and near-field ptychography. Wide-Field High-Resolution Reconstruction for Computational Multi-Plane Phase Imaging and Single-Exposure Quantitative Phase Imaging with a Conventional Microscope are other relevant works in this area.
The key aspects of the algorithm are:
- It does not require any prior knowledge about the properties of the light or electron source, making it practical for real-world applications.
- It can dramatically improve the reconstruction quality and convergence rate compared to existing methods.
- It integrates well with existing ptychographic engines and can be easily adopted.
- It can also enhance mixed-state and numerical monochromatization techniques, allowing for fewer coherent modes or a lower dimensionality of the Krylov subspace while providing more stable and faster convergence.
The authors demonstrate the effectiveness of their approach using both visible-light and electron ptychography data. They show that the new algorithm can produce high-quality reconstructions even with low levels of coherence, which is a significant limitation of conventional ptychography methods.
Critical Analysis
The paper presents a robust and practical solution to a key challenge in ptychography - dealing with low coherence in the illumination source. The authors' universal reconstruction algorithm seems to address this issue effectively, as demonstrated by the improved reconstruction quality and convergence rate.
One potential limitation mentioned in the paper is the impact on weakly scattering samples, which are an important application area for ptychography. The authors suggest their approach could have a "significant impact" in this domain, but more research may be needed to fully understand its capabilities and limitations for such samples.
Additionally, the paper does not provide a detailed comparison to other state-of-the-art approaches for handling low coherence in ptychography. Align-Free Multi-Plane Phase Retrieval is another relevant work in this area that could be considered.
Overall, the research presented in this paper appears to be a valuable contribution to the field of ptychography, providing a practical and effective solution to a longstanding challenge. Further investigation into its performance and applicability across a broader range of samples and use cases would be a logical next step.
Conclusion
The paper introduces a universal reconstruction algorithm for ptychography that can effectively handle low levels of spatial and temporal coherence in both far-field and near-field implementations. This approach can dramatically improve the reconstruction quality and convergence rate compared to existing methods, while also integrating well with existing ptychographic engines.
The authors suggest this algorithm could have a significant impact on ptychography of weakly scattering samples, which are an important application area for this technique. Additionally, the algorithm can enhance related methods like mixed-state and numerical monochromatization, requiring fewer resources while providing more stable and faster convergence.
Overall, this research represents an important advancement in the field of ptychography, addressing a key limitation and expanding the technique's practical capabilities. The universal and coherence-tolerant nature of the algorithm could make ptychography more accessible and impactful across a wider range of scientific and industrial applications.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
Predicting ptychography probe positions using single-shot phase retrieval neural network
Ming Du, Tao Zhou, Junjing Deng, Daniel J. Ching, Steven Henke, Mathew J. Cherukara
0
0
Ptychography is a powerful imaging technique that is used in a variety of fields, including materials science, biology, and nanotechnology. However, the accuracy of the reconstructed ptychography image is highly dependent on the accuracy of the recorded probe positions which often contain errors. These errors are typically corrected jointly with phase retrieval through numerical optimization approaches. When the error accumulates along the scan path or when the error magnitude is large, these approaches may not converge with satisfactory result. We propose a fundamentally new approach for ptychography probe position prediction for data with large position errors, where a neural network is used to make single-shot phase retrieval on individual diffraction patterns, yielding the object image at each scan point. The pairwise offsets among these images are then found using a robust image registration method, and the results are combined to yield the complete scan path by constructing and solving a linear equation. We show that our method can achieve good position prediction accuracy for data with large and accumulating errors on the order of $10^2$ pixels, a magnitude that often makes optimization-based algorithms fail to converge. For ptychography instruments without sophisticated position control equipment such as interferometers, our method is of significant practical potential.
6/3/2024
🧠
Coordinate-based neural representations for computational adaptive optics in widefield microscopy
Iksung Kang, Qinrong Zhang, Stella X. Yu, Na Ji
0
0
Widefield microscopy is widely used for non-invasive imaging of biological structures at subcellular resolution. When applied to complex specimen, its image quality is degraded by sample-induced optical aberration. Adaptive optics can correct wavefront distortion and restore diffraction-limited resolution but require wavefront sensing and corrective devices, increasing system complexity and cost. Here, we describe a self-supervised machine learning algorithm, CoCoA, that performs joint wavefront estimation and three-dimensional structural information extraction from a single input 3D image stack without the need for external training dataset. We implemented CoCoA for widefield imaging of mouse brain tissues and validated its performance with direct-wavefront-sensing-based adaptive optics. Importantly, we systematically explored and quantitatively characterized the limiting factors of CoCoA's performance. Using CoCoA, we demonstrated the first in vivo widefield mouse brain imaging using machine-learning-based adaptive optics. Incorporating coordinate-based neural representations and a forward physics model, the self-supervised scheme of CoCoA should be applicable to microscopy modalities in general.
6/26/2024
Wide-Field, High-Resolution Reconstruction in Computational Multi-Aperture Miniscope Using a Fourier Neural Network
Qianwan Yang, Ruipeng Guo, Guorong Hu, Yujia Xue, Yunzhe Li, Lei Tian
0
0
Traditional fluorescence microscopy is constrained by inherent trade-offs among resolution, field-of-view, and system complexity. To navigate these challenges, we introduce a simple and low-cost computational multi-aperture miniature microscope, utilizing a microlens array for single-shot wide-field, high-resolution imaging. Addressing the challenges posed by extensive view multiplexing and non-local, shift-variant aberrations in this device, we present SV-FourierNet, a novel multi-channel Fourier neural network. SV-FourierNet facilitates high-resolution image reconstruction across the entire imaging field through its learned global receptive field. We establish a close relationship between the physical spatially-varying point-spread functions and the network's learned effective receptive field. This ensures that SV-FourierNet has effectively encapsulated the spatially-varying aberrations in our system, and learned a physically meaningful function for image reconstruction. Training of SV-FourierNet is conducted entirely on a physics-based simulator. We showcase wide-field, high-resolution video reconstructions on colonies of freely moving C. elegans and imaging of a mouse brain section. Our computational multi-aperture miniature microscope, augmented with SV-FourierNet, represents a major advancement in computational microscopy and may find broad applications in biomedical research and other fields requiring compact microscopy solutions.
5/31/2024
Sparse-view Signal-domain Photoacoustic Tomography Reconstruction Method Based on Neural Representation
Bowei Yao, Yi Zeng, Haizhao Dai, Qing Wu, Youshen Xiao, Fei Gao, Yuyao Zhang, Jingyi Yu, Xiran Cai
0
0
Photoacoustic tomography is a hybrid biomedical technology, which combines the advantages of acoustic and optical imaging. However, for the conventional image reconstruction method, the image quality is affected obviously by artifacts under the condition of sparse sampling. in this paper, a novel model-based sparse reconstruction method via implicit neural representation was proposed for improving the image quality reconstructed from sparse data. Specially, the initial acoustic pressure distribution was modeled as a continuous function of spatial coordinates, and parameterized by a multi-layer perceptron. The weights of multi-layer perceptron were determined by training the network in self-supervised manner. And the total variation regularization term was used to offer the prior knowledge. We compared our result with some ablation studies, and the results show that out method outperforms existing methods on simulation and experimental data. Under the sparse sampling condition, our method can suppress the artifacts and avoid the ill-posed problem effectively, which reconstruct images with higher signal-to-noise ratio and contrast-to-noise ratio than traditional methods. The high-quality results for sparse data make the proposed method hold the potential for further decreasing the hardware cost of photoacoustic tomography system.
6/26/2024