Automated high-resolution backscattered-electron imaging at macroscopic scale

Read original: arXiv:2407.10628 - Published 7/16/2024 by Zhiyuan Lang, Zunshuai Zhang, Lei Wang, Yuhan Liu, Weixiong Qian, Shenghua Zhou, Ying Jiang, Tongyi Zhang, Jiong Yang
Total Score

0

🔄

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • The paper proposes a novel approach for generating high-resolution scanning electron microscopy (SEM) images across multiple scales.
  • The researchers used SEM imaging on an AlCoCrFeNi2.1 eutectic high entropy alloy (EHEA) as an example.
  • They combined SEM videos and image stitching to capture physical dimensions at the centimeter level while preserving submicron-level details.
  • The video-extracted low-definition (LD) images were then clarified using a well-trained denoising model.
  • The researchers segmented the macroscopic image of the EHEA and distinguished the areas of various microstructures.
  • They found that the hardness of the EHEA is positively correlated with the content of the body-centered cubic (BCC) phase and negatively correlated with the lamella width.

Plain English Explanation

Scanning electron microscopy (SEM) is a powerful tool used in materials science to study the detailed structure of materials. However, at high magnification, the limited imaging range of SEM cannot capture the full range of microstructures present in a material. To address this, the researchers developed a new approach that combines SEM videos and image stitching to create a single, high-resolution image that can show both large-scale and small-scale features.

They applied this method to study an AlCoCrFeNi2.1 eutectic high entropy alloy (EHEA). First, they used SEM to capture video footage of the EHEA sample. They then stitched together the individual frames from the video to create a large, high-resolution image. To improve the quality of the LD images extracted from the video, they used a machine learning model to denoise and enhance them.

Next, the researchers segmented the macroscopic image of the EHEA, identifying the different microstructural features present. By combining this segmentation data with hardness measurements, they were able to determine how the different microstructures are related to the material's mechanical properties. For example, they found that the hardness is positively correlated with the amount of a specific crystal structure (BCC phase) and negatively correlated with the width of the lamellar structures.

This approach provides a way to generate high-quality, large-scale images from SEM data, which can then be used to study the relationships between a material's microstructure and its overall properties. The researchers believe this method can be widely applied to other types of microscopy as well.

Technical Explanation

The researchers proposed a novel approach to generate high-resolution SEM images across multiple scales, enabling a single image to capture physical dimensions at the centimeter level while preserving submicron-level details. They adopted the SEM imaging on the AlCoCrFeNi2.1 eutectic high entropy alloy (EHEA) as an example.

The key elements of their approach are:

  1. SEM Video and Image Stitching: The researchers combined SEM video footage and image stitching techniques to create large, high-resolution images from the individual video frames.

  2. Denoising LD Images: The low-definition (LD) images extracted from the SEM video were clarified using a well-trained denoising model to improve their quality.

  3. Microstructure Segmentation: The researchers segmented the macroscopic image of the EHEA and distinguished the areas of various microstructures, such as the body-centered cubic (BCC) phase and lamellar structures.

  4. Correlating Microstructure and Hardness: By combining the segmentation results and hardness experiments, the researchers found that the hardness of the EHEA is positively correlated with the content of the BCC phase, negatively correlated with the lamella width, and not significantly related to the proportion of lamellar structures.

This approach enables the generation of macroscopic images based on SEM data, which can then be used to analyze the relationships between the microstructures and their spatial distribution within the material. The researchers believe this method can be widely applied to other types of microscopy, such as confocal structured illumination microscopy.

Critical Analysis

The researchers have presented a promising approach for generating high-resolution SEM images across multiple scales, which can provide valuable insights into the relationships between a material's microstructure and its overall properties. However, there are a few potential limitations and areas for further research that could be considered:

  1. Validation on a Wider Range of Materials: The researchers used an EHEA as their example material. It would be interesting to see how well this approach performs on a more diverse set of materials, including those with different microstructural features and properties.

  2. Quantitative Evaluation of Denoising Performance: While the researchers mentioned that they used a well-trained denoising model, they did not provide a quantitative evaluation of its performance. It would be helpful to see metrics such as peak signal-to-noise ratio (PSNR) or structural similarity index (SSIM) to assess the quality of the denoised images.

  3. Exploration of Alternative Segmentation Techniques: The researchers used a segmentation approach to distinguish the various microstructural features. It may be worth investigating other segmentation algorithms, such as those based on deep learning, to see if they can provide more accurate and robust results.

  4. Integration with Automated Workflows: The researchers' approach could potentially be integrated with automated experimental workflows or high-performance computing (HPC) systems to streamline the data acquisition, processing, and analysis pipeline.

Overall, the researchers have presented a valuable contribution to the field of materials science, and their work opens up interesting avenues for further research and development.

Conclusion

The researchers have proposed a novel approach for generating high-resolution SEM images across multiple scales, which can capture both large-scale and small-scale features in a single image. By combining SEM video, image stitching, and machine learning-based denoising, they were able to create macroscopic images of a eutectic high entropy alloy (EHEA) that preserved submicron-level details.

Through segmentation and hardness experiments, the researchers found that the hardness of the EHEA is positively correlated with the content of the body-centered cubic (BCC) phase and negatively correlated with the lamella width. This demonstrates the potential of their approach to uncover the relationships between a material's microstructure and its overall properties.

The researchers believe that their method can be widely applied to other types of microscopy, potentially enabling new avenues of research and discovery in materials science and beyond. By providing a feasible solution for generating high-quality, large-scale images from SEM data, this work could have a significant impact on the field.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

🔄

Total Score

0

Automated high-resolution backscattered-electron imaging at macroscopic scale

Zhiyuan Lang, Zunshuai Zhang, Lei Wang, Yuhan Liu, Weixiong Qian, Shenghua Zhou, Ying Jiang, Tongyi Zhang, Jiong Yang

Scanning electron microscopy (SEM) has been widely utilized in the field of materials science due to its significant advantages, such as large depth of field, wide field of view, and excellent stereoscopic imaging. However, at high magnification, the limited imaging range in SEM cannot cover all the possible inhomogeneous microstructures. In this research, we propose a novel approach for generating high-resolution SEM images across multiple scales, enabling a single image to capture physical dimensions at the centimeter level while preserving submicron-level details. We adopted the SEM imaging on the AlCoCrFeNi2.1 eutectic high entropy alloy (EHEA) as an example. SEM videos and image stitching are combined to fulfill this goal, and the video-extracted low-definition (LD) images are clarified by a well-trained denoising model. Furthermore, we segment the macroscopic image of the EHEA, and area of various microstructures are distinguished. Combining the segmentation results and hardness experiments, we found that the hardness is positively correlated with the content of body-centered cubic (BCC) phase, negatively correlated with the lamella width, and the relationship with the proportion of lamellar structures was not significant. Our work provides a feasible solution to generate macroscopic images based on SEMs for further analysis of the correlations between the microstructures and spatial distribution, and can be widely applied to other types of microscope.

Read more

7/16/2024

🖼️

Total Score

0

Three-dimensional Microstructural Image Synthesis from 2D Backscattered Electron Image of Cement Paste

Xin Zhao, Lin Wang, Qinfei Li, Heng Chen, Shuangrong Liu, Pengkun Hou, Xu Wu, Jianfeng Yuan, Haozhong Gao, Bo Yang

This paper proposes a deep learning-based method for generating 3D microstructures from a single two-dimensional (2D) image, capable of producing high-quality, realistic 3D images at low cost. In the method, a framework (CEM3DMG) is designed to synthesize 3D images by learning microstructural information from a 2D backscattered electron (BSE) image. Experimental results show that CEM3DMG can generate realistic 3D images of arbitrary size with a resolution of 0.47 $mu m$ per pixel. Visual observation confirms that the generated 3D images exhibit similar microstructural features to the 2D images, including pores and particles morphology. Furthermore, quantitative analysis reveals that these 3D microstructures closely match the real 2D microstructure in terms of gray level histogram, phase proportions, and pore size distribution.

Read more

7/12/2024

🖼️

Total Score

0

Enhancing digital core image resolution using optimal upscaling algorithm: with application to paired SEM images

Shaohua You, Shuqi Sun, Zhengting Yan, Qinzhuo Liao, Huiying Tang, Lianhe Sun, Gensheng Li

The porous media community extensively utilizes digital rock images for core analysis. High-resolution digital rock images that possess sufficient quality are essential but often challenging to acquire. Super-resolution (SR) approaches enhance the resolution of digital rock images and provide improved visualization of fine features and structures, aiding in the analysis and interpretation of rock properties, such as pore connectivity and mineral distribution. However, there is a current shortage of real paired microscopic images for super-resolution training. In this study, we used two types of Scanning Electron Microscopes (SEM) to obtain the images of shale samples in five regions, with 1X, 2X, 4X, 8X and 16X magnifications. We used these real scanned paired images as a reference to select the optimal method of image generation and validated it using Enhanced Deep Super Resolution (EDSR) and Very Deep Super Resolution (VDSR) methods. Our experiments show that the bilinear algorithm is more suitable than the commonly used bicubic method, for establishing low-resolution datasets in the SR approaches, which is partially attributed to the mechanism of Scanning Electron Microscopes (SEM).

Read more

9/6/2024

Electron Microscopy-based Automatic Defect Inspection for Semiconductor Manufacturing: A Systematic Review
Total Score

0

Electron Microscopy-based Automatic Defect Inspection for Semiconductor Manufacturing: A Systematic Review

Enrique Dehaerne, Bappaditya Dey, Victor Blanco, Jesse Davis

In this review, automatic defect inspection algorithms that analyze Electron Microscope (EM) images of Semiconductor Manufacturing (SM) products are identified, categorized, and discussed. This is a topic of critical importance for the SM industry as the continuous shrinking of device patterns has led to increasing defectivity and a greater prevalence of higher-resolution imaging tools such as EM. These aspects among others threaten to increase costs as a result of increased inspection time-to-solution and decreased yield, respectively. Relevant research papers were systematically identified in four popular publication databases in January 2024. A total of 103 papers were selected after screening for novel contributions relating to automatic EM image analysis algorithms for semiconductor defect inspection. These papers were then categorized based on the inspection tasks they addressed, their evaluation metrics, and the type of algorithms used. A notable finding from this categorization is that reference-based defect detection algorithms were the most popular algorithm type until 2020 when deep learning-based inspection algorithms became more popular, especially for defect classification. Furthermore, four broader research questions were discussed to come to the following conclusions: (i) the key components of inspection algorithms are set up, pre-processing, feature extraction, and final prediction; (ii) the maturity of the manufacturing process affects the data availability and required sensitivity of inspection algorithms; (iii) key challenges for these algorithms relate to the desiderata of minimizing time-to-solution which pushes for high imaging throughput, reducing manual input during algorithm setup, and higher processing throughput; and (iv) three promising directions for future work are suggested based on gaps in the reviewed literature that address key remaining limitations.

Read more

9/12/2024