Long working distance portable smartphone microscopy for metallic mesh defect detection
0
Sign in to get full access
Overview
- Developed a portable smartphone-based microscope system for detecting defects in metallic meshes
- Utilized long working distance to enable imaging of large samples without direct contact
- Employed machine learning algorithms for automated defect detection and classification
Plain English Explanation
The researchers developed a smartphone-based microscope system that can be used to detect defects in metallic meshes. Metallic meshes are used in a variety of applications, such as electromagnetic shielding and semiconductor manufacturing, and it's important to be able to quickly and accurately identify any defects.
The key innovation of this system is the use of a long working distance, which means the sample doesn't need to be in direct contact with the microscope. This allows the system to be used to image large samples, like a entire sheet of a metallic mesh, without having to move the sample around. The researchers also incorporated machine learning algorithms to automate the process of detecting and classifying defects in the images, making the system more efficient and scalable.
Technical Explanation
The researchers developed a portable smartphone-based microscope system with a long working distance to enable the imaging of large metallic mesh samples without direct contact. The system uses a custom-designed lens attachment that can be clipped onto a smartphone camera, allowing for high-magnification imaging.
To detect and classify defects in the metallic meshes, the researchers trained a deep learning model on a dataset of images with known defects. The model was able to automatically identify and categorize different types of defects, such as breaks, shorts, and missing wires, in the captured microscope images.
The long working distance of the microscope, typically around 20-30 cm, allows for the imaging of large samples without the need to move or reposition them. This is a key advantage over traditional microscopes, which often require direct contact with the sample or the use of complex sample stages.
Critical Analysis
The researchers acknowledge that the performance of the defect detection model may be limited by the quality and diversity of the training data. They suggest that further research is needed to explore the use of data augmentation techniques and the incorporation of additional features, such as texture or shape information, to improve the model's accuracy.
Additionally, the researchers note that the current system is limited to imaging metallic meshes and may not be suitable for other types of samples or materials. Exploring the applicability of the system to a wider range of materials and applications could be an area for future investigation.
Conclusion
The portable smartphone-based microscope system developed by the researchers offers a promising solution for the automated detection and classification of defects in metallic meshes. The long working distance and integration of machine learning algorithms make the system a practical and scalable tool for quality control and inspection in various industries, such as electromagnetic shielding and semiconductor manufacturing. Further research to expand the system's capabilities and versatility could significantly contribute to the field of high-throughput, non-destructive defect inspection.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
0
Long working distance portable smartphone microscopy for metallic mesh defect detection
Zhengang Lu, Hongsheng Qin, Jing Li, Ming Sun, Jiubin Tan
Metallic mesh is a transparent electromagnetic shielding film with a fine metal line structure. However, it can develop defects that affect the optoelectronic performance whether in the production preparation or in actual use. The development of in-situ non-destructive testing (NDT) devices for metallic mesh requires long working distances, reflective optical path design, and miniaturization. To address the limitations of existing smartphone microscopes, which feature short working distances and inadequate transmission imaging for industrial in-situ inspection, we propose a novel long-working distance reflective smartphone microscopy system (LD-RSM). LD-RSM builds a 4f optical imaging system with external optical components and a smartphone, utilizing a beam splitter to achieve reflective imaging with the illumination system and imaging system on the same side of the sample. It achieves an optical resolution of 4.92$mu$m and a working distance of up to 22.23 mm. Additionally, we introduce a dual prior weighted Robust Principal Component Analysis (DW-RPCA) for defect detection. This approach leverages spectral filter fusion and Hough transform to model different defect types, enhancing the accuracy and efficiency of defect identification. Coupled with an optimized threshold segmentation algorithm, DW-RPCA method achieves a pixel-level accuracy of 84.8%. Our work showcases strong potential for growth in the field of in-situ on-line inspection of industrial products.
Read more8/14/2024
0
Electron Microscopy-based Automatic Defect Inspection for Semiconductor Manufacturing: A Systematic Review
Enrique Dehaerne, Bappaditya Dey, Victor Blanco, Jesse Davis
In this review, automatic defect inspection algorithms that analyze Electron Microscope (EM) images of Semiconductor Manufacturing (SM) products are identified, categorized, and discussed. This is a topic of critical importance for the SM industry as the continuous shrinking of device patterns has led to increasing defectivity and a greater prevalence of higher-resolution imaging tools such as EM. These aspects among others threaten to increase costs as a result of increased inspection time-to-solution and decreased yield, respectively. Relevant research papers were systematically identified in four popular publication databases in January 2024. A total of 103 papers were selected after screening for novel contributions relating to automatic EM image analysis algorithms for semiconductor defect inspection. These papers were then categorized based on the inspection tasks they addressed, their evaluation metrics, and the type of algorithms used. A notable finding from this categorization is that reference-based defect detection algorithms were the most popular algorithm type until 2020 when deep learning-based inspection algorithms became more popular, especially for defect classification. Furthermore, four broader research questions were discussed to come to the following conclusions: (i) the key components of inspection algorithms are set up, pre-processing, feature extraction, and final prediction; (ii) the maturity of the manufacturing process affects the data availability and required sensitivity of inspection algorithms; (iii) key challenges for these algorithms relate to the desiderata of minimizing time-to-solution which pushes for high imaging throughput, reducing manual input during algorithm setup, and higher processing throughput; and (iv) three promising directions for future work are suggested based on gaps in the reviewed literature that address key remaining limitations.
Read more9/12/2024
0
Deep-learning-driven end-to-end metalens imaging
Joonhyuk Seo, Jaegang Jo, Joohoon Kim, Joonho Kang, Chanik Kang, Seongwon Moon, Eunji Lee, Jehyeong Hong, Junsuk Rho, Haejun Chung
Recent advances in metasurface lenses (metalenses) have shown great potential for opening a new era in compact imaging, photography, light detection and ranging (LiDAR), and virtual reality/augmented reality (VR/AR) applications. However, the fundamental trade-off between broadband focusing efficiency and operating bandwidth limits the performance of broadband metalenses, resulting in chromatic aberration, angular aberration, and a relatively low efficiency. In this study, a deep-learning-based image restoration framework is proposed to overcome these limitations and realize end-to-end metalens imaging, thereby achieving aberration-free full-color imaging for mass-produced metalenses with 10-mm diameter. Neural-network-assisted metalens imaging achieved a high resolution comparable to that of the ground truth image.
Read more5/13/2024
0
Irregularity Inspection using Neural Radiance Field
Tianqi Ding, Dawei Xiang
With the increasing growth of industrialization, more and more industries are relying on machine automation for production. However, defect detection in large-scale production machinery is becoming increasingly important. Due to their large size and height, it is often challenging for professionals to conduct defect inspections on such large machinery. For example, the inspection of aging and misalignment of components on tall machinery like towers requires companies to assign dedicated personnel. Employees need to climb the towers and either visually inspect or take photos to detect safety hazards in these large machines. Direct visual inspection is limited by its low level of automation, lack of precision, and safety concerns associated with personnel climbing the towers. Therefore, in this paper, we propose a system based on neural network modeling (NeRF) of 3D twin models. By comparing two digital models, this system enables defect detection at the 3D interface of an object.
Read more8/22/2024