Deep Learning for Melt Pool Depth Contour Prediction From Surface Thermal Images via Vision Transformers

Read original: arXiv:2404.17699 - Published 5/21/2024 by Francis Ogoke, Peter Myung-Won Pak, Alexander Myers, Guadalupe Quirarte, Jack Beuth, Jonathan Malen, Amir Barati Farimani
Total Score

0

Deep Learning for Melt Pool Depth Contour Prediction From Surface Thermal Images via Vision Transformers

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • Researchers developed a deep learning model to accurately predict the melt pool depth contour from surface thermal images during metal additive manufacturing.
  • The model uses a Vision Transformer architecture to capture the complex spatial relationships in the thermal data.
  • The researchers validated the model's performance on experimental data and simulations, showcasing its ability to outperform traditional approaches.

Plain English Explanation

In metal 3D printing, the melt pool is the molten area created by the laser or electron beam as it interacts with the metal powder. Accurately predicting the shape and depth of the melt pool is crucial for controlling the quality of the final printed part.

The researchers in this paper tackled this challenge by developing a deep learning model that can analyze the thermal images of the 3D printing process and predict the contours, or outlines, of the melt pool depth. This is important because the melt pool depth is directly related to the porosity and defects in the final printed part.

The key innovation of this work is the use of a Vision Transformer, which is a deep learning architecture that is especially good at capturing the complex spatial relationships in visual data, like thermal images. This allowed the model to better understand the patterns in the thermal data and make more accurate melt pool depth predictions.

The researchers validated their model's performance using both experimental data and simulations from the FLOW-3D software. They showed that their Vision Transformer-based model outperformed traditional approaches, demonstrating its potential to improve quality control in metal 3D printing.

Technical Explanation

The researchers developed a deep learning model based on the Vision Transformer architecture to predict melt pool depth contours from surface thermal images during metal additive manufacturing. The Vision Transformer, or ViT, is a deep learning model that uses self-attention mechanisms to effectively capture the complex spatial relationships in visual data, making it well-suited for this task.

The researchers trained and evaluated their ViT-based model using a combination of experimental data and simulations. The experimental data consisted of thermal images and corresponding melt pool depth measurements collected during the metal 3D printing process. The simulation data was generated using the FLOW-3D computational fluid dynamics software, which allowed them to create a larger and more diverse dataset.

The ViT-based model outperformed traditional convolutional neural network (CNN) approaches in predicting melt pool depth contours, highlighting the advantages of the self-attention mechanism for capturing the complex spatial relationships in the thermal data. The researchers also demonstrated the model's robustness by evaluating its performance on different materials and process parameters.

Critical Analysis

The researchers thoroughly validated their ViT-based model on both experimental and simulated data, providing a comprehensive evaluation of its performance. However, the paper does not address the potential computational complexity or inference time of the ViT architecture, which could be an important consideration for real-time process monitoring and control in industrial settings.

Additionally, the paper does not discuss the model's ability to generalize to new, unseen materials or process conditions. It would be beneficial to see how the model performs on a broader range of materials and process parameters, as this would better reflect the diversity of real-world metal additive manufacturing applications.

Furthermore, the paper does not provide any insights into the specific thermal image features that the ViT model is leveraging to make its predictions. Understanding these critical features could lead to further improvements in the model's architecture and training, as well as provide valuable insights into the underlying physics of the melt pool formation process.

Conclusion

This research demonstrates the potential of deep learning, and specifically Vision Transformers, for accurately predicting melt pool depth contours from surface thermal images in metal additive manufacturing. By capturing the complex spatial relationships in the thermal data, the ViT-based model outperformed traditional CNN approaches, showcasing its ability to improve quality control and process monitoring in this important industrial application.

While the study provides a robust evaluation of the model's performance, further research is needed to address its computational efficiency, generalization capabilities, and interpretability. Nonetheless, this work represents a significant step forward in leveraging advanced deep learning techniques to enhance the understanding and control of metal 3D printing processes.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

Deep Learning for Melt Pool Depth Contour Prediction From Surface Thermal Images via Vision Transformers
Total Score

0

Deep Learning for Melt Pool Depth Contour Prediction From Surface Thermal Images via Vision Transformers

Francis Ogoke, Peter Myung-Won Pak, Alexander Myers, Guadalupe Quirarte, Jack Beuth, Jonathan Malen, Amir Barati Farimani

Insufficient overlap between the melt pools produced during Laser Powder Bed Fusion (L-PBF) can lead to lack-of-fusion defects and deteriorated mechanical and fatigue performance. In-situ monitoring of the melt pool subsurface morphology requires specialized equipment that may not be readily accessible or scalable. Therefore, we introduce a machine learning framework to correlate in-situ two-color thermal images observed via high-speed color imaging to the two-dimensional profile of the melt pool cross-section. Specifically, we employ a hybrid CNN-Transformer architecture to establish a correlation between single bead off-axis thermal image sequences and melt pool cross-section contours measured via optical microscopy. In this architecture, a ResNet model embeds the spatial information contained within the thermal images to a latent vector, while a Transformer model correlates the sequence of embedded vectors to extract temporal information. Our framework is able to model the curvature of the subsurface melt pool structure, with improved performance in high energy density regimes compared to analytical melt pool models. The performance of this model is evaluated through dimensional and geometric comparisons to the corresponding experimental melt pool observations.

Read more

5/21/2024

Binocular Model: A deep learning solution for online melt pool temperature analysis using dual-wavelength Imaging Pyrometry
Total Score

0

Binocular Model: A deep learning solution for online melt pool temperature analysis using dual-wavelength Imaging Pyrometry

Javid Akhavan, Chaitanya Krishna Vallabh, Xiayun Zhao, Souran Manoochehri

In metal Additive Manufacturing (AM), monitoring the temperature of the Melt Pool (MP) is crucial for ensuring part quality, process stability, defect prevention, and overall process optimization. Traditional methods, are slow to converge and require extensive manual effort to translate data into actionable insights, rendering them impractical for real-time monitoring and control. To address this challenge, we propose an Artificial Intelligence (AI)-based solution aimed at reducing manual data processing reliance and improving the efficiency of transitioning from data to insight. In our study, we utilize a dataset comprising dual-wavelength real-time process monitoring data and corresponding temperature maps. We introduce a deep learning model called the Binocular model, which exploits dual input observations to perform a precise analysis of MP temperature in Laser Powder Bed Fusion (L-PBF). Through advanced deep learning techniques, we seamlessly convert raw data into temperature maps, significantly streamlining the process and enabling batch processing at a rate of up to 750 frames per second, approximately 1000 times faster than conventional methods. Our Binocular model achieves high accuracy in temperature estimation, evidenced by a 0.95 R-squared score, while simultaneously enhancing processing efficiency by a factor of $sim1000x$ times. This model directly addresses the challenge of real-time MP temperature monitoring and offers insights into the encountered constraints and the benefits of our Deep Learning-based approach. By combining efficiency and precision, our work contributes to the advancement of temperature monitoring in L-PBF, thus driving progress in the field of metal AM.

Read more

8/27/2024

🔮

Total Score

0

Temperature Distribution Prediction in Laser Powder Bed Fusion using Transferable and Scalable Graph Neural Networks

Riddhiman Raut, Amit Kumar Ball, Amrita Basak

This study presents novel predictive models using Graph Neural Networks (GNNs) for simulating thermal dynamics in Laser Powder Bed Fusion (L-PBF) processes. By developing and validating Single-Laser GNN (SL-GNN) and Multi-Laser GNN (ML-GNN) surrogates, the research introduces a scalable data-driven approach that learns fundamental physics from small-scale Finite Element Analysis (FEA) simulations and applies them to larger domains. Achieving a Mean Absolute Percentage Error (MAPE) of 3.77% with the baseline SL-GNN model, GNNs effectively learn from high-resolution simulations and generalize well across larger geometries. The proposed models capture the complexity of the heat transfer process in L-PBF while significantly reducing computational costs. For example, a thermomechanical simulation for a 2 mm x 2 mm domain typically requires about 4 hours, whereas the SL-GNN model can predict thermal distributions almost instantly. Calibrating models to larger domains enhances predictive performance, with significant drops in MAPE for 3 mm x 3 mm and 4 mm x 4 mm domains, highlighting the scalability and efficiency of this approach. Additionally, models show a decreasing trend in Root Mean Square Error (RMSE) when tuned to larger domains, suggesting potential for becoming geometry-agnostic. The interaction of multiple lasers complicates heat transfer, necessitating larger model architectures and advanced feature engineering. Using hyperparameters from Gaussian process-based Bayesian optimization, the best ML-GNN model demonstrates a 46.4% improvement in MAPE over the baseline ML-GNN model. In summary, this approach enables more efficient and flexible predictive modeling in L-PBF additive manufacturing.

Read more

7/22/2024

🤿

Total Score

0

ThermoPore: Predicting Part Porosity Based on Thermal Images Using Deep Learning

Peter Myung-Won Pak, Francis Ogoke, Andrew Polonsky, Anthony Garland, Dan S. Bolintineanu, Dan R. Moser, Michael J. Heiden, Amir Barati Farimani

We present a deep learning approach for quantifying and localizing ex-situ porosity within Laser Powder Bed Fusion fabricated samples utilizing in-situ thermal image monitoring data. Our goal is to build the real time porosity map of parts based on thermal images acquired during the build. The quantification task builds upon the established Convolutional Neural Network model architecture to predict pore count and the localization task leverages the spatial and temporal attention mechanisms of the novel Video Vision Transformer model to indicate areas of expected porosity. Our model for porosity quantification achieved a $R^2$ score of 0.57 and our model for porosity localization produced an average IoU score of 0.32 and a maximum of 1.0. This work is setting the foundations of part porosity Digital Twins based on additive manufacturing monitoring data and can be applied downstream to reduce time-intensive post-inspection and testing activities during part qualification and certification. In addition, we seek to accelerate the acquisition of crucial insights normally only available through ex-situ part evaluation by means of machine learning analysis of in-situ process monitoring data.

Read more

4/29/2024