Binocular Model: A deep learning solution for online melt pool temperature analysis using dual-wavelength Imaging Pyrometry

Read original: arXiv:2408.11126 - Published 8/27/2024 by Javid Akhavan, Chaitanya Krishna Vallabh, Xiayun Zhao, Souran Manoochehri
Total Score

0

Binocular Model: A deep learning solution for online melt pool temperature analysis using dual-wavelength Imaging Pyrometry

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • This paper presents a deep learning solution for online melt pool temperature analysis using dual-wavelength imaging pyrometry in additive manufacturing processes.
  • The proposed "Binocular Model" uses a convolutional neural network to predict melt pool temperature from infrared camera images.
  • The model is trained and evaluated on data collected from a laser powder bed fusion (LPBF) process.

Plain English Explanation

The paper describes a new way to track the temperature of the molten metal as it is being 3D printed using a laser powder bed fusion (LPBF) process. This is an important part of monitoring and controlling the 3D printing process to ensure good part quality.

The key idea is to use two infrared cameras to take images of the molten metal (called the "melt pool") from different angles. The researchers then trained a deep learning model called the "Binocular Model" to analyze these images and predict the temperature of the melt pool. This allows them to monitor the temperature in real-time during the 3D printing process.

Technical Explanation

The "Binocular Model" proposed in this paper uses a convolutional neural network (CNN) architecture to predict melt pool temperature from dual-wavelength infrared camera images. The model takes in two infrared images of the melt pool captured from different viewpoints and outputs a temperature prediction.

To train and evaluate the model, the researchers collected data from a laser powder bed fusion (LPBF) 3D printing process. This included synchronized infrared camera footage and pyrometer measurements of the melt pool temperature. They used this data to train the Binocular Model and compare its temperature predictions to the ground truth pyrometer measurements.

The experiments demonstrated that the Binocular Model can accurately predict melt pool temperature in real-time during the 3D printing process. This provides a non-invasive way to monitor the critical melt pool temperature without disrupting the printing workflow.

Critical Analysis

The paper provides a comprehensive evaluation of the Binocular Model, including analysis of how different network architectures, training strategies, and input data configurations impact the temperature prediction performance.

However, the paper does not extensively discuss the limitations of the approach or potential avenues for future work. For example, it is unclear how the model would generalize to different 3D printing processes or materials beyond the specific LPBF setup used in the experiments.

Additionally, the paper does not address potential challenges around deploying such a system in a real-world manufacturing environment, such as calibration, robustness to environmental conditions, or integration with existing process monitoring infrastructure.

Further research would be needed to better understand the broader applicability and practical feasibility of the Binocular Model approach for online melt pool temperature analysis in additive manufacturing.

Conclusion

This paper presents a novel deep learning solution called the "Binocular Model" for real-time monitoring of melt pool temperature during laser powder bed fusion 3D printing. By leveraging dual-wavelength infrared imaging and a convolutional neural network architecture, the model can accurately predict melt pool temperature without disrupting the printing process.

The demonstrated capability to non-invasively monitor this critical process parameter in real-time has the potential to enhance process control and improve part quality in additive manufacturing. While further research is needed to assess the broader applicability of the approach, this work represents an important step forward in the use of computer vision and deep learning for advanced in-situ monitoring of 3D printing processes.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

Binocular Model: A deep learning solution for online melt pool temperature analysis using dual-wavelength Imaging Pyrometry
Total Score

0

Binocular Model: A deep learning solution for online melt pool temperature analysis using dual-wavelength Imaging Pyrometry

Javid Akhavan, Chaitanya Krishna Vallabh, Xiayun Zhao, Souran Manoochehri

In metal Additive Manufacturing (AM), monitoring the temperature of the Melt Pool (MP) is crucial for ensuring part quality, process stability, defect prevention, and overall process optimization. Traditional methods, are slow to converge and require extensive manual effort to translate data into actionable insights, rendering them impractical for real-time monitoring and control. To address this challenge, we propose an Artificial Intelligence (AI)-based solution aimed at reducing manual data processing reliance and improving the efficiency of transitioning from data to insight. In our study, we utilize a dataset comprising dual-wavelength real-time process monitoring data and corresponding temperature maps. We introduce a deep learning model called the Binocular model, which exploits dual input observations to perform a precise analysis of MP temperature in Laser Powder Bed Fusion (L-PBF). Through advanced deep learning techniques, we seamlessly convert raw data into temperature maps, significantly streamlining the process and enabling batch processing at a rate of up to 750 frames per second, approximately 1000 times faster than conventional methods. Our Binocular model achieves high accuracy in temperature estimation, evidenced by a 0.95 R-squared score, while simultaneously enhancing processing efficiency by a factor of $sim1000x$ times. This model directly addresses the challenge of real-time MP temperature monitoring and offers insights into the encountered constraints and the benefits of our Deep Learning-based approach. By combining efficiency and precision, our work contributes to the advancement of temperature monitoring in L-PBF, thus driving progress in the field of metal AM.

Read more

8/27/2024

Deep Learning for Melt Pool Depth Contour Prediction From Surface Thermal Images via Vision Transformers
Total Score

0

Deep Learning for Melt Pool Depth Contour Prediction From Surface Thermal Images via Vision Transformers

Francis Ogoke, Peter Myung-Won Pak, Alexander Myers, Guadalupe Quirarte, Jack Beuth, Jonathan Malen, Amir Barati Farimani

Insufficient overlap between the melt pools produced during Laser Powder Bed Fusion (L-PBF) can lead to lack-of-fusion defects and deteriorated mechanical and fatigue performance. In-situ monitoring of the melt pool subsurface morphology requires specialized equipment that may not be readily accessible or scalable. Therefore, we introduce a machine learning framework to correlate in-situ two-color thermal images observed via high-speed color imaging to the two-dimensional profile of the melt pool cross-section. Specifically, we employ a hybrid CNN-Transformer architecture to establish a correlation between single bead off-axis thermal image sequences and melt pool cross-section contours measured via optical microscopy. In this architecture, a ResNet model embeds the spatial information contained within the thermal images to a latent vector, while a Transformer model correlates the sequence of embedded vectors to extract temporal information. Our framework is able to model the curvature of the subsurface melt pool structure, with improved performance in high energy density regimes compared to analytical melt pool models. The performance of this model is evaluated through dimensional and geometric comparisons to the corresponding experimental melt pool observations.

Read more

5/21/2024

Deep Neural Operator Enabled Digital Twin Modeling for Additive Manufacturing
Total Score

0

Deep Neural Operator Enabled Digital Twin Modeling for Additive Manufacturing

Ning Liu, Xuxiao Li, Manoj R. Rajanna, Edward W. Reutzel, Brady Sawyer, Prahalada Rao, Jim Lua, Nam Phan, Yue Yu

A digital twin (DT), with the components of a physics-based model, a data-driven model, and a machine learning (ML) enabled efficient surrogate, behaves as a virtual twin of the real-world physical process. In terms of Laser Powder Bed Fusion (L-PBF) based additive manufacturing (AM), a DT can predict the current and future states of the melt pool and the resulting defects corresponding to the input laser parameters, evolve itself by assimilating in-situ sensor data, and optimize the laser parameters to mitigate defect formation. In this paper, we present a deep neural operator enabled computational framework of the DT for closed-loop feedback control of the L-PBF process. This is accomplished by building a high-fidelity computational model to accurately represent the melt pool states, an efficient surrogate model to approximate the melt pool solution field, followed by an physics-based procedure to extract information from the computed melt pool simulation that can further be correlated to the defect quantities of interest (e.g., surface roughness). In particular, we leverage the data generated from the high-fidelity physics-based model and train a series of Fourier neural operator (FNO) based ML models to effectively learn the relation between the input laser parameters and the corresponding full temperature field of the melt pool. Subsequently, a set of physics-informed variables such as the melt pool dimensions and the peak temperature can be extracted to compute the resulting defects. An optimization algorithm is then exercised to control laser input and minimize defects. On the other hand, the constructed DT can also evolve with the physical twin via offline finetuning and online material calibration. Finally, a probabilistic framework is adopted for uncertainty quantification. The developed DT is envisioned to guide the AM process and facilitate high-quality manufacturing.

Read more

5/17/2024

🔮

Total Score

0

Temperature Distribution Prediction in Laser Powder Bed Fusion using Transferable and Scalable Graph Neural Networks

Riddhiman Raut, Amit Kumar Ball, Amrita Basak

This study presents novel predictive models using Graph Neural Networks (GNNs) for simulating thermal dynamics in Laser Powder Bed Fusion (L-PBF) processes. By developing and validating Single-Laser GNN (SL-GNN) and Multi-Laser GNN (ML-GNN) surrogates, the research introduces a scalable data-driven approach that learns fundamental physics from small-scale Finite Element Analysis (FEA) simulations and applies them to larger domains. Achieving a Mean Absolute Percentage Error (MAPE) of 3.77% with the baseline SL-GNN model, GNNs effectively learn from high-resolution simulations and generalize well across larger geometries. The proposed models capture the complexity of the heat transfer process in L-PBF while significantly reducing computational costs. For example, a thermomechanical simulation for a 2 mm x 2 mm domain typically requires about 4 hours, whereas the SL-GNN model can predict thermal distributions almost instantly. Calibrating models to larger domains enhances predictive performance, with significant drops in MAPE for 3 mm x 3 mm and 4 mm x 4 mm domains, highlighting the scalability and efficiency of this approach. Additionally, models show a decreasing trend in Root Mean Square Error (RMSE) when tuned to larger domains, suggesting potential for becoming geometry-agnostic. The interaction of multiple lasers complicates heat transfer, necessitating larger model architectures and advanced feature engineering. Using hyperparameters from Gaussian process-based Bayesian optimization, the best ML-GNN model demonstrates a 46.4% improvement in MAPE over the baseline ML-GNN model. In summary, this approach enables more efficient and flexible predictive modeling in L-PBF additive manufacturing.

Read more

7/22/2024