Investigation on domain adaptation of additive manufacturing monitoring systems to enhance digital twin reusability

Read original: arXiv:2409.12785 - Published 9/20/2024 by Jiarui Xie, Zhuo Yang, Chun-Chun Hu, Haw-Ching Yang, Yan Lu, Yaoyao Fiona Zhao
Total Score

0

📶

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • Powder bed fusion (PBF) is a type of metal 3D printing that can quickly make complex objects.
  • However, defects like holes and uneven surfaces can occur, reducing the part's strength.
  • Monitoring the melt pool (the melted metal) during printing can help detect these defects.
  • Machine learning models can be trained on melt pool images to identify process problems.
  • But these models don't work well when applied to different printers or settings.
  • This paper proposes a way to transfer knowledge between different printing setups to improve model reusability.

Plain English Explanation

3D printing metal parts can be done using a process called powder bed fusion (PBF). PBF allows creating complex shapes quickly. However, the printed parts can sometimes have defects like holes or uneven surfaces, which can make them weaker.

To catch these problems, researchers monitor the melt pool - the melted metal - during printing. They use high-speed cameras to take images of the melt pool, and then train machine learning (ML) models to analyze these images and detect defects. This allows them to evaluate print quality in real-time.

The challenge is that these ML models don't work well when applied to different printers or printing settings. The models get trained on data from one specific setup, but don't perform as well on data from other setups, even if they are printing the same type of part.

This paper proposes a way to transfer the knowledge from one printer setup to another. By aligning the data and models between the different setups, the researchers were able to improve the accuracy of defect detection by 31% without needing any labeled training data from the new setup.

Technical Explanation

This paper focuses on improving the reusability of digital twin (DT) models for monitoring powder bed fusion (PBF) additive manufacturing processes. PBF is a metal 3D printing technology that can rapidly fabricate complex geometries. However, defects like pores and balling can occur, compromising the mechanical performance of the printed part.

To address this, the researchers propose using machine learning (ML)-based DT models to monitor the melt pool - the pool of melted metal - during the printing process. Melt pool images captured by high-speed cameras are used to train these ML models for tasks like anomaly detection and print quality evaluation.

The key challenge is that the performance of these ML models is usually limited when applied to printing setups different from the one used to collect the training data. To improve the reusability of the DT models, the paper introduces a knowledge transfer pipeline consisting of:

  1. Data Preprocessing: Standardizing the input data from different sources.
  2. Data Augmentation: Synthetically expanding the training data.
  3. Domain Alignment: Reducing the distribution gap between source and target domain data.
  4. Decision Alignment: Aligning the output of the model to the target domain.

Experiments were conducted using datasets from the National Institute of Standards and Technology and National Cheng Kung University, which had variations in cameras, materials, printers, and process parameters. Compared to a model trained only on the source data, the proposed pipeline increased melt pool anomaly detection accuracy by 31% without any labeled target data.

Critical Analysis

The main strength of this research is the novel knowledge transfer pipeline that enhances the reusability of DT models across different additive manufacturing setups. By addressing the domain shift problem, the approach can potentially save time and resources that would otherwise be spent on collecting and annotating large training datasets for each new printing configuration.

However, the paper does not provide a detailed analysis of the individual contributions of each step in the pipeline (data augmentation, domain alignment, etc.). It would be helpful to understand which techniques had the greatest impact on improving model performance.

Additionally, the experiments were conducted on a relatively small number of datasets, so further validation on a wider range of printing conditions would be beneficial to fully assess the generalizability of the approach. The paper also does not discuss any potential limitations or failure cases of the proposed pipeline.

Finally, while the knowledge transfer concept is promising, the practical implementation may still be challenging for industrial users who may not have the required expertise in machine learning and domain adaptation. Providing more guidance on how to apply the pipeline in real-world settings would enhance the paper's impact.

Conclusion

This paper presents a novel knowledge transfer pipeline to enhance the reusability of digital twin models for monitoring powder bed fusion additive manufacturing processes. By aligning the data and models between different printing setups, the approach can significantly improve the accuracy of defect detection without requiring any labeled training data from the target domain.

This research demonstrates the potential of cross-domain knowledge transfer to address the widespread challenge of domain shift in industrial machine learning applications. If further developed and adopted, the proposed techniques could help accelerate the deployment of robust quality assurance systems for additive manufacturing, ultimately improving the reliability and performance of 3D printed metal parts.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

📶

Total Score

0

New!Investigation on domain adaptation of additive manufacturing monitoring systems to enhance digital twin reusability

Jiarui Xie, Zhuo Yang, Chun-Chun Hu, Haw-Ching Yang, Yan Lu, Yaoyao Fiona Zhao

Powder bed fusion (PBF) is an emerging metal additive manufacturing (AM) technology that enables rapid fabrication of complex geometries. However, defects such as pores and balling may occur and lead to structural unconformities, thus compromising the mechanical performance of the part. This has become a critical challenge for quality assurance as the nature of some defects is stochastic during the process and invisible from the exterior. To address this issue, digital twin (DT) using machine learning (ML)-based modeling can be deployed for AM process monitoring and control. Melt pool is one of the most commonly observed physical phenomena for process monitoring, usually by high-speed cameras. Once labeled and preprocessed, the melt pool images are used to train ML-based models for DT applications such as process anomaly detection and print quality evaluation. Nonetheless, the reusability of DTs is restricted due to the wide variability of AM settings, including AM machines and monitoring instruments. The performance of the ML models trained using the dataset collected from one setting is usually compromised when applied to other settings. This paper proposes a knowledge transfer pipeline between different AM settings to enhance the reusability of AM DTs. The source and target datasets are collected from the National Institute of Standards and Technology and National Cheng Kung University with different cameras, materials, AM machines, and process parameters. The proposed pipeline consists of four steps: data preprocessing, data augmentation, domain alignment, and decision alignment. Compared with the model trained only using the source dataset, this pipeline increased the melt pool anomaly detection accuracy by 31% without any labeled training data from the target dataset.

Read more

9/20/2024

Deep Neural Operator Enabled Digital Twin Modeling for Additive Manufacturing
Total Score

0

Deep Neural Operator Enabled Digital Twin Modeling for Additive Manufacturing

Ning Liu, Xuxiao Li, Manoj R. Rajanna, Edward W. Reutzel, Brady Sawyer, Prahalada Rao, Jim Lua, Nam Phan, Yue Yu

A digital twin (DT), with the components of a physics-based model, a data-driven model, and a machine learning (ML) enabled efficient surrogate, behaves as a virtual twin of the real-world physical process. In terms of Laser Powder Bed Fusion (L-PBF) based additive manufacturing (AM), a DT can predict the current and future states of the melt pool and the resulting defects corresponding to the input laser parameters, evolve itself by assimilating in-situ sensor data, and optimize the laser parameters to mitigate defect formation. In this paper, we present a deep neural operator enabled computational framework of the DT for closed-loop feedback control of the L-PBF process. This is accomplished by building a high-fidelity computational model to accurately represent the melt pool states, an efficient surrogate model to approximate the melt pool solution field, followed by an physics-based procedure to extract information from the computed melt pool simulation that can further be correlated to the defect quantities of interest (e.g., surface roughness). In particular, we leverage the data generated from the high-fidelity physics-based model and train a series of Fourier neural operator (FNO) based ML models to effectively learn the relation between the input laser parameters and the corresponding full temperature field of the melt pool. Subsequently, a set of physics-informed variables such as the melt pool dimensions and the peak temperature can be extracted to compute the resulting defects. An optimization algorithm is then exercised to control laser input and minimize defects. On the other hand, the constructed DT can also evolve with the physical twin via offline finetuning and online material calibration. Finally, a probabilistic framework is adopted for uncertainty quantification. The developed DT is envisioned to guide the AM process and facilitate high-quality manufacturing.

Read more

5/17/2024

Deep Learning for Melt Pool Depth Contour Prediction From Surface Thermal Images via Vision Transformers
Total Score

0

Deep Learning for Melt Pool Depth Contour Prediction From Surface Thermal Images via Vision Transformers

Francis Ogoke, Peter Myung-Won Pak, Alexander Myers, Guadalupe Quirarte, Jack Beuth, Jonathan Malen, Amir Barati Farimani

Insufficient overlap between the melt pools produced during Laser Powder Bed Fusion (L-PBF) can lead to lack-of-fusion defects and deteriorated mechanical and fatigue performance. In-situ monitoring of the melt pool subsurface morphology requires specialized equipment that may not be readily accessible or scalable. Therefore, we introduce a machine learning framework to correlate in-situ two-color thermal images observed via high-speed color imaging to the two-dimensional profile of the melt pool cross-section. Specifically, we employ a hybrid CNN-Transformer architecture to establish a correlation between single bead off-axis thermal image sequences and melt pool cross-section contours measured via optical microscopy. In this architecture, a ResNet model embeds the spatial information contained within the thermal images to a latent vector, while a Transformer model correlates the sequence of embedded vectors to extract temporal information. Our framework is able to model the curvature of the subsurface melt pool structure, with improved performance in high energy density regimes compared to analytical melt pool models. The performance of this model is evaluated through dimensional and geometric comparisons to the corresponding experimental melt pool observations.

Read more

5/21/2024

Binocular Model: A deep learning solution for online melt pool temperature analysis using dual-wavelength Imaging Pyrometry
Total Score

0

Binocular Model: A deep learning solution for online melt pool temperature analysis using dual-wavelength Imaging Pyrometry

Javid Akhavan, Chaitanya Krishna Vallabh, Xiayun Zhao, Souran Manoochehri

In metal Additive Manufacturing (AM), monitoring the temperature of the Melt Pool (MP) is crucial for ensuring part quality, process stability, defect prevention, and overall process optimization. Traditional methods, are slow to converge and require extensive manual effort to translate data into actionable insights, rendering them impractical for real-time monitoring and control. To address this challenge, we propose an Artificial Intelligence (AI)-based solution aimed at reducing manual data processing reliance and improving the efficiency of transitioning from data to insight. In our study, we utilize a dataset comprising dual-wavelength real-time process monitoring data and corresponding temperature maps. We introduce a deep learning model called the Binocular model, which exploits dual input observations to perform a precise analysis of MP temperature in Laser Powder Bed Fusion (L-PBF). Through advanced deep learning techniques, we seamlessly convert raw data into temperature maps, significantly streamlining the process and enabling batch processing at a rate of up to 750 frames per second, approximately 1000 times faster than conventional methods. Our Binocular model achieves high accuracy in temperature estimation, evidenced by a 0.95 R-squared score, while simultaneously enhancing processing efficiency by a factor of $sim1000x$ times. This model directly addresses the challenge of real-time MP temperature monitoring and offers insights into the encountered constraints and the benefits of our Deep Learning-based approach. By combining efficiency and precision, our work contributes to the advancement of temperature monitoring in L-PBF, thus driving progress in the field of metal AM.

Read more

8/27/2024