Enabling Additive Manufacturing Part Inspection of Digital Twins via Collaborative Virtual Reality

Read original: arXiv:2405.12931 - Published 5/22/2024 by Vuthea Chheang, Saurabh Narain, Garrett Hooten, Robert Cerda, Brian Au, Brian Weston, Brian Giera, Peer-Timo Bremer, Haichao Miao
Total Score

0

🏅

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • Digital twins are a powerful tool in additive manufacturing (AM) that can revolutionize design optimization, inspection, monitoring, and root cause analysis.
  • AM digital twins incorporate a wide range of data sources, including machine toolpaths, in-process imaging, X-ray CT scans, and performance metrics.
  • Despite the evolution of digital twin platforms, effectively inspecting and deriving actionable insights from these complex, multimodal datasets remains a challenge.
  • Collaboration between quality assurance, manufacturing, pilot labs, and plant operations is crucial to reliably produce parts at scale, especially for the complex structures enabled by AM.
  • Traditional 2D desktop-based inspection methods struggle to handle the large-scale, inherently 3D nature of digital twin data.

Plain English Explanation

Digital twins are digital replicas of physical objects or processes. In the context of additive manufacturing (AM), digital twins can transform how we design, inspect, monitor, and troubleshoot AM parts and processes. Digital twins can incorporate a wealth of data, from the specific instructions given to the 3D printer to images of the part being built, and even scans of the final product.

This wealth of data can provide valuable insights, but inspecting and making sense of it all can be a challenge. Different teams, from quality control to manufacturing to research, need to work together to effectively use digital twins. This is especially true for complex 3D-printed parts, where the digital twin data can be difficult to visualize and analyze on a standard 2D computer screen.

To address these challenges, the researchers introduce a new virtual reality (VR) framework. This allows teams to immerse themselves in the digital twin data and collaborate in real-time. The VR system can handle large, 3D datasets and provides tools to align, visualize, and explore the digital twin in an intuitive way. This can help unlock the full potential of digital twins to improve additive manufacturing processes and enable the transition from monitoring to control.

Technical Explanation

The paper presents a novel VR framework to facilitate the collaborative and real-time inspection of digital twins in additive manufacturing (AM). AM digital twins typically incorporate a wide range of multimodal data, including machine toolpaths, in-process imaging, X-ray CT scans, and performance metrics.

The VR framework includes advanced features to address the challenges of inspecting these complex, large-scale datasets. This includes intuitive alignment and visualization of multimodal data, visual occlusion management, and the ability to stream and interact with voluminous 3D data. The framework also provides collaborative tools to enable teams from different departments, such as quality assurance, manufacturing, and research, to work together effectively.

The researchers demonstrate the capabilities of their VR framework through several use cases, showcasing how it can improve the inspection of AM components and processes. By enabling teams to map wireless networks into digital reality, the framework can help fully exploit the potential of digital twins in AM.

Critical Analysis

The paper presents a compelling and well-designed VR framework to address the challenges of inspecting and deriving actionable insights from digital twins in additive manufacturing. The researchers have clearly identified the key pain points, such as the need for collaborative, multidisciplinary approaches and the limitations of traditional 2D desktop-based inspection methods.

One potential area for further research could be exploring how this VR framework can be integrated with existing digital twin platforms or AM software ecosystems. Additionally, while the paper showcases several use cases, it would be interesting to see more detailed evaluations of the framework's performance, such as user studies or comparisons to alternative approaches.

Another consideration is the accessibility and scalability of the VR-based approach. While VR can provide an immersive and intuitive experience, it may not be feasible or practical for all teams and organizations to adopt. The researchers could explore ways to make the core capabilities of the framework available through more widely accessible platforms or interfaces.

Overall, the paper presents a promising solution to a critical challenge in the practical application of digital twins in additive manufacturing. By facilitating collaborative, real-time inspection and analysis, this VR framework has the potential to unlock the full value of digital twins and drive further advancements in this rapidly evolving field.

Conclusion

This paper introduces a novel virtual reality (VR) framework to enable collaborative and real-time inspection of digital twins in additive manufacturing (AM). Digital twins in AM can incorporate a wealth of multimodal data, from machine instructions to part scans, but effectively inspecting and deriving insights from these complex datasets remains a significant challenge.

The VR framework presented in this paper addresses this challenge by providing advanced features for aligning and visualizing multimodal data, managing visual occlusion, and streaming large-scale 3D datasets. By empowering teams from different departments to work together in an immersive, intuitive environment, the framework can help unlock the full potential of digital twins to optimize AM design, improve inspection and monitoring, and facilitate root cause analysis.

As the adoption of digital twins in AM continues to grow, solutions like the one presented in this paper will be crucial to bridging the gap between the data-rich digital models and the real-world manufacturing processes. By enabling more effective collaboration and insights, this VR framework can contribute to the broader goal of reliably producing complex AM parts at scale.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

🏅

Total Score

0

Enabling Additive Manufacturing Part Inspection of Digital Twins via Collaborative Virtual Reality

Vuthea Chheang, Saurabh Narain, Garrett Hooten, Robert Cerda, Brian Au, Brian Weston, Brian Giera, Peer-Timo Bremer, Haichao Miao

Digital twins (DTs) are an emerging capability in additive manufacturing (AM), set to revolutionize design optimization, inspection, in situ monitoring, and root cause analysis. AM DTs typically incorporate multimodal data streams, ranging from machine toolpaths and in-process imaging to X-ray CT scans and performance metrics. Despite the evolution of DT platforms, challenges remain in effectively inspecting them for actionable insights, either individually or in a multidisciplinary team setting. Quality assurance, manufacturing departments, pilot labs, and plant operations must collaborate closely to reliably produce parts at scale. This is particularly crucial in AM where complex structures require a collaborative and multidisciplinary approach. Additionally, the large-scale data originating from different modalities and their inherent 3D nature pose significant hurdles for traditional 2D desktop-based inspection methods. To address these challenges and increase the value proposition of DTs, we introduce a novel virtual reality (VR) framework to facilitate collaborative and real-time inspection of DTs in AM. This framework includes advanced features for intuitive alignment and visualization of multimodal data, visual occlusion management, streaming large-scale volumetric data, and collaborative tools, substantially improving the inspection of AM components and processes to fully exploit the potential of DTs in AM.

Read more

5/22/2024

Digital Twins in Additive Manufacturing: A Systematic Review
Total Score

0

Digital Twins in Additive Manufacturing: A Systematic Review

Md Manjurul Ahsan, Benjamin Bevans, Chris Billings, Alexander Riensche, Yingtao Liu, Shivakumar Raman, Zahed Siddique

Digital Twins (DTs) are becoming popular in Additive Manufacturing (AM) due to their ability to create virtual replicas of physical components of AM machines, which helps in real-time production monitoring. Advanced techniques such as Machine Learning (ML), Augmented Reality (AR), and simulation-based models play key roles in developing intelligent and adaptable DTs in manufacturing processes. However, questions remain regarding scalability, the integration of high-quality data, and the computational power required for real-time applications in developing DTs. Understanding the current state of DTs in AM is essential to address these challenges and fully utilize their potential in advancing AM processes. Considering this opportunity, this work aims to provide a comprehensive overview of DTs in AM by addressing the following four research questions: (1) What are the key types of DTs used in AM and their specific applications? (2) What are the recent developments and implementations of DTs? (3) How are DTs employed in process improvement and hybrid manufacturing? (4) How are DTs integrated with Industry 4.0 technologies? By discussing current applications and techniques, we aim to offer a better understanding and potential future research directions for researchers and practitioners in AM and DTs.

Read more

9/4/2024

Deep Neural Operator Enabled Digital Twin Modeling for Additive Manufacturing
Total Score

0

Deep Neural Operator Enabled Digital Twin Modeling for Additive Manufacturing

Ning Liu, Xuxiao Li, Manoj R. Rajanna, Edward W. Reutzel, Brady Sawyer, Prahalada Rao, Jim Lua, Nam Phan, Yue Yu

A digital twin (DT), with the components of a physics-based model, a data-driven model, and a machine learning (ML) enabled efficient surrogate, behaves as a virtual twin of the real-world physical process. In terms of Laser Powder Bed Fusion (L-PBF) based additive manufacturing (AM), a DT can predict the current and future states of the melt pool and the resulting defects corresponding to the input laser parameters, evolve itself by assimilating in-situ sensor data, and optimize the laser parameters to mitigate defect formation. In this paper, we present a deep neural operator enabled computational framework of the DT for closed-loop feedback control of the L-PBF process. This is accomplished by building a high-fidelity computational model to accurately represent the melt pool states, an efficient surrogate model to approximate the melt pool solution field, followed by an physics-based procedure to extract information from the computed melt pool simulation that can further be correlated to the defect quantities of interest (e.g., surface roughness). In particular, we leverage the data generated from the high-fidelity physics-based model and train a series of Fourier neural operator (FNO) based ML models to effectively learn the relation between the input laser parameters and the corresponding full temperature field of the melt pool. Subsequently, a set of physics-informed variables such as the melt pool dimensions and the peak temperature can be extracted to compute the resulting defects. An optimization algorithm is then exercised to control laser input and minimize defects. On the other hand, the constructed DT can also evolve with the physical twin via offline finetuning and online material calibration. Finally, a probabilistic framework is adopted for uncertainty quantification. The developed DT is envisioned to guide the AM process and facilitate high-quality manufacturing.

Read more

5/17/2024

Photogrammetry for Digital Twinning Industry 4.0 (I4) Systems
Total Score

0

Photogrammetry for Digital Twinning Industry 4.0 (I4) Systems

Ahmed Alhamadah, Muntasir Mamun, Henry Harms, Mathew Redondo, Yu-Zheng Lin, Jesus Pacheco, Soheil Salehi, Pratik Satam

The onset of Industry 4.0 is rapidly transforming the manufacturing world through the integration of cloud computing, machine learning (ML), artificial intelligence (AI), and universal network connectivity, resulting in performance optimization and increase productivity. Digital Twins (DT) are one such transformational technology that leverages software systems to replicate physical process behavior, representing the physical process in a digital environment. This paper aims to explore the use of photogrammetry (which is the process of reconstructing physical objects into virtual 3D models using photographs) and 3D Scanning techniques to create accurate visual representation of the 'Physical Process', to interact with the ML/AI based behavior models. To achieve this, we have used a readily available consumer device, the iPhone 15 Pro, which features stereo vision capabilities, to capture the depth of an Industry 4.0 system. By processing these images using 3D scanning tools, we created a raw 3D model for 3D modeling and rendering software for the creation of a DT model. The paper highlights the reliability of this method by measuring the error rate in between the ground truth (measurements done manually using a tape measure) and the final 3D model created using this method. The overall mean error is 4.97% and the overall standard deviation error is 5.54% between the ground truth measurements and their photogrammetry counterparts. The results from this work indicate that photogrammetry using consumer-grade devices can be an efficient and cost-efficient approach to creating DTs for smart manufacturing, while the approaches flexibility allows for iterative improvements of the models over time.

Read more

7/30/2024