Photogrammetry for Digital Twinning Industry 4.0 (I4) Systems

Read original: arXiv:2407.18951 - Published 7/30/2024 by Ahmed Alhamadah, Muntasir Mamun, Henry Harms, Mathew Redondo, Yu-Zheng Lin, Jesus Pacheco, Soheil Salehi, Pratik Satam
Total Score

0

Photogrammetry for Digital Twinning Industry 4.0 (I4) Systems

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • Digital twinning is a key technology for Industry 4.0 (I4) systems
  • Photogrammetry can be used to create digital twins of physical systems
  • This work explores the use of photogrammetry for digital twinning in I4 systems
  • The research is supported by funding from the National Science Foundation (NSF) and the University of Arizona's "Future Factory" initiative

Plain English Explanation

Digital twinning is the process of creating a virtual model that accurately represents a physical object or system. This can be a powerful tool for Industry 4.0 (I4) systems, which rely on integration of digital and physical components.

Photogrammetry is a technique that uses multiple photographs to reconstruct the 3D shape of an object. This paper explores how photogrammetry can be used to create digital twins of physical systems in an I4 context.

The research is supported by funding from the National Science Foundation (NSF) and the University of Arizona's "Future Factory" initiative, which are investing in technologies to improve manufacturing and enable more seamless integration of digital and physical components.

Technical Explanation

The paper presents a framework for using photogrammetry to generate digital twins of I4 systems. The approach leverages stereo-vision techniques to reconstruct 3D models from multiple camera views.

The proposed system consists of a set of calibrated cameras that capture images of the target system. These images are then processed using photogrammetry algorithms to reconstruct a 3D model of the physical system.

The authors demonstrate the effectiveness of their approach through case studies involving various I4 systems. They show how the digital twins created via photogrammetry can be used for applications like part inspection and remote monitoring.

Critical Analysis

The paper provides a promising approach for leveraging photogrammetry to create digital twins of I4 systems. The use of stereo-vision techniques to reconstruct 3D models is a well-established method, and the authors demonstrate its applicability in an I4 context.

However, the paper does not address some potential limitations of the approach. For example, the accuracy and fidelity of the digital twins may be affected by factors like lighting conditions, object occlusions, and camera calibration. Further research may be needed to assess the robustness of the photogrammetry-based approach in real-world I4 environments.

Additionally, the paper focuses on the technical implementation of the photogrammetry framework, but does not delve deeply into the broader implications and applications of digital twinning in I4 systems. A more in-depth discussion of the potential benefits, challenges, and use cases of this technology would provide valuable context for the research.

Conclusion

This paper demonstrates the potential of using photogrammetry to create digital twins of I4 systems. By leveraging stereo-vision techniques, the proposed framework can reconstruct 3D models of physical systems that can be used for a variety of applications, such as part inspection and remote monitoring.

The research is supported by funding from the NSF and the University of Arizona's "Future Factory" initiative, indicating the growing interest and investment in technologies that enable more seamless integration of digital and physical components in manufacturing and industry. While the paper provides a solid technical foundation, further research may be needed to address the limitations and broader implications of this approach.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

Photogrammetry for Digital Twinning Industry 4.0 (I4) Systems
Total Score

0

Photogrammetry for Digital Twinning Industry 4.0 (I4) Systems

Ahmed Alhamadah, Muntasir Mamun, Henry Harms, Mathew Redondo, Yu-Zheng Lin, Jesus Pacheco, Soheil Salehi, Pratik Satam

The onset of Industry 4.0 is rapidly transforming the manufacturing world through the integration of cloud computing, machine learning (ML), artificial intelligence (AI), and universal network connectivity, resulting in performance optimization and increase productivity. Digital Twins (DT) are one such transformational technology that leverages software systems to replicate physical process behavior, representing the physical process in a digital environment. This paper aims to explore the use of photogrammetry (which is the process of reconstructing physical objects into virtual 3D models using photographs) and 3D Scanning techniques to create accurate visual representation of the 'Physical Process', to interact with the ML/AI based behavior models. To achieve this, we have used a readily available consumer device, the iPhone 15 Pro, which features stereo vision capabilities, to capture the depth of an Industry 4.0 system. By processing these images using 3D scanning tools, we created a raw 3D model for 3D modeling and rendering software for the creation of a DT model. The paper highlights the reliability of this method by measuring the error rate in between the ground truth (measurements done manually using a tape measure) and the final 3D model created using this method. The overall mean error is 4.97% and the overall standard deviation error is 5.54% between the ground truth measurements and their photogrammetry counterparts. The results from this work indicate that photogrammetry using consumer-grade devices can be an efficient and cost-efficient approach to creating DTs for smart manufacturing, while the approaches flexibility allows for iterative improvements of the models over time.

Read more

7/30/2024

🏅

Total Score

0

Enabling Additive Manufacturing Part Inspection of Digital Twins via Collaborative Virtual Reality

Vuthea Chheang, Saurabh Narain, Garrett Hooten, Robert Cerda, Brian Au, Brian Weston, Brian Giera, Peer-Timo Bremer, Haichao Miao

Digital twins (DTs) are an emerging capability in additive manufacturing (AM), set to revolutionize design optimization, inspection, in situ monitoring, and root cause analysis. AM DTs typically incorporate multimodal data streams, ranging from machine toolpaths and in-process imaging to X-ray CT scans and performance metrics. Despite the evolution of DT platforms, challenges remain in effectively inspecting them for actionable insights, either individually or in a multidisciplinary team setting. Quality assurance, manufacturing departments, pilot labs, and plant operations must collaborate closely to reliably produce parts at scale. This is particularly crucial in AM where complex structures require a collaborative and multidisciplinary approach. Additionally, the large-scale data originating from different modalities and their inherent 3D nature pose significant hurdles for traditional 2D desktop-based inspection methods. To address these challenges and increase the value proposition of DTs, we introduce a novel virtual reality (VR) framework to facilitate collaborative and real-time inspection of DTs in AM. This framework includes advanced features for intuitive alignment and visualization of multimodal data, visual occlusion management, streaming large-scale volumetric data, and collaborative tools, substantially improving the inspection of AM components and processes to fully exploit the potential of DTs in AM.

Read more

5/22/2024

Digital Twins in Additive Manufacturing: A Systematic Review
Total Score

0

Digital Twins in Additive Manufacturing: A Systematic Review

Md Manjurul Ahsan, Benjamin Bevans, Chris Billings, Alexander Riensche, Yingtao Liu, Shivakumar Raman, Zahed Siddique

Digital Twins (DTs) are becoming popular in Additive Manufacturing (AM) due to their ability to create virtual replicas of physical components of AM machines, which helps in real-time production monitoring. Advanced techniques such as Machine Learning (ML), Augmented Reality (AR), and simulation-based models play key roles in developing intelligent and adaptable DTs in manufacturing processes. However, questions remain regarding scalability, the integration of high-quality data, and the computational power required for real-time applications in developing DTs. Understanding the current state of DTs in AM is essential to address these challenges and fully utilize their potential in advancing AM processes. Considering this opportunity, this work aims to provide a comprehensive overview of DTs in AM by addressing the following four research questions: (1) What are the key types of DTs used in AM and their specific applications? (2) What are the recent developments and implementations of DTs? (3) How are DTs employed in process improvement and hybrid manufacturing? (4) How are DTs integrated with Industry 4.0 technologies? By discussing current applications and techniques, we aim to offer a better understanding and potential future research directions for researchers and practitioners in AM and DTs.

Read more

9/4/2024

📊

Total Score

0

Scan-to-BIM for As-built Roads: Automatic Road Digital Twinning from Semantically Labeled Point Cloud Data

Yuexiong Ding, Mengtian Yin, Ran Wei, Ioannis Brilakis, Muyang Liu, Xiaowei Luo

Creating geometric digital twins (gDT) for as-built roads still faces many challenges, such as low automation level and accuracy, limited asset types and shapes, and reliance on engineering experience. A novel scan-to-building information modeling (scan-to-BIM) framework is proposed for automatic road gDT creation based on semantically labeled point cloud data (PCD), which considers six asset types: Road Surface, Road Side (Slope), Road Lane (Marking), Road Sign, Road Light, and Guardrail. The framework first segments the semantic PCD into spatially independent instances or parts, then extracts the sectional polygon contours as their representative geometric information, stored in JavaScript Object Notation (JSON) files using a new data structure. Primitive gDTs are finally created from JSON files using corresponding conversion algorithms. The proposed method achieves an average distance error of 1.46 centimeters and a processing speed of 6.29 meters per second on six real-world road segments with a total length of 1,200 meters.

Read more

6/19/2024