Evaluating the efficacy of haptic feedback, 360{deg} treadmill-integrated Virtual Reality framework and longitudinal training on decision-making performance in a complex search-and-shoot simulation

2404.09147

YC

0

Reddit

0

Published 4/16/2024 by Akash K Rao, Arnav Bhavsar, Shubhajit Roy Chowdhury, Sushil Chandra, Ramsingh Negi, Prakash Duraisamy, Varun Dutt

šŸ‹ļø

Abstract

Virtual Reality (VR) has made significant strides, offering users a multitude of ways to interact with virtual environments. Each sensory modality in VR provides distinct inputs and interactions, enhancing the user's immersion and presence. However, the potential of additional sensory modalities, such as haptic feedback and 360{deg} locomotion, to improve decision-making performance has not been thoroughly investigated. This study addresses this gap by evaluating the impact of a haptic feedback, 360{deg} locomotion-integrated VR framework and longitudinal, heterogeneous training on decision-making performance in a complex search-and-shoot simulation. The study involved 32 participants from a defence simulation base in India, who were randomly divided into two groups: experimental (haptic feedback, 360{deg} locomotion-integrated VR framework with longitudinal, heterogeneous training) and placebo control (longitudinal, heterogeneous VR training without extrasensory modalities). The experiment lasted 10 days. On Day 1, all subjects executed a search-and-shoot simulation closely replicating the elements/situations in the real world. From Day 2 to Day 9, the subjects underwent heterogeneous training, imparted by the design of various complexity levels in the simulation using changes in behavioral attributes/artificial intelligence of the enemies. On Day 10, they repeated the search-and-shoot simulation executed on Day 1. The results showed that the experimental group experienced a gradual increase in presence, immersion, and engagement compared to the placebo control group. However, there was no significant difference in decision-making performance between the two groups on day 10. We intend to use these findings to design multisensory VR training frameworks that enhance engagement levels and decision-making performance.

Create account to get full access

or

If you already have an account, we'll log you in

Overview

  • This study explores the impact of a haptic feedback, 360-degree locomotion-integrated virtual reality (VR) framework and longitudinal, heterogeneous training on decision-making performance in a complex search-and-shoot simulation.
  • The researchers conducted an experiment with 32 participants from a defense simulation base in India, divided into an experimental group (using the VR framework with extra sensory modalities) and a placebo control group (using VR training without the extra modalities).
  • The experiment lasted 10 days, with the participants performing a search-and-shoot simulation on the first and last days, and undergoing heterogeneous training in between.

Plain English Explanation

The researchers wanted to see if adding more ways for people to experience virtual reality (VR) could improve their decision-making skills in a complex simulation. They set up an experiment where some people used a VR system with haptic feedback (touch sensations) and 360-degree locomotion (being able to move around freely), while others used a standard VR system without those extra features.

Over 10 days, the participants practiced a search-and-shoot simulation that was designed to be similar to real-world situations. The researchers measured things like how immersed and engaged the participants felt in the VR environment. On the first and last days, the participants performed the same search-and-shoot task, and the researchers compared their decision-making performance between the two groups.

The results showed that the group using the more advanced VR system felt more present, immersed, and engaged in the virtual environment. However, there was no significant difference in their decision-making performance compared to the group using the standard VR system.

The researchers plan to use these findings to design even more engaging and effective VR training frameworks that can improve people's decision-making skills in complex, real-world scenarios.

Technical Explanation

The researchers conducted an experiment to evaluate the impact of a haptic feedback, 360-degree locomotion-integrated VR framework and longitudinal, heterogeneous training on decision-making performance in a complex search-and-shoot simulation. They recruited 32 participants from a defense simulation base in India and randomly divided them into two groups: an experimental group that used the VR framework with extra sensory modalities, and a placebo control group that used VR training without the extra modalities.

The experiment lasted 10 days. On Day 1, all participants executed a search-and-shoot simulation closely replicating elements and situations from the real world. From Day 2 to Day 9, the participants underwent heterogeneous training, with the simulation's complexity levels and enemy behavior/artificial intelligence changing to create a diverse learning experience. On Day 10, they repeated the initial search-and-shoot simulation.

The results showed that the experimental group experienced a gradual increase in presence, immersion, and engagement compared to the placebo control group. However, there was no significant difference in decision-making performance between the two groups on Day 10.

Critical Analysis

The study provides valuable insights into the potential of multisensory VR training to enhance user engagement and presence. However, the lack of a significant difference in decision-making performance between the two groups is an interesting finding that warrants further investigation.

One possible limitation of the study is the relatively short duration of the experiment, as 10 days may not have been sufficient to fully capture the long-term effects of the multisensory VR training on decision-making skills. Additionally, the study focused on a specific search-and-shoot simulation, which may not be representative of all types of decision-making tasks.

Future research could explore the impact of multisensory VR training on a wider range of decision-making scenarios, as well as investigate the optimal duration and training regimen for enhancing decision-making performance. Incorporating physiological measurements and longitudinal studies could also provide deeper insights into the underlying mechanisms and long-term effects of multisensory VR training on cognitive and behavioral outcomes.

Conclusion

This study highlights the potential of multisensory VR training to improve user engagement and presence, but it did not find a significant difference in decision-making performance between the experimental and control groups. The findings suggest that the design and implementation of VR training frameworks require careful consideration to effectively enhance decision-making skills in complex, real-world scenarios. The researchers plan to use these insights to develop more advanced VR training systems that can better support improved decision-making performance.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Related Papers

Effects of Multisensory Feedback on the Perception and Performance of Virtual Reality Hand-Retargeted Interaction

Effects of Multisensory Feedback on the Perception and Performance of Virtual Reality Hand-Retargeted Interaction

Hyunyoung Jang, Jinwook Kim, Jeongmi Lee

YC

0

Reddit

0

Retargeting methods that modify the visual representation of real movements have been widely used to expand the interaction space and create engaging virtual reality experiences. For optimal user experience and performance, it is essential to specify the perception of retargeting and utilize the appropriate range of modification parameters. However, previous studies mostly concentrated on whether users perceived the target sense or not and rarely examined the perceptual accuracy and sensitivity to retargeting. Moreover, it is unknown how the perception and performance in hand-retargeted interactions are influenced by multisensory feedback. In this study, we used rigorous psychophysical methods to specify users' perceptual accuracy and sensitivity to hand-retargeting and provide acceptable ranges of retargeting parameters. We also presented different multisensory feedback simultaneously with the retargeting to probe its effect on users' perception and task performance. The experimental results showed that providing continuous multisensory feedback, proportionate to the distance between the virtual hand and the targeted destination, heightened the accuracy of users' perception of hand retargeting without altering their perceptual sensitivity. Furthermore, the utilization of multisensory feedback considerably improved the precision of task performance, particularly at lower gain factors. Based on these findings, we propose design guidelines and potential applications of VR hand-retargeted interactions and multisensory feedback for optimal user experience and performance.

Read more

4/8/2024

Advancing Robotic Surgery: Affordable Kinesthetic and Tactile Feedback Solutions for Endotrainers

Advancing Robotic Surgery: Affordable Kinesthetic and Tactile Feedback Solutions for Endotrainers

Bharath Rajiv Nair, Aravinthkumar T., B. Vinod

YC

0

Reddit

0

The proliferation of robot-assisted minimally invasive surgery highlights the need for advanced training tools such as cost-effective robotic endotrainers. Current surgical robots often lack haptic feedback, which is crucial for providing surgeons with a real-time sense of touch. This absence can impact the surgeon's ability to perform delicate operations effectively. To enhance surgical training and address this deficiency, we have integrated a cost-effective haptic feedback system into a robotic endotrainer. This system incorporates both kinesthetic (force) and tactile feedback, improving the fidelity of surgical simulations and enabling more precise control during operations. Our system incorporates an innovative, cost-effective Force/Torque sensor utilizing optoelectronic technology, specifically designed to accurately detect forces and moments exerted on surgical tools with a 95% accuracy, providing essential kinesthetic feedback. Additionally, we implemented a tactile feedback mechanism that informs the surgeon of the gripping forces between the tool's tip and the tissue. This dual feedback system enhances the fidelity of training simulations and the execution of robotic surgeries, promoting broader adoption and safer practices.

Read more

6/27/2024

šŸ’¬

Pseudo-Haptics Survey: Human-Computer Interaction in Extended Reality & Teleoperation

Rui Xavier, Jos'e Lu'is Silva, Rodrigo Ventura, Joaquim Jorge

YC

0

Reddit

0

Pseudo-haptic techniques are becoming increasingly popular in human-computer interaction. They replicate haptic sensations by leveraging primarily visual feedback rather than mechanical actuators. These techniques bridge the gap between the real and virtual worlds by exploring the brain's ability to integrate visual and haptic information. One of the many advantages of pseudo-haptic techniques is that they are cost-effective, portable, and flexible. They eliminate the need for direct attachment of haptic devices to the body, which can be heavy and large and require a lot of power and maintenance. Recent research has focused on applying these techniques to extended reality and mid-air interactions. To better understand the potential of pseudo-haptic techniques, the authors developed a novel taxonomy encompassing tactile feedback, kinesthetic feedback, and combined categories in multimodal approaches, ground not covered by previous surveys. This survey highlights multimodal strategies and potential avenues for future studies, particularly regarding integrating these techniques into extended reality and collaborative virtual environments.

Read more

6/4/2024

šŸ–¼ļø

Multisensory extended reality applications offer benefits for volumetric biomedical image analysis in research and medicine

Kathrin Krieger, Jan Egger, Jens Kleesiek, Matthias Gunzer, Jianxu Chen

YC

0

Reddit

0

3D data from high-resolution volumetric imaging is a central resource for diagnosis and treatment in modern medicine. While the fast development of AI enhances imaging and analysis, commonly used visualization methods lag far behind. Recent research used extended reality (XR) for perceiving 3D images with visual depth perception and touch but used restrictive haptic devices. While unrestricted touch benefits volumetric data examination, implementing natural haptic interaction with XR is challenging. The research question is whether a multisensory XR application with intuitive haptic interaction adds value and should be pursued. In a study, 24 experts for biomedical images in research and medicine explored 3D medical shapes with 3 applications: a multisensory virtual reality (VR) prototype using haptic gloves, a simple VR prototype using controllers, and a standard PC application. Results of standardized questionnaires showed no significant differences between all application types regarding usability and no significant difference between both VR applications regarding presence. Participants agreed to statements that VR visualizations provide better depth information, using the hands instead of controllers simplifies data exploration, the multisensory VR prototype allows intuitive data exploration, and it is beneficial over traditional data examination methods. While most participants mentioned manual interaction as best aspect, they also found it the most improvable. We conclude that a multisensory XR application with improved manual interaction adds value for volumetric biomedical data examination. We will proceed with our open-source research project ISH3DE (Intuitive Stereoptic Haptic 3D Data Exploration) to serve medical education, therapeutic decisions, surgery preparations, or research data analysis.

Read more

6/17/2024