Comparing the Effects of Visual, Haptic, and Visuohaptic Encoding on Memory Retention of Digital Objects in Virtual Reality
0
Sign in to get full access
Overview
- This paper examines the effects of different sensory experiences on memory retention of digital objects in virtual reality (VR).
- The researchers compared the impact of visual, haptic (touch), and visuohaptic (combined visual and touch) encoding on participants' ability to remember the properties of virtual objects.
- The study aimed to provide insights into how multisensory feedback in VR can influence the way users perceive and remember digital information.
Plain English Explanation
The paper explores how the senses of sight and touch can affect how well people remember virtual objects in VR. The researchers had participants interact with digital objects using three different methods:
- Visual: Participants could only see the objects.
- Haptic: Participants could feel the objects using touch, but couldn't see them.
- Visuohaptic: Participants could both see and feel the objects.
After interacting with the objects, the researchers tested how well the participants could recall the objects' properties, such as their shape and size. The goal was to understand how incorporating touch, in addition to sight, might improve people's ability to remember virtual things they've experienced in VR. [This relates to the research in the paper on evaluating the efficacy of haptic feedback in 360-degree treadmill-integrated VR.]
The findings from this study could help inform the design of VR experiences, where providing both visual and touch-based interactions may lead to better user memory and understanding of the virtual content. [This also connects to the research on the effects of multisensory feedback on perception and performance in VR and the benefits of multisensory extended reality applications.]
Technical Explanation
The researchers conducted an experiment with 60 participants, who were randomly assigned to one of the three sensory encoding conditions (visual, haptic, or visuohaptic). In the visual condition, participants could only see the virtual objects; in the haptic condition, they could only feel the objects; and in the visuohaptic condition, they could both see and feel the objects.
Participants were asked to interact with a series of virtual objects and then complete a memory test, where they were required to identify the objects from a set of options and provide details about their properties, such as shape and size. The researchers analyzed the accuracy and response times of the participants' responses to assess the impact of the different sensory encoding conditions on memory retention.
The results showed that participants in the visuohaptic condition performed significantly better on the memory test compared to those in the visual or haptic conditions. This suggests that combining visual and haptic feedback can enhance users' ability to remember virtual objects they have experienced in VR. [This relates to research on the reduction of forgetting through contextual variation during encoding.]
The findings also indicate that the integration of touch-based interactions, or pseudo-haptics, in VR can improve users' understanding and retention of digital content, which has important implications for the design of immersive experiences.
Critical Analysis
The researchers acknowledged several limitations of the study, such as the use of a relatively small sample size and the focus on a limited set of virtual objects. Additionally, the study did not investigate the long-term effects of the different sensory encoding conditions on memory retention.
Further research is needed to explore the generalizability of these findings, as well as the potential impact of factors such as task complexity, user characteristics, and the specific design of the virtual environment. Investigating the neural mechanisms underlying the observed memory effects could also provide valuable insights.
Overall, the study's findings contribute to a growing body of research on the role of multisensory feedback in VR and its implications for user experience and learning. However, more work is needed to fully understand the nuances of how different sensory modalities interact to shape our perception and memory of digital content in immersive environments.
Conclusion
This study provides evidence that incorporating both visual and haptic feedback in virtual reality can enhance users' ability to remember the properties of digital objects they have experienced. The results suggest that the integration of touch-based interactions in VR may lead to improved user understanding and retention of virtual content, with potential applications in areas such as education, training, and entertainment.
The findings highlight the importance of considering multisensory experiences in the design of immersive technologies, as leveraging the senses of sight and touch can significantly impact how users perceive and remember virtual environments. Further research is needed to build on these insights and explore the broader implications of multimodal feedback for the development of more engaging and effective VR applications.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
0
Comparing the Effects of Visual, Haptic, and Visuohaptic Encoding on Memory Retention of Digital Objects in Virtual Reality
Lucas Siqueira Rodrigues, Timo Torsten Schmidt, John Nyakatura, Stefan Zachow, Johann Habakuk Israel, Thomas Kosch
Although Virtual Reality (VR) has undoubtedly improved human interaction with 3D data, users still face difficulties retaining important details of complex digital objects in preparation for physical tasks. To address this issue, we evaluated the potential of visuohaptic integration to improve the memorability of virtual objects in immersive visualizations. In a user study (N=20), participants performed a delayed match-to-sample task where they memorized stimuli of visual, haptic, or visuohaptic encoding conditions. We assessed performance differences between the conditions through error rates and response time. We found that visuohaptic encoding significantly improved memorization accuracy compared to unimodal visual and haptic conditions. Our analysis indicates that integrating haptics into immersive visualizations enhances the memorability of digital objects. We discuss its implications for the optimal encoding design in VR applications that assist professionals who need to memorize and recall virtual objects in their daily work.
Read more6/21/2024
0
Investigating Size Congruency Between the Visual Perception of a VR Object and the Haptic Perception of Its Physical World Agent
Wenqi Zheng, Dawei Xiong, Cekai Weng, Jiajun Jiang, Junwei Li, Jinni Zhou, Mingming Fan
The perception of physical objects and miniatures enhances the realism and immersion in VR. This work explores the relationship between haptic feedback from real objects and their visual representations in VR. The study examines how users confirm and adjust the sizes of different virtual objects. The results show that as the size of the virtual cubes increases, users are less likely to perceive the size correctly and need more adjustments. This research provides insights into how haptic sensations and visual inputs interact, contributing to the understanding of visual-haptic illusions in VR environments.
Read more8/16/2024
🏋️
0
Multimedia and Immersive Training Materials Influence Impressions of Learning But Not Learning Outcomes
Benjamin A. Clegg, Alex Karduna, Ethan Holen, Jason Garcia, Matthew G. Rhodes, Francisco R. Ortega
Although the use of technologies like multimedia and virtual reality (VR) in training offer the promise of improved learning, these richer and potentially more engaging materials do not consistently produce superior learning outcomes. Default approaches to such training may inadvertently mimic concepts like naive realism in display design, and desirable difficulties in the science of learning - fostering an impression of greater learning dissociated from actual gains in memory. This research examined the influence of format of instructions in learning to assemble items from components. Participants in two experiments were trained on the steps to assemble a series of bars, that resembled Meccano pieces, into eight different shapes. After training on pairs of shapes, participants rated the likelihood they would remember the shapes and then were administered a recognition test. Relative to viewing a static diagram, viewing videos of shapes being constructed in a VR environment (Experiment 1) or viewing within an immersive VR system (Experiment 2) elevated participants' assessments of their learning but without enhancing learning outcomes. Overall, these findings illustrate how future workers might mistakenly come to believe that technologically advanced support improves learning and prefer instructional designs that integrate similarly complex cues into training.
Read more7/9/2024
🏋️
0
Evaluating the efficacy of haptic feedback, 360{deg} treadmill-integrated Virtual Reality framework and longitudinal training on decision-making performance in a complex search-and-shoot simulation
Akash K Rao, Arnav Bhavsar, Shubhajit Roy Chowdhury, Sushil Chandra, Ramsingh Negi, Prakash Duraisamy, Varun Dutt
Virtual Reality (VR) has made significant strides, offering users a multitude of ways to interact with virtual environments. Each sensory modality in VR provides distinct inputs and interactions, enhancing the user's immersion and presence. However, the potential of additional sensory modalities, such as haptic feedback and 360{deg} locomotion, to improve decision-making performance has not been thoroughly investigated. This study addresses this gap by evaluating the impact of a haptic feedback, 360{deg} locomotion-integrated VR framework and longitudinal, heterogeneous training on decision-making performance in a complex search-and-shoot simulation. The study involved 32 participants from a defence simulation base in India, who were randomly divided into two groups: experimental (haptic feedback, 360{deg} locomotion-integrated VR framework with longitudinal, heterogeneous training) and placebo control (longitudinal, heterogeneous VR training without extrasensory modalities). The experiment lasted 10 days. On Day 1, all subjects executed a search-and-shoot simulation closely replicating the elements/situations in the real world. From Day 2 to Day 9, the subjects underwent heterogeneous training, imparted by the design of various complexity levels in the simulation using changes in behavioral attributes/artificial intelligence of the enemies. On Day 10, they repeated the search-and-shoot simulation executed on Day 1. The results showed that the experimental group experienced a gradual increase in presence, immersion, and engagement compared to the placebo control group. However, there was no significant difference in decision-making performance between the two groups on day 10. We intend to use these findings to design multisensory VR training frameworks that enhance engagement levels and decision-making performance.
Read more4/16/2024