Investigating Size Congruency Between the Visual Perception of a VR Object and the Haptic Perception of Its Physical World Agent

Read original: arXiv:2408.08018 - Published 8/16/2024 by Wenqi Zheng, Dawei Xiong, Cekai Weng, Jiajun Jiang, Junwei Li, Jinni Zhou, Mingming Fan
Total Score

0

Investigating Size Congruency Between the Visual Perception of a VR Object and the Haptic Perception of Its Physical World Agent

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • Investigates the size congruency between the visual perception of a virtual reality (VR) object and the haptic (touch) perception of its physical world agent
  • Examines the integration of visual and haptic cues in a cross-modal size perception task
  • Explores how the size of a VR object is perceived compared to the size of its physical counterpart

Plain English Explanation

The researchers looked at how the size of a virtual object in VR is perceived compared to the size of the corresponding physical object that a person can touch. They wanted to see if the visual information from the VR object and the haptic (touch) information from the physical object would be integrated in a way that led to a congruent perception of the size, or if there would be a mismatch.

The researchers had participants interact with a virtual cube in VR and a physical cube that matched the virtual one. They measured how the participants perceived the size of each cube, and then looked at whether the visual and haptic size perceptions were aligned. This allowed them to better understand how the brain combines different sensory cues when judging the size of objects.

Technical Explanation

The study used a within-subjects experimental design where participants interacted with both a virtual cube in VR and a physical cube that matched the virtual one. The size of the cubes was varied across trials.

Participants were asked to judge the size of each cube using a visual matching task for the virtual cube and a haptic (touch) matching task for the physical cube. This allowed the researchers to measure the perceived size of the cubes based on visual and haptic cues independently.

The results showed that there was often a mismatch between the perceived size of the virtual cube and the perceived size of the physical cube, even when their actual sizes were the same. This indicates that the visual and haptic size cues were not fully integrated in a congruent manner.

The researchers suggest this visual-haptic size illusion arises due to differences in how the brain processes visual and haptic information about object size. This has implications for the design of cross-modal experiences in VR and other mixed-reality applications.

Critical Analysis

The paper provides a thorough experimental investigation of the visual-haptic size illusion, but it does not fully explain the underlying mechanisms driving this phenomenon. The authors suggest that differences in how the brain processes visual and haptic size cues are responsible, but more research is needed to confirm this and elucidate the specific neural processes involved.

Additionally, the study only looked at a single object shape (a cube) and a limited range of sizes. It would be valuable to examine whether the visual-haptic size illusion generalizes to other object shapes and a wider variety of sizes to better understand the scope and boundaries of this effect.

The authors also do not discuss potential individual differences in the strength of the visual-haptic size illusion. It's possible that some people are more susceptible to this illusion than others, which could have implications for the design of cross-modal VR experiences.

Conclusion

This study provides important insights into the integration of visual and haptic cues when perceiving the size of objects. The finding that there is often a mismatch between the perceived size of a virtual object and its physical counterpart has significant implications for the design of mixed-reality experiences, where seamless cross-modal integration is crucial for a naturalistic and immersive user experience. Further research is needed to fully understand the mechanisms underlying this visual-haptic size illusion and how it can be mitigated in practical applications.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

Investigating Size Congruency Between the Visual Perception of a VR Object and the Haptic Perception of Its Physical World Agent
Total Score

0

Investigating Size Congruency Between the Visual Perception of a VR Object and the Haptic Perception of Its Physical World Agent

Wenqi Zheng, Dawei Xiong, Cekai Weng, Jiajun Jiang, Junwei Li, Jinni Zhou, Mingming Fan

The perception of physical objects and miniatures enhances the realism and immersion in VR. This work explores the relationship between haptic feedback from real objects and their visual representations in VR. The study examines how users confirm and adjust the sizes of different virtual objects. The results show that as the size of the virtual cubes increases, users are less likely to perceive the size correctly and need more adjustments. This research provides insights into how haptic sensations and visual inputs interact, contributing to the understanding of visual-haptic illusions in VR environments.

Read more

8/16/2024

Comparing the Effects of Visual, Haptic, and Visuohaptic Encoding on Memory Retention of Digital Objects in Virtual Reality
Total Score

0

Comparing the Effects of Visual, Haptic, and Visuohaptic Encoding on Memory Retention of Digital Objects in Virtual Reality

Lucas Siqueira Rodrigues, Timo Torsten Schmidt, John Nyakatura, Stefan Zachow, Johann Habakuk Israel, Thomas Kosch

Although Virtual Reality (VR) has undoubtedly improved human interaction with 3D data, users still face difficulties retaining important details of complex digital objects in preparation for physical tasks. To address this issue, we evaluated the potential of visuohaptic integration to improve the memorability of virtual objects in immersive visualizations. In a user study (N=20), participants performed a delayed match-to-sample task where they memorized stimuli of visual, haptic, or visuohaptic encoding conditions. We assessed performance differences between these encoding modalities through error rates and response times. We found that visuohaptic encoding significantly improved memorization accuracy compared to unimodal visual and haptic conditions. Our analysis indicates that integrating haptics into immersive visualizations enhances the memorability of digital objects. We discuss its implications for the optimal encoding design in VR applications that assist professionals who need to memorize and recall virtual objects in their daily work.

Read more

9/17/2024

Stretch or Vibrate? Rendering Spatial Information of Static and Moving Objects in VR via Haptic Feedback for Blind People
Total Score

0

Stretch or Vibrate? Rendering Spatial Information of Static and Moving Objects in VR via Haptic Feedback for Blind People

Jiasheng Li, Zining Zhang, Zeyu Yan, Yuhang Zhao, Huaishu Peng

Perceiving spatial information of a virtual object (e.g., direction, distance) is critical yet challenging for blind users seeking an immersive virtual reality experience. To facilitate VR accessibility for blind users, in this paper, we investigate the effectiveness of two types of haptic cues--vibrotactile and skin-stretch cues--in conveying the spatial information of a virtual object when applied to the dorsal side of a blind user's hand. We conducted a user study with 10 blind users to investigate how they perceive static and moving objects in VR with a custom-made haptic apparatus. Our results reveal that blind users can more accurately understand an object's location and movement when receiving skin-stretch cues, as opposed to vibrotactile cues. We discuss the pros and cons of both types of haptic cues and conclude with design recommendations for future haptic solutions for VR accessibility.

Read more

8/14/2024

Effects of Multisensory Feedback on the Perception and Performance of Virtual Reality Hand-Retargeted Interaction
Total Score

0

Effects of Multisensory Feedback on the Perception and Performance of Virtual Reality Hand-Retargeted Interaction

Hyunyoung Jang, Jinwook Kim, Jeongmi Lee

Retargeting methods that modify the visual representation of real movements have been widely used to expand the interaction space and create engaging virtual reality experiences. For optimal user experience and performance, it is essential to specify the perception of retargeting and utilize the appropriate range of modification parameters. However, previous studies mostly concentrated on whether users perceived the target sense or not and rarely examined the perceptual accuracy and sensitivity to retargeting. Moreover, it is unknown how the perception and performance in hand-retargeted interactions are influenced by multisensory feedback. In this study, we used rigorous psychophysical methods to specify users' perceptual accuracy and sensitivity to hand-retargeting and provide acceptable ranges of retargeting parameters. We also presented different multisensory feedback simultaneously with the retargeting to probe its effect on users' perception and task performance. The experimental results showed that providing continuous multisensory feedback, proportionate to the distance between the virtual hand and the targeted destination, heightened the accuracy of users' perception of hand retargeting without altering their perceptual sensitivity. Furthermore, the utilization of multisensory feedback considerably improved the precision of task performance, particularly at lower gain factors. Based on these findings, we propose design guidelines and potential applications of VR hand-retargeted interactions and multisensory feedback for optimal user experience and performance.

Read more

4/8/2024