Enhancement of Co-located Shared VR Experiences: Representing Non-HMD Observers on Both HMD and 2D Screen

Read original: arXiv:2408.07470 - Published 8/15/2024 by Zixuan Guo, Wenge Xu, Hongyu Wang, Tingjie Wan, Nilufar Baghaei, Cheng-Hung Lo, Hai-Ning Liang
Total Score

0

Enhancement of Co-located Shared VR Experiences: Representing Non-HMD Observers on Both HMD and 2D Screen

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • This paper explores ways to enhance co-located shared virtual reality (VR) experiences by representing non-HMD (head-mounted display) observers on both HMD and 2D screens.
  • The researchers aim to improve user engagement and awareness in collaborative VR environments where some participants use HMDs while others observe on 2D displays.

Plain English Explanation

In virtual reality (VR) experiences, some people wear special headsets called HMDs that fully immerse them in the virtual world. However, other people may prefer to just observe the VR scene on a regular 2D screen. This can create challenges for collaboration and awareness between the HMD users and the 2D observers.

To address this, the researchers explored techniques to represent non-HMD observers on both the HMD and 2D screens. The goal was to enhance the overall shared VR experience and make it easier for everyone to understand what the others are doing, regardless of their display setup.

By finding ways to seamlessly integrate the 2D observers into the virtual environment, the researchers hoped to improve user engagement and create a more cohesive collaborative experience for all participants.

Technical Explanation

The paper describes several approaches the researchers explored for representing non-HMD observers in co-located shared VR experiences:

  1. Avatar Representation: The researchers experimented with different ways of visualizing the 2D observers' avatars within the virtual environment, including full-body avatars and more abstract representations.

  2. Perspective Matching: To help HMD users understand the 2D observers' viewpoint, the researchers investigated techniques to align the 2D observers' visual perspective with that of the HMD users.

  3. Virtual Camera Views: In addition to the avatar representations, the researchers explored providing HMD users with virtual camera views that showed the 2D observers and their interactions within the shared VR space.

Through a series of user studies, the researchers evaluated the effectiveness of these approaches in enhancing awareness, engagement, and collaboration between HMD users and 2D observers in co-located shared VR experiences.

Critical Analysis

The paper acknowledges that while the proposed techniques show promise, there are still some limitations and areas for further research. For example, the effects of different avatar representations on user experience and collaboration need to be explored in more depth.

Additionally, the researchers note that the layout and dimensionality of the VR environment may also play a significant role in the effectiveness of the proposed approaches, and this should be investigated further.

Overall, the paper presents a thoughtful exploration of ways to enhance co-located shared VR experiences, but more research is needed to fully understand the optimal strategies for representing non-HMD observers and facilitating effective collaboration in these mixed-reality settings.

Conclusion

This paper tackles the important challenge of improving shared VR experiences for both HMD users and 2D observers. By exploring various techniques to represent non-HMD participants within the virtual environment, the researchers aim to create more engaging and collaborative co-located VR experiences.

The findings from this work contribute to a growing body of research on enhancing the representation of remote collaborators and improving the realism and impact of virtual avatars. As mixed-reality technologies continue to advance, this research provides valuable insights for designers and developers working to create more inclusive and effective shared VR experiences.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

Enhancement of Co-located Shared VR Experiences: Representing Non-HMD Observers on Both HMD and 2D Screen
Total Score

0

Enhancement of Co-located Shared VR Experiences: Representing Non-HMD Observers on Both HMD and 2D Screen

Zixuan Guo, Wenge Xu, Hongyu Wang, Tingjie Wan, Nilufar Baghaei, Cheng-Hung Lo, Hai-Ning Liang

Virtual reality (VR) not only allows head-mounted display (HMD) users to immerse themselves in virtual worlds but also to share them with others. When designed correctly, this shared experience can be enjoyable. However, in typical scenarios, HMD users are isolated by their devices, and non-HMD observers lack connection with the virtual world. To address this, our research investigates visually representing observers on both HMD and 2D screens to enhance shared experiences. The study, including five representation conditions, reveals that incorporating observer representation positively impacts both HMD users and observers. For how to design and represent them, our work shows that HMD users prefer methods displaying real-world visuals, while observers exhibit diverse preferences regarding being represented with real or virtual images. We provide design guidelines tailored to both displays, offering valuable insights to enhance co-located shared VR experiences for HMD users and non-HMD observers.

Read more

8/15/2024

Working in Extended Reality in the Wild: Worker and Bystander Experiences of XR Virtual Displays in Real-World Settings
Total Score

0

Working in Extended Reality in the Wild: Worker and Bystander Experiences of XR Virtual Displays in Real-World Settings

Leonardo Pavanatto, Verena Biener, Jennifer Chandran, Snehanjali Kalamkar, Feiyu Lu, John J. Dudley, Jinghui Hu, G. Nikki Ramirez-Saffy, Per Ola Kristensson, Alexander Giovannelli, Luke Schlueter, Jorg Muller, Jens Grubert, Doug A. Bowman

Although access to sufficient screen space is crucial to knowledge work, workers often find themselves with limited access to display infrastructure in remote or public settings. While virtual displays can be used to extend the available screen space through extended reality (XR) head-worn displays (HWD), we must better understand the implications of working with them in public settings from both users' and bystanders' viewpoints. To this end, we conducted two user studies. We first explored the usage of a hybrid AR display across real-world settings and tasks. We focused on how users take advantage of virtual displays and what social and environmental factors impact their usage of the system. A second study investigated the differences between working with a laptop, an AR system, or a VR system in public. We focused on a single location and participants performed a predefined task to enable direct comparisons between the conditions while also gathering data from bystanders. The combined results suggest a positive acceptance of XR technology in public settings and show that virtual displays can be used to accompany existing devices. We highlighted some environmental and social factors. We saw that previous XR experience and personality can influence how people perceive the use of XR in public. In addition, we confirmed that using XR in public still makes users stand out and that bystanders are curious about the devices, yet have no clear understanding of how they can be used.

Read more

8/20/2024

Exploring Remote Collaboration: The Impact of Avatar Representation on Dyadic Haptic Interactions in Shared Virtual Environments
Total Score

0

Exploring Remote Collaboration: The Impact of Avatar Representation on Dyadic Haptic Interactions in Shared Virtual Environments

Genki Sasaki, Hiroshi Igarashi

This study is the first to explore the interplay between haptic interaction and avatar representation in Shared Virtual Environments (SVEs). We focus on their combined effect on social presence and task-related scores in dyadic collaborations. In a series of experiments, participants performed the plate control task with haptic interaction under four avatar representation conditions: avatars of both participant and partner were displayed, only the participant's avatar was displayed, only the partner's avatar was displayed, and no avatars were displayed. The study finds that avatar representation, especially of the partner, significantly enhances the perception of social presence, which haptic interaction alone does not fully achieve. In contrast, neither the presence nor the type of avatar representation impacts the task performance or participants' force effort of the task, suggesting that haptic interaction provides sufficient interaction cues for the execution of the task. These results underscore the significance of integrating both visual and haptic modalities to optimize remote collaboration experiences in virtual environments, ensuring effective communication and a strong sense of social presence.

Read more

9/16/2024

Perception in Pixels: Understanding Avatar Representation in Video-Mediated Collaborative Interactions
Total Score

0

Perception in Pixels: Understanding Avatar Representation in Video-Mediated Collaborative Interactions

Pitch Sinlapanuntakul, Mark Zachry

Despite the abundance of research concerning virtual reality (VR) avatars, the impact of screen-based or augmented reality (AR) avatars for real-world applications remain relatively unexplored. Notably, there is a lack of research examining video-mediated collaborative interaction experiences using AR avatars for goal-directed group activities. This study bridges this gap with a mixed-methods, quasi-experimental user study that investigates video-based small-group interactions when employing AR avatars as opposed to traditional video for user representation. We found that the use of avatars positively influenced self-esteem and video-based collaboration satisfaction. In addition, our group interview findings highlight experiences and perceptions regarding the dynamic use of avatars in video-mediated collaborative interactions, including benefits, challenges, and factors that would influence a decision to use avatars. This study contributes an empirical understanding of avatar representation in mediating video-based collaborative interactions, implications and perceptions surrounding the adoption of AR avatars, and a comprehensive comparison of key characteristics between user representations.

Read more

5/8/2024