Two-In-One: A Design Space for Mapping Unimanual Input into Bimanual Interactions in VR for Users with Limited Movement

Overview

• Virtual Reality (VR) applications often require users to perform actions with two hands
• Bimanual interactions in VR can resemble real-world interactions, improving realism and immersion
• However, these interactions can pose significant accessibility challenges for people with limited mobility

Plain English Explanation

Virtual reality (VR) applications often require users to use both of their hands to perform tasks and interact with objects in the virtual environment. This can make the experience feel more realistic and engaging. However, these "two-handed" interactions can be very difficult for people who only have full use of one hand, such as those with limited mobility.

There is an opportunity to create accessible techniques that take advantage of users' abilities, but designers currently lack the tools to consider alternative approaches. To address this, the researchers propose a framework called "Two-in-One" that helps create accessible methods for two-handed interactions in VR using only one hand.

The framework has two main components: bimanual interactions and computer assistance. By understanding the different types of two-handed interactions and how computers can assist users, the researchers aim to develop new one-handed techniques that can still allow people with limited mobility to fully engage with VR applications.

Technical Explanation

The researchers' "Two-in-One" framework defines a design space with two key dimensions: bimanual interactions and computer assistance. The bimanual interactions dimension covers the different types of two-handed tasks users may need to perform in VR, such as bimanual teleportation or bimanual teleoperation. The computer assistance dimension considers how technology can help translate these two-handed interactions into accessible one-handed techniques, such as through physics-aware prediction or spatial assistance.

Using this framework, the researchers created three new interaction techniques that allow users with limited mobility to perform bimanual tasks in VR using only one hand. They then evaluated these techniques through a video elicitation study with 17 people who have restricted mobility.

Critical Analysis

The researchers acknowledge that their proposed solutions involve complex tradeoffs between autonomy, agency, and accessibility. While the techniques they developed aimed to make VR more inclusive, the study participants highlighted the need for additional settings and methods to fully accommodate people with limited mobility.

Some potential limitations of the research include the relatively small sample size and the fact that the techniques were only evaluated through a video study rather than direct user testing. Additionally, the framework focuses on translating specific bimanual interactions to one-handed input, but there may be opportunities to rethink VR interactions in more fundamental ways to better serve users with diverse abilities.

Further research could explore a wider range of one-handed techniques, investigate long-term usage and user experiences, and consider broader system-level approaches to making VR truly accessible for all.

Conclusion

This research highlights the accessibility challenges posed by the bimanual interactions common in virtual reality applications. By proposing the "Two-in-One" framework, the researchers have taken an important step towards creating more inclusive VR experiences for users with limited mobility.

While the specific techniques developed show promise, the study also underscores the need for continued innovation and a deeper understanding of the complex tradeoffs involved in designing accessible VR systems. As VR technology continues to evolve, it will be crucial for developers to prioritize inclusivity and ensure that the immersive experiences they create can be enjoyed by people of all abilities.