Augmenting Static Visualizations with PapARVis Designer

Overview

• This paper presents an authoring environment for augmenting static visualizations with virtual content in augmented reality.
• The environment integrates all steps of the design and deployment workflow, including an extension to the Vega visualization language, a preview feature, and debug hints.
• The authors inform their design through a design space of four ways to augment static visualizations, and demonstrate the expressiveness of their tool through examples.
• A user study shows high user satisfaction and the ability for participants to create augmented visualizations in an average of 4.63 minutes.

Plain English Explanation

The paper describes a new tool that makes it easier to create augmented reality (AR) experiences that combine physical, static visualizations like posters or books with virtual, digital content. Traditionally, designing these types of "augmented visualizations" has involved using different tools and devices, without a way to easily design and test both the physical and virtual aspects together.

The new authoring environment presented in the paper aims to streamline this process. It has three key features: 1) an extension to the popular Vega visualization language that allows authors to specify the virtual content, 2) a preview mode that lets authors see how the physical and virtual elements will look together, and 3) debugging tools to help ensure the two elements are properly aligned and integrated.

The authors developed this tool based on their analysis of four different ways that static visualizations can be augmented with virtual content. They demonstrate the versatility of their approach by showing examples of augmented books, posters, projections, and large wall-sized visualizations.

In a user study, participants were able to create their own augmented visualizations using the tool in less than 5 minutes on average, and reported being highly satisfied with the experience. This suggests the new authoring environment can make it much easier for designers and researchers to leverage the benefits of combining physical and digital elements in their visualizations.

Technical Explanation

The core contribution of this paper is the design and implementation of an authoring environment for augmented visualizations. The environment integrates three key features:

1. Vega Extension: The authors extend the popular Vega visualization language to allow authors to specify the virtual content that will be overlaid on the physical, static visualization. This provides a unified way to design both the physical and digital elements.

2. Preview: The authoring environment includes a preview mode that lets authors see how the physical and virtual content will be combined in the final augmented reality experience. This allows for iterative design and debugging.

3. Debug Hints: To help ensure valid combinations of physical and virtual content, the environment provides debug hints that flag potential issues or conflicts between the two elements.

The authors ground their design in a taxonomy of four ways that static visualizations can be augmented:

, , , and . They demonstrate the expressiveness of their tool through examples spanning different types of physical visualizations, from books and posters to wall-sized displays.

A user study with 12 participants shows that they were able to create augmented visualizations using the authoring environment in an average of 4.63 minutes, and reported high levels of satisfaction with the experience. This suggests the environment succeeds in streamlining the authoring process for these types of augmented visualizations.

Critical Analysis

The paper provides a compelling solution to the challenge of authoring augmented visualizations that combine physical and virtual elements. By integrating the design of both components into a single environment, the authors make it much easier for designers to create these types of experiences.

However, the paper does not address some potential limitations or areas for future work. For example, the authoring environment is focused on 2D static visualizations, and it's unclear how well it would extend to 3D physical objects or more complex virtual content. Additionally, the user study was relatively small, and more extensive real-world testing would be needed to fully validate the usability and practicality of the tool.

Another area for further research could be exploring ways to preserve the history and context of augmented visualizations as they are edited and updated over time. This could help ensure the integrity and provenance of these hybrid physical-digital artifacts.

Overall, the authoring environment presented in this paper represents an important step towards making it easier to develop multi-platform scientific visualization applications that leverage the strengths of both the physical and digital worlds. With further refinement and expansion, this type of tool could become a valuable resource for data visualization researchers and designers.

Conclusion

This paper introduces a novel authoring environment that simplifies the process of creating augmented reality experiences that combine physical, static visualizations with virtual, digital content. By integrating key features like a Vega extension, preview mode, and debugging tools, the environment streamlines the design and deployment workflow.

The authors' taxonomy of four ways to augment static visualizations, and the diverse examples they demonstrate, highlight the broad applicability of this approach. And the positive results from the user study suggest the environment can enable even non-expert users to quickly and effectively augment sports videos or visualizations with virtual content.

Overall, this work represents an important contribution towards making it easier for designers, researchers, and the general public to leverage the unique benefits of combining physical and digital elements in their visualizations and information experiences.