A Tangible Multi-Display Toolkit to Support the Collaborative Design Exploration of AV-Pedestrian Interfaces

Read original: arXiv:2406.08733 - Published 6/14/2024 by Marius Hoggenmuller, Martin Tomitsch, Callum Parker, Trung Thanh Nguyen, Dawei Zhou, Stewart Worrall, Eduardo Nebot
Total Score

0

A Tangible Multi-Display Toolkit to Support the Collaborative Design Exploration of AV-Pedestrian Interfaces

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • This paper presents a tangible multi-display toolkit to support the collaborative design exploration of autonomous vehicle (AV)-pedestrian interfaces.
  • The toolkit allows designers and stakeholders to physically interact with and experiment with different interface designs in a shared environment.
  • The goal is to better understand how these interfaces can facilitate communication and trust between AVs and pedestrians.

Plain English Explanation

The paper describes a new tool that can help designers and others create and test interfaces for autonomous vehicles (self-driving cars) to communicate with pedestrians (people walking). This is an important problem, as we need ways for AVs and pedestrians to understand each other and feel safe as self-driving cars become more common on our roads.

The tool they developed is a "tangible multi-display toolkit" - this means it uses physical, hands-on components that people can move around and interact with, along with digital displays, to simulate and test different interface designs. This allows designers to collaboratively experiment with various ways the AV could signal its intentions to nearby pedestrians, rather than just thinking about it on a computer screen.

By using this toolkit, the researchers hope to gain better insights into how these AV-pedestrian interfaces can build trust and facilitate clear communication between the two. The physical, collaborative nature of the tool is key, as it allows for richer exploration and faster iteration compared to traditional digital prototyping approaches.

Technical Explanation

The researchers created a tangible multi-display toolkit to support the collaborative design of AV-pedestrian interfaces. The toolkit consists of:

  • A physical scale model of a road intersection with movable AV and pedestrian models
  • Embedded digital displays to simulate AV interface designs
  • Input devices like sliders and buttons to control the AV's behavior

This allows designers and stakeholders to physically interact with and experiment with different interface concepts in a shared environment that mimics real-world conditions. The goal is to better understand how these interfaces can facilitate communication and trust between AVs and pedestrians.

The toolkit supports both static displays (e.g. text, icons) and dynamic animations on the AV model to signal its intentions. Designers can also use the two-handed gestures and immersive sketching capabilities to quickly ideate and iterate on new interface concepts.

The researchers conducted a user study to evaluate the toolkit, finding that it enabled rich co-design experiences where participants could collaboratively explore and discuss AV-pedestrian interaction designs.

Critical Analysis

The paper provides a promising approach to addressing the critical challenge of designing effective communication between AVs and pedestrians. The tangible, collaborative nature of the toolkit allows for richer exploration compared to traditional digital prototyping methods.

However, the study was relatively small-scale, involving only 12 participants. Further research is needed to validate the toolkit's effectiveness with larger and more diverse user groups. Additionally, the paper does not address how the toolkit could be adapted for remote/distributed collaboration, which may become increasingly important as AV development involves geographically dispersed stakeholders.

Another potential limitation is that the toolkit only simulates a single intersection scenario. Expanding the toolkit to handle a wider range of road configurations and traffic situations could enhance its utility and real-world applicability.

Overall, the paper presents an innovative step towards improving AV-pedestrian interface design, but additional research and development will be needed to fully realize the potential of this approach.

Conclusion

This paper introduces a tangible multi-display toolkit that enables collaborative exploration of autonomous vehicle-pedestrian interfaces. By allowing designers and stakeholders to physically interact with and experiment with different interface concepts, the toolkit aims to provide richer insights into how these interfaces can facilitate communication and trust.

The results of the user study suggest that the toolkit can enable productive co-design experiences, but further research is needed to validate its effectiveness at scale and expand its capabilities to handle more diverse real-world scenarios. Nonetheless, this work represents an important contribution towards improving the design of AV-pedestrian interactions, which will be crucial as self-driving cars become more prevalent on our roads.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

A Tangible Multi-Display Toolkit to Support the Collaborative Design Exploration of AV-Pedestrian Interfaces
Total Score

0

A Tangible Multi-Display Toolkit to Support the Collaborative Design Exploration of AV-Pedestrian Interfaces

Marius Hoggenmuller, Martin Tomitsch, Callum Parker, Trung Thanh Nguyen, Dawei Zhou, Stewart Worrall, Eduardo Nebot

The advent of cyber-physical systems, such as robots and autonomous vehicles (AVs), brings new opportunities and challenges for the domain of interaction design. Though there is consensus about the value of human-centred development, there is a lack of documented tailored methods and tools for involving multiple stakeholders in design exploration processes. In this paper we present a novel approach using a tangible multi-display toolkit. Orchestrating computer-generated imagery across multiple displays, the toolkit enables multiple viewing angles and perspectives to be captured simultaneously (e.g. top-view, first-person pedestrian view). Participants are able to directly interact with the simulated environment through tangible objects. At the same time, the objects physically simulate the interface's behaviour (e.g. through an integrated LED display). We evaluated the toolkit in design sessions with experts to collect feedback and input on the design of an AV-pedestrian interface. The paper reports on how the combination of tangible objects and multiple displays supports collaborative design explorations.

Read more

6/14/2024

Designing Interactions With Shared AVs in Complex Urban Mobility Scenarios
Total Score

0

Designing Interactions With Shared AVs in Complex Urban Mobility Scenarios

Marius Hoggenmueller, Martin Tomitsch, Stewart Worrall

In this article, we report on the design and evaluation of an external human-machine interface (eHMI) for a real autonomous vehicle (AV), developed to operate as a shared transport pod in a pedestrianized urban space. We present insights about our human-centered design process, which included testing initial concepts through a tangible toolkit and evaluating 360-degree recordings of a staged pick-up scenario in virtual reality. Our results indicate that in complex mobility scenarios, participants filter for critical eHMI messages; further, we found that implicit cues (i.e., pick-up manoeuvre and proximity to the rider) influence participants' experience and trust, while at the same time more explicit interaction modes are desired. This highlights the importance of considering interactions with shared AVs as a service more holistically, in order to develop knowledge about AV-pedestrian interactions in complex mobility scenarios that complements more targeted eHMI evaluations.

Read more

6/19/2024

Tangible Scenography as a Holistic Design Method for Human-Robot Interaction
Total Score

0

Tangible Scenography as a Holistic Design Method for Human-Robot Interaction

Amy Koike, Bengisu Cagiltay, Bilge Mutlu

Traditional approaches to human-robot interaction design typically examine robot behaviors in controlled environments and narrow tasks. These methods are impractical for designing robots that interact with diverse user groups in complex human environments. Drawing from the field of theater, we present the construct of scenes -- individual environments consisting of specific people, objects, spatial arrangements, and social norms -- and tangible scenography, as a holistic design approach for human-robot interactions. We created a design tool, Tangible Scenography Kit (TaSK), with physical props to aid in design brainstorming. We conducted design sessions with eight professional designers to generate exploratory designs. Designers used tangible scenography and TaSK components to create multiple scenes with specific interaction goals, characterize each scene's social environment, and design scene-specific robot behaviors. From these sessions, we found that this method can encourage designers to think beyond a robot's narrow capabilities and consider how they can facilitate complex social interactions.

Read more

6/4/2024

Metaverse for Safer Roadways: An Immersive Digital Twin Framework for Exploring Human-Autonomy Coexistence in Urban Transportation Systems
Total Score

0

Metaverse for Safer Roadways: An Immersive Digital Twin Framework for Exploring Human-Autonomy Coexistence in Urban Transportation Systems

Tanmay Vilas Samak, Chinmay Vilas Samak, Venkat Narayan Krovi

Societal-scale deployment of autonomous vehicles requires them to coexist with human drivers, necessitating mutual understanding and coordination among these entities. However, purely real-world or simulation-based experiments cannot be employed to explore such complex interactions due to safety and reliability concerns, respectively. Consequently, this work presents an immersive digital twin framework to explore and experiment with the interaction dynamics between autonomous and non-autonomous traffic participants. Particularly, we employ a mixed-reality human-machine interface to allow human drivers and autonomous agents to observe and interact with each other for testing edge-case scenarios while ensuring safety at all times. To validate the versatility of the proposed framework's modular architecture, we first present a discussion on a set of user experience experiments encompassing 4 different levels of immersion with 4 distinct user interfaces. We then present a case study of uncontrolled intersection traversal to demonstrate the efficacy of the proposed framework in validating the interactions of a primary human-driven, autonomous, and connected autonomous vehicle with a secondary semi-autonomous vehicle. The proposed framework has been openly released to guide the future of autonomy-oriented digital twins and research on human-autonomy coexistence.

Read more

9/11/2024